How to optimally configure memcache running on 16 cores 144G ram server?

Posted by Ivko Maksimovic on Server Fault See other posts from Server Fault or by Ivko Maksimovic
Published on 2012-09-14T04:15:08Z Indexed on 2012/09/14 15:40 UTC
Read the original article Hit count: 276

Filed under:

configuration

|

memcached

Memcache is the only important app running on the server
Server has 16 cores and 144G RAM
Memcache is given 135G
Memcache runs at 32 threads
Gigabit network, test shows at least 300Mbit/s availability on network port
600 connections
3000 requests per second
Say that memcache (memory) usage is at 50% - it's definitely not full

As we increase number of requests towards server, requests slow down (from 8ms to 100ms per request) but server load remains 0.00. We suspect this can be solved by adjusting configuration but we don't understand many of the configuration parameters (besides, maybe, the number of threads).

Any ideas?

© Server Fault or respective owner

Related posts about configuration

SSIS Configuration error: Cannot retrieve configuration table schema

as seen on Stack Overflow - Search for 'Stack Overflow'
I'm trying to add a simple configuration to a SSIS package, of type SQL Server, so stored in a table. At the end of the wizard, when it goes to try and write a new row to the nominated table to store the configuration it fails with the error: TITLE: Microsoft Visual Studio Could not complete wizard… >>> More
SharePoint: Can't Connect to a Configuration Database When Using Configuration Wizard

as seen on Stack Overflow - Search for 'Stack Overflow'
Hello everyone. I wonder if you could help me with the following problem: We have a SharePoint farm consisted of two servers with an NLB (a load balancer), a database server and an index server (4 servers in total). The issues initially appeared when we were trying to change Search settings via Shared… >>> More
Module configuration and layout configuration in zend framework.

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi all, I got some codes from other articles for configuring module and layout in zend framework. I tried with in my local. i didn't get different layout for default and admin module. Here is my code for configuring module and layout for zend framework. configs/application.ini [production] #… >>> More
Xml configuration versus Annotation based configuration

as seen on Stack Overflow - Search for 'Stack Overflow'
In a few large projects i have been working on lately it seems to become increasingly important to choose one or the other (XML or Annotation). As projects grow, consistency is very important for maintainability. My question is, what do people prefer. Do you prefer XML based or Annotation based… >>> More
Creating packages in code - Package Configurations

as seen on SQLIS - Search for 'SQLIS'
Continuing my theme of building various types of packages in code, this example shows how to building a package with package configurations. Incidentally it shows you how to add a variable, and a connection too. It covers the five most common configurations: Configuration File Indirect Configuration… >>> More

Related posts about memcached

Memcached Debuging/Server Logs Monitor the Memcached Servers?

as seen on Server Fault - Search for 'Server Fault'
I have chat engine which is based on the Memcached variables, putting them into arrays and reading them in other end via jquery, which works fine 95% of the times, however when the server load is high memcached (presume its the memcached) the crash and browser gets stucks up. I dont think its jquery… >>> More
yum error when installing memcached

as seen on Server Fault - Search for 'Server Fault'
Hi, trying to install memcached with "yum install memcached" and i'm getting all these errors which I have no idea how to solve. Setting up Install Process Resolving Dependencies -- Running transaction check --- Package memcached.x86_64 0:1.4.5-1.el5.rf set to be updated -- Processing Dependency:… >>> More
First round playing with Memcached

as seen on Geeks with Blogs - Search for 'Geeks with Blogs'
To be honest I have not been very interested in the caching before I’m going to a project which would be using the multi-site deployment and high connection and concurrency and very sensitive to the user experience. That means we must cache the output data for better performance. After looked for… >>> More
Slow Memcached: Average 10ms memcached `get`

as seen on Server Fault - Search for 'Server Fault'
We're using Newrelic to measure our Python/Django application performance. Newrelic is reporting that across our system "Memcached" is taking an average of 12ms to respond to commands. Drilling down into the top dozen or so web views (by # of requests) I can see that some Memcache get take up to… >>> More
NoSQL Memcached API for MySQL: Latest Updates

as seen on Oracle Blogs - Search for 'Oracle Blogs'
With data volumes exploding, it is vital to be able to ingest and query data at high speed. For this reason, MySQL has implemented NoSQL interfaces directly to the InnoDB and MySQL Cluster (NDB) storage engines, which bypass the SQL layer completely. Without SQL parsing and optimization, Key-Value… >>> More