Linux 2.6.31 Scheduler and Multithreaded Jobs

Posted by dsimcha on Stack Overflow See other posts from Stack Overflow or by dsimcha
Published on 2010-05-13T16:43:41Z Indexed on 2010/05/13 16:54 UTC
Read the original article Hit count: 390

Filed under:

scheduler

|

multithreading

|

linux

|

linux-kernel

|

Performance

I run massively parallel scientific computing jobs on a shared Linux computer with 24 cores. Most of the time my jobs are capable of scaling to 24 cores when nothing else is running on this computer. However, it seems like when even one single-threaded job that isn't mine is running, my 24-thread jobs (which I set for high nice values) only manage to get ~1800% CPU (using Linux notation). Meanwhile, about 500% of the CPU cycles (again, using Linux notation) are idle. Can anyone explain this behavior and what I can do about it to get all of the 23 cores that aren't being used by someone else?

Notes:

In case it's relevant, I have observed this on slightly different kernel versions, though I can't remember which off the top of my head.
The CPU architecture is x64. Is it at all possible that the fact that my 24-core jobs are 32-bit and the other jobs I'm competing w/ are 64-bit is relevant?

Edit: One thing I just noticed is that going up to 30 threads seems to alleviate the problem to some degree. It gets me up to ~2100% CPU.

© Stack Overflow or respective owner

Related posts about scheduler

Task scheduler "hidden" only hides task, not process

as seen on Server Fault - Search for 'Server Fault'
I am trying to make an application that acts like a desktop application for all the computers in our network. I have already got a windows forms app that works like I want it to, and I'm using the task scheduler to start it on login. We would really like it if the process as well as the task is… >>> More
Windows Scheduler OR SQL Server Job for sending out digest e-mails

as seen on Stack Overflow - Search for 'Stack Overflow'
Will be sending out e-mails from an application on a scheduled basis. I have an EmailController in my ASP.NET MVC application with action methods, one for each kind of notification/e-mail, that will need to be called at different times during the week. Question: Is Windows Scheduler (running… >>> More
Windows Server 2008 Task Scheduler Tasks Not Executing

as seen on Server Fault - Search for 'Server Fault'
I've been having an intermittent problem for some time now with the Windows Task Scheduler that I can't work out. I use the task scheduler to run a C# app I've written that has various plugins used to ensure production systems are working. This task scheduler itself is actually a production system… >>> More
Quartz scheduler is failing to start the cron job

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi I am using Quartz scheduler to trigger a cron which needs to perform a host of activities. My Code for the same is as follow: In the init() method of my InitServlet class, I am defining my TimerServer public class InitServlet extends HttpServlet { public void init(ServletConfig config)… >>> More
How is this Quartz Cron Expression executed

as seen on Stack Overflow - Search for 'Stack Overflow'
I have a the following; private String cronExpression = ""; private final String jobID = "MyJObID"; ... Scheduler scheduler = ServiceLocator.getInstance().getScheduler(); CronTrigger trigger = new CronTrigger(jobID , Scheduler.DEFAULT_GROUP, cronExpression); JobDetail jobDetail = new JobDetail(jobID… >>> More

Related posts about multithreading

C++ Multithreading on Unix

as seen on Programmers - Search for 'Programmers'
I have two related questions: 1) Are there any good books for multithreading in C++, especially now that C++11 contains multithreading in the standard library? 2) I have the Wrox Programming on Unix book (1000 pages fat red one) and within it, it uses the Unix Thread class. How does this code relate… >>> More
what are the difficulties of operating system multithreading?

as seen on Stack Overflow - Search for 'Stack Overflow'
I am reading a book that compares two ways of implementing threads, Middleware Threads and OS Threads. I have a question about these sentences: "A difficulty of operating system multithreading, however, is performance overhead. Since it is the operating system that is involved in switching threads… >>> More
TCP multicast and multithreading

as seen on Stack Overflow - Search for 'Stack Overflow'
I need to come up with clients that can multicast to other clients reliably. That implies I'll be using TCP to connect reliably between clients within a multicast group. Doesn't that come up to n^2 number of connections? That seems a little silly to me. Wouldn't/shouldn't there be a way to more easily… >>> More
How to achieve multithreading using JavaScript with IE6?

as seen on Stack Overflow - Search for 'Stack Overflow'
How to achieve multithreading using JavaScript with IE6? Is there a third party library to do this? >>> More
Multithreading recommendation based on program description

as seen on Stack Overflow - Search for 'Stack Overflow'
I would like to describe some specifics of my program and get feedback on what the best multithreading model to use would be most applicable. I've spent a lot of time now reading on ThreadPool, Threads, Producer/Consumer, etc. and have yet to come to solid conclusions. I have a list of files (all… >>> More