[torqueusers] Submitting very short jobs

James A. Peltier jpeltier at sfu.ca
Mon Oct 29 09:08:19 MDT 2012


We use Torque routing and Maui priorities to set a much higher priority to jobs that run for short periods.  This allows for those short running jobs to get on more frequently.  Add to that fairshare and we're able to roughly balance out the jobs that are running.

----- Original Message -----
| Hi,
| 
| we have for a long time used maui/torque, and it has worked really
| well
| for out applications (mpi-jobs with many cores and execution times of
| days/weeks).
| 
| But, we have other applications which instead consists of
| hundreds/thousands of single core very short applications (a few
| seconds).
| 
| Haven't tried yet, but I imagine that due overhead it would be
| inefficient to use maui/torque in the same way as we have done
| previously.
| 
| I'm sure I'm not the first one with this kind of problem, and am just
| wondering if there are any best practices regarding this kind of
| problem.
| 
| Thanks!
| 
| /jon
| _______________________________________________
| torqueusers mailing list
| torqueusers at supercluster.org
| http://www.supercluster.org/mailman/listinfo/torqueusers
| 

-- 
James A. Peltier
Manager, IT Services - Research Computing Group
Simon Fraser University - Burnaby Campus
Phone   : 778-782-6573
Fax     : 778-782-3045
E-Mail  : jpeltier at sfu.ca
Website : http://www.sfu.ca/itservices
          http://blogs.sfu.ca/people/jpeltier

"The smartest people are constantly revising their understanding, reconsidering a problem they thought they’d already solved. They’re open to new points of view, new information, new ideas, contradictions, and challenges to their own way of thinking." - Jeff Bezos


More information about the torqueusers mailing list