[torqueusers] Considerations for Clusters Running Lots of Small Jobs

Joshua Bernstein jbernstein at penguincomputing.com
Thu Dec 4 13:56:45 MST 2008


Hi All,

	The TORQUE documentation contains a nice explanation for running TORQUE 
on a large cluster. But are these ideas also pertinent to say a very 
small, say four node cluster, running, say many thousands of short lived 
jobs. Its very common in the BioIT space to have a comparitively small 
cluster, but with the many thousands of jobs lasting only a few seconds. 
Does anybody have an guidance on configuration or even source level 
changes for a high throughput, small cluster, with short lived jobs. Or 
would we expect the same changes for a large cluster to also be 
applicable to this configuration?

-Joshua Bernstein
Software Engineer
Penguin Computing


More information about the torqueusers mailing list