[torqueusers] Considerations for Clusters Running Lots of Small Jobs
jbernstein at penguincomputing.com
Thu Dec 4 13:56:45 MST 2008
The TORQUE documentation contains a nice explanation for running TORQUE
on a large cluster. But are these ideas also pertinent to say a very
small, say four node cluster, running, say many thousands of short lived
jobs. Its very common in the BioIT space to have a comparitively small
cluster, but with the many thousands of jobs lasting only a few seconds.
Does anybody have an guidance on configuration or even source level
changes for a high throughput, small cluster, with short lived jobs. Or
would we expect the same changes for a large cluster to also be
applicable to this configuration?
More information about the torqueusers