[torqueusers] File descriptor limits with mpiexec and pbs/torque

Maestas, Christopher Daniel cdmaest at sandia.gov
Wed Nov 3 13:59:47 MST 2004


We recently discovered when launching > 504 processes on a system you
hit a file descriptor limit.
If you add the following to the startup script of your pbs_mom:
ulimit -n 4096

And ensure that the fs.file-max parameter is high enough in sysctl.conf
fs.file-max = 65536

You can launch job sizes > 504.  This is tested with torque 1.1.0p4 and
mpiexec-0.77 ....
We modified the pbs_mom startup script from a modified Nico rpm for
1.1.0p4. :-)

-- Chris
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://www.supercluster.org/pipermail/torqueusers/attachments/20041103/fb8cd9c0/attachment-0001.html

More information about the torqueusers mailing list