[torqueusers] Submission number limits?

[Jeremy Mann]

Good afternoon all, I have one user that wants to submit roughly 140,000
jobs to our queue. We tried it last week and it never worked. It took
nearly an hour to submit all of them, then the PBS scheduler would stop
responding and give:

05/02/2008 14:39:50;0100; pbs_sched;Req;;Leaving schedule

05/02/2008 14:39:50;0080; pbs_sched;Svr;main;brk point 760373248
05/02/2008 14:39:53;0100; pbs_sched;Req;;Entering Schedule
05/02/2008 14:42:53;0002; pbs_sched;Svr;toolong;alarm call

The jobs are quite small and they run for about a minute. Now we're
thinking about breaking them up into 100 or 1000 job chunks.

I'm curious if the number of jobs being submitted, in our case 140,000, is
too large for PBS/Torque to handle.

Torque 2.1.2 x86_64 and the built in scheduler (not MAUI)

-- 
Jeremy Mann
jeremy at biochem.uthscsa.edu

University of Texas Health Science Center
Bioinformatics Core Facility
http://www.bioinformatics.uthscsa.edu
Phone: (210) 567-2672