[torqueusers] can user limit max jobs running

Gus Correa gus at ldeo.columbia.edu
Wed Apr 18 10:40:11 MDT 2012


On 04/18/2012 12:20 PM, Ashish Agarwal wrote:
> The slot limit is exactly what I'm looking for, but:
>
> * It is not mentioned in our man pages. I read now the man page on
> clusterresources.com <http://clusterresources.com>, which is quite
> different than our installed man page.
>
> * It works on one of our clusters, but on a second one I get "qsub: Bad
> Job Array Request." Does this feature have to be enabled? Or is it only
> available from a certain version? The cluster it works on is qsub
> version: 2.5.10, and the one it does not work on is version: 2.4.12.
>
>

As far as I can tell, by looking at 2.4.11 and 2.5.9,
this feature is absent in 2.4 and isn't mentioned on
its man pages, whereas the 2.5 man page has the
"An optional slot limit ... " additional text
under '-t array_request'.


> On Wed, Apr 18, 2012 at 11:26 AM, Al Taufer
> <ataufer at adaptivecomputing.com <mailto:ataufer at adaptivecomputing.com>>
> wrote:
>
>     It sounds like slot limits on a job array would do what you want. The
>     man page for qsub says
>
>     An optional slot limit can be specified to limit the amount  of jobs
>     that  can  run concurrently in the job array. The default value is
>     unlimited. The slot limit must be the last thing specified in the
>     array_request and is delimited from the array by a percent sign (%).
>
>     qsub script.sh -t 0-299%5
>
>     This sets the slot limit to 5. Only 5 jobs from this array can run at
>     the same time.
>
>     On Wed, Apr 18, 2012 at 8:22 AM, Ashish Agarwal
>     <agarwal1975 at gmail.com <mailto:agarwal1975 at gmail.com>> wrote:
>      > I've read some posts about how an admin can limit the maximum
>     number of jobs
>      > a user can run. But I'd like to know if a user can him/herself
>     limit the
>      > number of jobs *running*, ideally jobs within the same job array.
>      >
>      > The use case is that I would like to submit 500 I/O intensive
>     jobs. Each job
>      > only requires a single core, so potentially all jobs could start
>     running on
>      > our cluster overloading the storage system. Thus, I'd like to say
>     "amongst
>      > all 500 jobs in this job array, run at most 20 at a time". Is
>     that possible?
>      >
>      > Thank you.
>      >
>      >
>      > _______________________________________________
>      > torqueusers mailing list
>      > torqueusers at supercluster.org <mailto:torqueusers at supercluster.org>
>      > http://www.supercluster.org/mailman/listinfo/torqueusers
>      >
>     _______________________________________________
>     torqueusers mailing list
>     torqueusers at supercluster.org <mailto:torqueusers at supercluster.org>
>     http://www.supercluster.org/mailman/listinfo/torqueusers
>
>
>
>
> _______________________________________________
> torqueusers mailing list
> torqueusers at supercluster.org
> http://www.supercluster.org/mailman/listinfo/torqueusers



More information about the torqueusers mailing list