[torqueusers] can user limit max jobs running

Ashish Agarwal agarwal1975 at gmail.com
Wed Apr 18 10:37:50 MDT 2012


Ok. Thanks for the help!

On Wed, Apr 18, 2012 at 12:34 PM, Al Taufer
<ataufer at adaptivecomputing.com>wrote:

> It was not in the 2.4 version.  It first showed up sometime in the 2.5
> version and should be shown in the 2.5 man pages.
>
> On Wed, Apr 18, 2012 at 10:20 AM, Ashish Agarwal <agarwal1975 at gmail.com>
> wrote:
> > The slot limit is exactly what I'm looking for, but:
> >
> > * It is not mentioned in our man pages. I read now the man page on
> > clusterresources.com, which is quite different than our installed man
> page.
> >
> > * It works on one of our clusters, but on a second one I get "qsub: Bad
> Job
> > Array Request." Does this feature have to be enabled? Or is it only
> > available from a certain version? The cluster it works on is qsub
> version:
> > 2.5.10, and the one it does not work on is version: 2.4.12.
> >
> >
> > On Wed, Apr 18, 2012 at 11:26 AM, Al Taufer <
> ataufer at adaptivecomputing.com>
> > wrote:
> >>
> >> It sounds like slot limits on a job array would do what you want. The
> >> man page for qsub says
> >>
> >> An optional slot limit can be specified to limit the amount  of jobs
> >> that  can  run concurrently in the job array. The default value is
> >> unlimited. The slot limit must be the last thing specified in the
> >> array_request and is delimited from the array by a percent sign (%).
> >>
> >> qsub script.sh -t 0-299%5
> >>
> >> This sets the slot limit to 5. Only 5 jobs from this array can run at
> >> the same time.
> >>
> >> On Wed, Apr 18, 2012 at 8:22 AM, Ashish Agarwal <agarwal1975 at gmail.com>
> >> wrote:
> >> > I've read some posts about how an admin can limit the maximum number
> of
> >> > jobs
> >> > a user can run. But I'd like to know if a user can him/herself limit
> the
> >> > number of jobs *running*, ideally jobs within the same job array.
> >> >
> >> > The use case is that I would like to submit 500 I/O intensive jobs.
> Each
> >> > job
> >> > only requires a single core, so potentially all jobs could start
> running
> >> > on
> >> > our cluster overloading the storage system. Thus, I'd like to say
> >> > "amongst
> >> > all 500 jobs in this job array, run at most 20 at a time". Is that
> >> > possible?
> >> >
> >> > Thank you.
> >> >
> >> >
> >> > _______________________________________________
> >> > torqueusers mailing list
> >> > torqueusers at supercluster.org
> >> > http://www.supercluster.org/mailman/listinfo/torqueusers
> >> >
> >> _______________________________________________
> >> torqueusers mailing list
> >> torqueusers at supercluster.org
> >> http://www.supercluster.org/mailman/listinfo/torqueusers
> >
> >
> >
> > _______________________________________________
> > torqueusers mailing list
> > torqueusers at supercluster.org
> > http://www.supercluster.org/mailman/listinfo/torqueusers
> >
> _______________________________________________
> torqueusers mailing list
> torqueusers at supercluster.org
> http://www.supercluster.org/mailman/listinfo/torqueusers
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://www.supercluster.org/pipermail/torqueusers/attachments/20120418/1bd68797/attachment.html 


More information about the torqueusers mailing list