[torqueusers] can user limit max jobs running

Al Taufer ataufer at adaptivecomputing.com
Wed Apr 18 10:34:49 MDT 2012


It was not in the 2.4 version.  It first showed up sometime in the 2.5
version and should be shown in the 2.5 man pages.

On Wed, Apr 18, 2012 at 10:20 AM, Ashish Agarwal <agarwal1975 at gmail.com> wrote:
> The slot limit is exactly what I'm looking for, but:
>
> * It is not mentioned in our man pages. I read now the man page on
> clusterresources.com, which is quite different than our installed man page.
>
> * It works on one of our clusters, but on a second one I get "qsub: Bad Job
> Array Request." Does this feature have to be enabled? Or is it only
> available from a certain version? The cluster it works on is qsub version:
> 2.5.10, and the one it does not work on is version: 2.4.12.
>
>
> On Wed, Apr 18, 2012 at 11:26 AM, Al Taufer <ataufer at adaptivecomputing.com>
> wrote:
>>
>> It sounds like slot limits on a job array would do what you want. The
>> man page for qsub says
>>
>> An optional slot limit can be specified to limit the amount  of jobs
>> that  can  run concurrently in the job array. The default value is
>> unlimited. The slot limit must be the last thing specified in the
>> array_request and is delimited from the array by a percent sign (%).
>>
>> qsub script.sh -t 0-299%5
>>
>> This sets the slot limit to 5. Only 5 jobs from this array can run at
>> the same time.
>>
>> On Wed, Apr 18, 2012 at 8:22 AM, Ashish Agarwal <agarwal1975 at gmail.com>
>> wrote:
>> > I've read some posts about how an admin can limit the maximum number of
>> > jobs
>> > a user can run. But I'd like to know if a user can him/herself limit the
>> > number of jobs *running*, ideally jobs within the same job array.
>> >
>> > The use case is that I would like to submit 500 I/O intensive jobs. Each
>> > job
>> > only requires a single core, so potentially all jobs could start running
>> > on
>> > our cluster overloading the storage system. Thus, I'd like to say
>> > "amongst
>> > all 500 jobs in this job array, run at most 20 at a time". Is that
>> > possible?
>> >
>> > Thank you.
>> >
>> >
>> > _______________________________________________
>> > torqueusers mailing list
>> > torqueusers at supercluster.org
>> > http://www.supercluster.org/mailman/listinfo/torqueusers
>> >
>> _______________________________________________
>> torqueusers mailing list
>> torqueusers at supercluster.org
>> http://www.supercluster.org/mailman/listinfo/torqueusers
>
>
>
> _______________________________________________
> torqueusers mailing list
> torqueusers at supercluster.org
> http://www.supercluster.org/mailman/listinfo/torqueusers
>


More information about the torqueusers mailing list