[torqueusers] can user limit max jobs running

Lawrence Lowe L.S.Lowe at bham.ac.uk
Wed Apr 18 09:00:20 MDT 2012


Hi Ashish, in man qsub, it gives an example:

  qsub script.sh -t 0-299%5
                This  sets the slot limit to 5. Only 5 jobs from this array can
                run at the same time.

Hope that's what you're looking for.

Tel: 0121 414 4621    Fax: 0121 414 6709    Email: L.S.Lowe at bham.ac.uk

On Wed, 18 Apr 2012, Sreedhar Manchu wrote:

> Hi Ashish,
>
> I don't know whether user can do this by issuing one simple command. Easiest way would be to make second set of 20 jobs depend on first 20. So at any time there would be only 20 jobs running. You can write a simple script to achieve this. If you want I can show you how to do it. Anyway check our qsub tutorial for dependancy and other stuff like getting job numbers into variables so that you can use them in scripts.
>
> Sreedhar.
>
> --
> Sent from my phone. Please excuse my brevity and any typos.
>
> On Apr 18, 2012, at 10:22, Ashish Agarwal <agarwal1975 at gmail.com> wrote:
>
>> I've read some posts about how an admin can limit the maximum number of jobs a user can run. But I'd like to know if a user can him/herself limit the number of jobs *running*, ideally jobs within the same job array.
>>
>> The use case is that I would like to submit 500 I/O intensive jobs. Each job only requires a single core, so potentially all jobs could start running on our cluster overloading the storage system. Thus, I'd like to say "amongst all 500 jobs in this job array, run at most 20 at a time". Is that possible?
>>
>> Thank you.
>>
>> _______________________________________________
>> torqueusers mailing list
>> torqueusers at supercluster.org
>> http://www.supercluster.org/mailman/listinfo/torqueusers
> _______________________________________________
> torqueusers mailing list
> torqueusers at supercluster.org
> http://www.supercluster.org/mailman/listinfo/torqueusers
>


More information about the torqueusers mailing list