[torqueusers] serial and parallel jobs

Gus Correa gus at ldeo.columbia.edu
Fri Oct 25 10:10:02 MDT 2013


Hi Luca

Two possibilities (among many others):

pbsdsh: It is part of Torque.  See 'man pbsdsh'.

Job arrays: It is a feature of qsub (qsub -t).
See 'man qsub'.

I hope this helps,
Gus Correa

On 10/25/2013 11:29 AM, Jim Prewett wrote:
>
> Hi Luca,
>
> Have you considered using GNU Parallel to run the many serial jobs?  You
> can instruct it to launch N jobs at a time and have it use multiple
> machines to run the jobs.  I really like it for this sort of thing!
>
> http://www.gnu.org/software/parallel/
>
> HTH,
> Jim
>
> On Fri, 25 Oct 2013, Luca Nannipieri wrote:
>
>> I have to run many serial jobs (100000 more or less), each one runs a
>> few minutes.I have to submit 100000 jobs or is there a better way to do
>> it with torque? serial jobs have to live withparallel jobs that have
>> higher priority.
>>
>> --
>> Ing. Luca Nannipieri
>> Istituto Nazionale di Geofisica e Vulcanologia
>> Sezione di Pisa
>> Via della Faggiola, 32 - 56126 Pisa - Italy
>> Tel. +39 050 8311926
>> fax: +39 050 8311942
>> http://www.pi.ingv.it/chisiamo/paginepersonali/nannipieri.html
>> PEC: aoo.pisa at pec.ingv.it
>> ----------------------------------------------------------------
>>
>> Il contenuto di questa e-mail e' rivolto unicamente alle persone
>> cui e' indirizzato, e puo'contenere informazioni la cui riservatezza
>> e' tutelata.E' proibita la copia, la divulgazione o l'uso di questo
>> messaggio o dell'informazione ivi contenuta da chiunque altro che
>> non sia il destinatario indicato. Se avete ricevuto questa e-mail
>> per errore, vogliate cortesemente comunicarlo immediatamente per
>> telefono, fax o e-mail.
>> Grazie.
>>
>> This e-mail is intended only for person or entity to which is
>> addressed and may contain information that is privileged, confidential
>> or otherwise protected from disclosure. Copying, dissemination or use
>> of this e-mail or the information herein by anyone other than the
>> intended recipient is prohibited. If you have received this e-mail
>> by mistake, please notify us immediately by telephone, fax or e-mail.
>> Thank you.
>>
>>
>>
>> _______________________________________________
>> torqueusers mailing list
>> torqueusers at supercluster.org
>> http://www.supercluster.org/mailman/listinfo/torqueusers
>>
>
> James E. Prewett                    Jim at Prewett.org download at hpc.unm.edu
> Systems Team Leader           LoGS: http://www.hpc.unm.edu/~download/LoGS/
> Designated Security Officer         OpenPGP key: pub 1024D/31816D93
> HPC Systems Engineer III   UNM HPC  505.277.8210
> _______________________________________________
> torqueusers mailing list
> torqueusers at supercluster.org
> http://www.supercluster.org/mailman/listinfo/torqueusers



More information about the torqueusers mailing list