[torqueusers] serial and parallel jobs

Jim Prewett download at hpc.unm.edu
Fri Oct 25 09:29:32 MDT 2013


Hi Luca,

Have you considered using GNU Parallel to run the many serial jobs?  You 
can instruct it to launch N jobs at a time and have it use multiple 
machines to run the jobs.  I really like it for this sort of thing!

http://www.gnu.org/software/parallel/

HTH,
Jim

On Fri, 25 Oct 2013, Luca Nannipieri wrote:

> I have to run many serial jobs (100000 more or less), each one runs a
> few minutes.I have to submit 100000 jobs or is there a better way to do
> it with torque? serial jobs have to live withparallel jobs that have
> higher priority.
>
> -- 
> Ing. Luca Nannipieri
> Istituto Nazionale di Geofisica e Vulcanologia
> Sezione di Pisa
> Via della Faggiola, 32 - 56126 Pisa - Italy
> Tel. +39 050 8311926
> fax: +39 050 8311942
> http://www.pi.ingv.it/chisiamo/paginepersonali/nannipieri.html
> PEC: aoo.pisa at pec.ingv.it
> ----------------------------------------------------------------
>
> Il contenuto di questa e-mail e' rivolto unicamente alle persone
> cui e' indirizzato, e puo'contenere informazioni la cui riservatezza
> e' tutelata.E' proibita la copia, la divulgazione o l'uso di questo
> messaggio o dell'informazione ivi contenuta da chiunque altro che
> non sia il destinatario indicato. Se avete ricevuto questa e-mail
> per errore, vogliate cortesemente comunicarlo immediatamente per
> telefono, fax o e-mail.
> Grazie.
>
> This e-mail is intended only for person or entity to which is
> addressed and may contain information that is privileged, confidential
> or otherwise protected from disclosure. Copying, dissemination or use
> of this e-mail or the information herein by anyone other than the
> intended recipient is prohibited. If you have received this e-mail
> by mistake, please notify us immediately by telephone, fax or e-mail.
> Thank you.
>
>
>
> _______________________________________________
> torqueusers mailing list
> torqueusers at supercluster.org
> http://www.supercluster.org/mailman/listinfo/torqueusers
>

James E. Prewett                    Jim at Prewett.org download at hpc.unm.edu
Systems Team Leader           LoGS: http://www.hpc.unm.edu/~download/LoGS/
Designated Security Officer         OpenPGP key: pub 1024D/31816D93
HPC Systems Engineer III   UNM HPC  505.277.8210


More information about the torqueusers mailing list