[torquedev] Torque ncpus command

Lenox, Billy AMRDEC/Sentient Corp. billy.lenox at us.army.mil
Mon Oct 10 05:27:50 MDT 2011


Here /var/spool/torque/server_priv/nodes

seed001 np=8 batch
seed002 np=8 batch
seed003 np=4 batch
seed004 np=4 batch
seed005 np=4 batch

Scheduler = PBS

Correct the -l procs=28 does not work over all Nodes Only the First One
(seed001)

Billy

> From: Ken Nielson <knielson at adaptivecomputing.com>
> Reply-To: Torque Developers mailing list <torquedev at supercluster.org>
> Date: Fri, 07 Oct 2011 11:01:29 -0600 (MDT)
> To: Torque Developers mailing list <torquedev at supercluster.org>
> Subject: Re: [torquedev] Torque ncpus command
> 
> ----- Original Message -----
>> From: "Billy AMRDEC Lenox/Sentient Corp." <billy.lenox at us.army.mil>
>> To: "Torque Developers mailing list" <torquedev at supercluster.org>
>> Sent: Friday, October 7, 2011 5:54:51 AM
>> Subject: Re: [torquedev] Torque ncpus command
>> 
>> I have Tried This:
>> 
>>> If you want 28 processors anywhere you can get them try using -l
>>> procs=28.
>> 
>> It still only runs on ONE NODE (seed001)
>> 
>> I have also done this:
>> 
>>> mpirun -np 28 -machinefile ${PBS_NODEFILE} ./prog
>> 
>> It still only runs on ONE NODE (seed001)
>> 
>> This is what is in my nodes file
>> 
>> Here /var/spool/torque/server_priv/nodes
>> 
>> seed001 np=8 batch
>> seed002 np=8 batch
>> seed003 np=4 batch
>> seed004 np=4 batch
>> seed005 np=4 batch
>> 
>> PBS_MOM is running on all nodes
>> PBS_SERVER is on the SERVER
>> 
>> I do a PBSNODES -A
>> 
>> All are FREE and READY for use.
>> 
>> I know I cant specify NODES:PROCESSORS in the Script.
>> 
>> I know if I create a file called hosts
>> 
>> seed001
>> seed002
>> seed003
>> seed004
>> seed005
>> 
>> And run the command like this in my script:
>> 
>>> mpirun -np 28 -machinefile /Users/name/hosts ./prog
>> 
>> This Works and runs on all nodes ${PBS_NODEFILE}
>> 
>> Still it not the correct way for PBS to work if I keep adding more
>> NODES
>> To the listing for more PROCS to use. I would like for this to work
>> somehow
>> correctly to use.
>> 
>> Thanks
>> 
>> Billy
>> 
> 
> What do you have in your $TORQUE_HOME/server_priv/nodes file?
> 
> What scheduler are you using?
> 
> -l procs=28 does work across multiple nodes if the configuration is correct.
> 
> Ken
> _______________________________________________
> torquedev mailing list
> torquedev at supercluster.org
> http://www.supercluster.org/mailman/listinfo/torquedev



More information about the torquedev mailing list