[torquedev] Torque ncpus command

Ken Nielson knielson at adaptivecomputing.com
Mon Oct 10 09:10:03 MDT 2011


----- Original Message -----
> From: "Billy AMRDEC Lenox/Sentient Corp." <billy.lenox at us.army.mil>
> To: "Torque Developers mailing list" <torquedev at supercluster.org>
> Sent: Monday, October 10, 2011 5:27:50 AM
> Subject: Re: [torquedev] Torque ncpus command
> 
> Here /var/spool/torque/server_priv/nodes
> 
> seed001 np=8 batch
> seed002 np=8 batch
> seed003 np=4 batch
> seed004 np=4 batch
> seed005 np=4 batch
> 
> Scheduler = PBS
> 
> Correct the -l procs=28 does not work over all Nodes Only the First
> One
> (seed001)
> 
> Billy
> 
> > From: Ken Nielson <knielson at adaptivecomputing.com>
> > Reply-To: Torque Developers mailing list
> > <torquedev at supercluster.org>
> > Date: Fri, 07 Oct 2011 11:01:29 -0600 (MDT)
> > To: Torque Developers mailing list <torquedev at supercluster.org>
> > Subject: Re: [torquedev] Torque ncpus command
> > 
> > ----- Original Message -----
> >> From: "Billy AMRDEC Lenox/Sentient Corp."
> >> <billy.lenox at us.army.mil>
> >> To: "Torque Developers mailing list" <torquedev at supercluster.org>
> >> Sent: Friday, October 7, 2011 5:54:51 AM
> >> Subject: Re: [torquedev] Torque ncpus command
> >> 
> >> I have Tried This:
> >> 
> >>> If you want 28 processors anywhere you can get them try using -l
> >>> procs=28.
> >> 
> >> It still only runs on ONE NODE (seed001)
> >> 
> >> I have also done this:
> >> 
> >>> mpirun -np 28 -machinefile ${PBS_NODEFILE} ./prog
> >> 
> >> It still only runs on ONE NODE (seed001)
> >> 
> >> This is what is in my nodes file
> >> 
> >> Here /var/spool/torque/server_priv/nodes
> >> 
> >> seed001 np=8 batch
> >> seed002 np=8 batch
> >> seed003 np=4 batch
> >> seed004 np=4 batch
> >> seed005 np=4 batch
> >> 
> >> PBS_MOM is running on all nodes
> >> PBS_SERVER is on the SERVER
> >> 
> >> I do a PBSNODES -A
> >> 
> >> All are FREE and READY for use.
> >> 
> >> I know I cant specify NODES:PROCESSORS in the Script.
> >> 
> >> I know if I create a file called hosts
> >> 
> >> seed001
> >> seed002
> >> seed003
> >> seed004
> >> seed005
> >> 
> >> And run the command like this in my script:
> >> 
> >>> mpirun -np 28 -machinefile /Users/name/hosts ./prog
> >> 
> >> This Works and runs on all nodes ${PBS_NODEFILE}
> >> 
> >> Still it not the correct way for PBS to work if I keep adding more
> >> NODES
> >> To the listing for more PROCS to use. I would like for this to
> >> work
> >> somehow
> >> correctly to use.
> >> 
> >> Thanks
> >> 
> >> Billy
> >> 
> > 
> > What do you have in your $TORQUE_HOME/server_priv/nodes file?
> > 
> > What scheduler are you using?
> > 
> > -l procs=28 does work across multiple nodes if the configuration is
> > correct.
> > 
> > Ken

Billy,

Have you tried using Maui as your scheduler? It does a much better job than pbs_sched.

Ken


More information about the torquedev mailing list