[torquedev] Torque ncpus command

Lenox, Billy AMRDEC/Sentient Corp. billy.lenox at us.army.mil
Mon Oct 10 09:30:44 MDT 2011


I have not tried Maui. Will it Work Ok with a Macintosh Cluster 10.5.8 OS?
Is it Free? 

Billy

> From: Ken Nielson <knielson at adaptivecomputing.com>
> Reply-To: Torque Developers mailing list <torquedev at supercluster.org>
> Date: Mon, 10 Oct 2011 09:10:03 -0600 (MDT)
> To: Torque Developers mailing list <torquedev at supercluster.org>
> Subject: Re: [torquedev] Torque ncpus command
> 
> ----- Original Message -----
>> From: "Billy AMRDEC Lenox/Sentient Corp." <billy.lenox at us.army.mil>
>> To: "Torque Developers mailing list" <torquedev at supercluster.org>
>> Sent: Monday, October 10, 2011 5:27:50 AM
>> Subject: Re: [torquedev] Torque ncpus command
>> 
>> Here /var/spool/torque/server_priv/nodes
>> 
>> seed001 np=8 batch
>> seed002 np=8 batch
>> seed003 np=4 batch
>> seed004 np=4 batch
>> seed005 np=4 batch
>> 
>> Scheduler = PBS
>> 
>> Correct the -l procs=28 does not work over all Nodes Only the First
>> One
>> (seed001)
>> 
>> Billy
>> 
>>> From: Ken Nielson <knielson at adaptivecomputing.com>
>>> Reply-To: Torque Developers mailing list
>>> <torquedev at supercluster.org>
>>> Date: Fri, 07 Oct 2011 11:01:29 -0600 (MDT)
>>> To: Torque Developers mailing list <torquedev at supercluster.org>
>>> Subject: Re: [torquedev] Torque ncpus command
>>> 
>>> ----- Original Message -----
>>>> From: "Billy AMRDEC Lenox/Sentient Corp."
>>>> <billy.lenox at us.army.mil>
>>>> To: "Torque Developers mailing list" <torquedev at supercluster.org>
>>>> Sent: Friday, October 7, 2011 5:54:51 AM
>>>> Subject: Re: [torquedev] Torque ncpus command
>>>> 
>>>> I have Tried This:
>>>> 
>>>>> If you want 28 processors anywhere you can get them try using -l
>>>>> procs=28.
>>>> 
>>>> It still only runs on ONE NODE (seed001)
>>>> 
>>>> I have also done this:
>>>> 
>>>>> mpirun -np 28 -machinefile ${PBS_NODEFILE} ./prog
>>>> 
>>>> It still only runs on ONE NODE (seed001)
>>>> 
>>>> This is what is in my nodes file
>>>> 
>>>> Here /var/spool/torque/server_priv/nodes
>>>> 
>>>> seed001 np=8 batch
>>>> seed002 np=8 batch
>>>> seed003 np=4 batch
>>>> seed004 np=4 batch
>>>> seed005 np=4 batch
>>>> 
>>>> PBS_MOM is running on all nodes
>>>> PBS_SERVER is on the SERVER
>>>> 
>>>> I do a PBSNODES -A
>>>> 
>>>> All are FREE and READY for use.
>>>> 
>>>> I know I cant specify NODES:PROCESSORS in the Script.
>>>> 
>>>> I know if I create a file called hosts
>>>> 
>>>> seed001
>>>> seed002
>>>> seed003
>>>> seed004
>>>> seed005
>>>> 
>>>> And run the command like this in my script:
>>>> 
>>>>> mpirun -np 28 -machinefile /Users/name/hosts ./prog
>>>> 
>>>> This Works and runs on all nodes ${PBS_NODEFILE}
>>>> 
>>>> Still it not the correct way for PBS to work if I keep adding more
>>>> NODES
>>>> To the listing for more PROCS to use. I would like for this to
>>>> work
>>>> somehow
>>>> correctly to use.
>>>> 
>>>> Thanks
>>>> 
>>>> Billy
>>>> 
>>> 
>>> What do you have in your $TORQUE_HOME/server_priv/nodes file?
>>> 
>>> What scheduler are you using?
>>> 
>>> -l procs=28 does work across multiple nodes if the configuration is
>>> correct.
>>> 
>>> Ken
> 
> Billy,
> 
> Have you tried using Maui as your scheduler? It does a much better job than
> pbs_sched.
> 
> Ken
> _______________________________________________
> torquedev mailing list
> torquedev at supercluster.org
> http://www.supercluster.org/mailman/listinfo/torquedev



More information about the torquedev mailing list