[torqueusers] assigning resources to a queue

Gus Correa gus at ldeo.columbia.edu
Tue Apr 24 14:48:57 MDT 2012


On 04/24/2012 04:03 PM, Christina Salls wrote:
>
>
> On Tue, Apr 24, 2012 at 2:56 PM, Gus Correa <gus at ldeo.columbia.edu
> <mailto:gus at ldeo.columbia.edu>> wrote:
>
>     On 04/24/2012 02:31 PM, Christina Salls wrote:
>      >
>      >
>      > On Tue, Apr 24, 2012 at 1:28 PM, Gus Correa
>     <gus at ldeo.columbia.edu <mailto:gus at ldeo.columbia.edu>
>      > <mailto:gus at ldeo.columbia.edu <mailto:gus at ldeo.columbia.edu>>> wrote:
>      >
>      >
>      >     On 04/24/2012 01:09 PM, Christina Salls wrote:
>      > >
>      > >
>      > > On Tue, Apr 24, 2012 at 12:59 PM, David Beer
>      > > <dbeer at adaptivecomputing.com
>     <mailto:dbeer at adaptivecomputing.com>
>     <mailto:dbeer at adaptivecomputing.com
>     <mailto:dbeer at adaptivecomputing.com>>
>      > <mailto:dbeer at adaptivecomputing.com
>     <mailto:dbeer at adaptivecomputing.com>
>      > <mailto:dbeer at adaptivecomputing.com
>     <mailto:dbeer at adaptivecomputing.com>>>> wrote:
>      > >
>      > >     Sorry for the confusion, I meant that you should replace
>      > <specific
>      > >     node> with the node's name. Thanks for clarifying Gus.
>      > >
>      > > Of course, I should have realized that!  Thanks again.
>      > >
>      > > Now that I have node n020 assigned to the hydrology queue, will
>     that
>      > > make it unavailable to the batch queue?
>      > >
>      >
>      >
>      >     In maui.cfg
>      >
>      >     ENABLEMULTIREQJOBS   TRUE
>      >
>      >     See the Maui Admin Guide for the meaning:
>      >
>     http://www.adaptivecomputing.com/resources/docs/maui/a.fparameters.php
>      >
>      > I am still using the built in scheduler in torque.  I haven't
>     installed
>      > maui yet.
>      >
>
>     Not sure if this will work with pbs_sched,
>     but may be worth trying.
>
>     1) In server_priv/nodes add some 'properties' to your nodes,
>     something like this:
>
>     n001 np=8 generic
>     n002 np=8 generic
>     ...
>     n019 np=8 generic
>     n020 np=8 hydro
>
>     'generic' and 'hydro' are node 'properties',
>     you can call them any string you want, and use as many
>     'properties' you want/need for each node.
>
>     http://www.adaptivecomputing.com/resources/docs/torque/3-0-3/3.2nodeproperties.php
>     http://www.adaptivecomputing.com/resources/docs/torque/3-0-3/4.1queueconfig.php#mapping
>     http://www.adaptivecomputing.com/resources/docs/torque/3-0-3/2.1jobsubmission.php
>
>     2) Reconfigure slightly your queues to default
>     to 'generic' and 'hydro' nodes, say:
>
>     set queue batch resources_default.neednodes = generic
>     set queue hydrology resources_default.neednodes = hydro
>
>     [unset the previous neednodes = 020 in the hydrology queue].
>
>     I hope this helps,
>     Gus Correa
>
>
> Definitely worth a try - it makes perfect sense.  Thanks for the
> suggestion.  The only roadblock I am concerned with is the fact that
> something within torque dynamically modifies the nodes file.  I am
> hoping it will leave my modifications intact.  I will let you know what
> happens.
>
> Thanks!
>

I edit my nodes file by hand, not with qmgr,
and never had this problem.
After editing it, you may need to restart pbs_server,
and perhaps pbs_sched too.

I hope it helps,
Gus Correa
>
>      >     I hope it helps,
>      >     Gus Correa
>      >
>      > >     David
>      > >
>      > >
>      > >     On Tue, Apr 24, 2012 at 10:21 AM, Christina Salls
>      > > <christina.salls at noaa.gov <mailto:christina.salls at noaa.gov>
>     <mailto:christina.salls at noaa.gov <mailto:christina.salls at noaa.gov>>
>      > <mailto:christina.salls at noaa.gov
>     <mailto:christina.salls at noaa.gov> <mailto:christina.salls at noaa.gov
>     <mailto:christina.salls at noaa.gov>>>>
>      >     wrote:
>      > >
>      > >
>      > >
>      > >         On Tue, Apr 24, 2012 at 12:10 PM, Gus Correa
>      > > <gus at ldeo.columbia.edu <mailto:gus at ldeo.columbia.edu>
>     <mailto:gus at ldeo.columbia.edu <mailto:gus at ldeo.columbia.edu>>
>      > <mailto:gus at ldeo.columbia.edu <mailto:gus at ldeo.columbia.edu>
>     <mailto:gus at ldeo.columbia.edu <mailto:gus at ldeo.columbia.edu>>>> wrote:
>      > >
>      > >             On 04/24/2012 12:00 PM, Christina Salls wrote:
>      > > > Hi David,
>      > > >
>      > > >        I tried using that synax and had a problem:
>      > > >
>      > > > Qmgr: set queue hydrology resources_default.need_nodes=<n020>
>      > >
>      > >             The syntax takes just the node name, I believe:
>      > >
>      > >             set queue hydrology resources_default.need_nodes=n020
>      > >
>      > >
>      > >         Thanks Gus, I unset the resource and reset it without the
>      >     brackets.
>      > >         Qmgr: unset queue hydrology resources_default.neednodes
>      > >         Qmgr: set queue hydrology resources_default.neednodes= n020
>      > >         Qmgr: print queue hydrology
>      > >         #
>      > >         # Create queues and set their attributes.
>      > >         #
>      > >         #
>      > >         # Create and define queue hydrology
>      > >         #
>      > >         create queue hydrology
>      > >         set queue hydrology queue_type = Execution
>      > >         set queue hydrology resources_default.neednodes = n020
>      > >         set queue hydrology enabled = True
>      > >         set queue hydrology started = True
>      > >
>      > >
>      > > > qmgr obj=hydrology svr=default: Unknown resource type
>      > > >   resources_default.need_nodes
>      > > >
>      > > > This is what ended up working for me.  Thanks again for
>      > >             your help!
>      > > >
>      > > > Qmgr: set queue hydrology resources_default.neednodes=<n020>
>      > > > Qmgr: print queue hydrology
>      > > > #
>      > > > # Create queues and set their attributes.
>      > > > #
>      > > > #
>      > > > # Create and define queue hydrology
>      > > > #
>      > > > create queue hydrology
>      > > > set queue hydrology queue_type = Execution
>      > > > set queue hydrology resources_default.neednodes = <n020>
>      > > > set queue hydrology enabled = True
>      > > > set queue hydrology started = True
>      > > > Qmgr:
>      > > >
>      > > >
>      > > >
>      > > > On Tue, Apr 24, 2012 at 11:50 AM, Christina Salls
>      > > > <christina.salls at noaa.gov <mailto:christina.salls at noaa.gov>
>     <mailto:christina.salls at noaa.gov <mailto:christina.salls at noaa.gov>>
>      > > <mailto:christina.salls at noaa.gov
>     <mailto:christina.salls at noaa.gov> <mailto:christina.salls at noaa.gov
>     <mailto:christina.salls at noaa.gov>>>
>      > > <mailto:christina.salls at noaa.gov
>     <mailto:christina.salls at noaa.gov> <mailto:christina.salls at noaa.gov
>     <mailto:christina.salls at noaa.gov>>
>      > > <mailto:christina.salls at noaa.gov <mailto:christina.salls at noaa.gov>
>      > <mailto:christina.salls at noaa.gov
>     <mailto:christina.salls at noaa.gov>>>>> wrote:
>      > > >
>      > > >
>      > > >
>      > > >     On Tue, Apr 24, 2012 at 11:38 AM, David Beer
>      > > > <dbeer at adaptivecomputing.com
>     <mailto:dbeer at adaptivecomputing.com>
>     <mailto:dbeer at adaptivecomputing.com
>     <mailto:dbeer at adaptivecomputing.com>>
>      > > <mailto:dbeer at adaptivecomputing.com
>     <mailto:dbeer at adaptivecomputing.com>
>      > <mailto:dbeer at adaptivecomputing.com
>     <mailto:dbeer at adaptivecomputing.com>>>
>      > > <mailto:dbeer at adaptivecomputing.com
>     <mailto:dbeer at adaptivecomputing.com>
>      > <mailto:dbeer at adaptivecomputing.com
>     <mailto:dbeer at adaptivecomputing.com>>
>      > > <mailto:dbeer at adaptivecomputing.com
>     <mailto:dbeer at adaptivecomputing.com>
>      > <mailto:dbeer at adaptivecomputing.com
>     <mailto:dbeer at adaptivecomputing.com>>>>>
>      > > >     wrote:
>      > > >
>      > > >         Christina
>      > > >
>      > > >         To make the hydrology queue request <specific
>      > >             node> by default -
>      > > >
>      > > > 'set queue hydrology
>      > >             resources_default.need_nodes=<specific node>'
>      > > >
>      > > >         David
>      > > >
>      > > >
>      > > >     Thanks David!!
>      > > >
>      > > >
>      > > >
>      > > >
>      > > >
>      > > > --
>
>
>
> _______________________________________________
> torqueusers mailing list
> torqueusers at supercluster.org
> http://www.supercluster.org/mailman/listinfo/torqueusers



More information about the torqueusers mailing list