[torqueusers] assigning resources to a queue

Gus Correa gus at ldeo.columbia.edu
Tue Apr 24 12:56:38 MDT 2012


On 04/24/2012 02:31 PM, Christina Salls wrote:
>
>
> On Tue, Apr 24, 2012 at 1:28 PM, Gus Correa <gus at ldeo.columbia.edu
> <mailto:gus at ldeo.columbia.edu>> wrote:
>
>
>     On 04/24/2012 01:09 PM, Christina Salls wrote:
>      >
>      >
>      > On Tue, Apr 24, 2012 at 12:59 PM, David Beer
>      > <dbeer at adaptivecomputing.com <mailto:dbeer at adaptivecomputing.com>
>     <mailto:dbeer at adaptivecomputing.com
>     <mailto:dbeer at adaptivecomputing.com>>> wrote:
>      >
>      >     Sorry for the confusion, I meant that you should replace
>     <specific
>      >     node> with the node's name. Thanks for clarifying Gus.
>      >
>      > Of course, I should have realized that!  Thanks again.
>      >
>      > Now that I have node n020 assigned to the hydrology queue, will that
>      > make it unavailable to the batch queue?
>      >
>
>
>     In maui.cfg
>
>     ENABLEMULTIREQJOBS   TRUE
>
>     See the Maui Admin Guide for the meaning:
>     http://www.adaptivecomputing.com/resources/docs/maui/a.fparameters.php
>
> I am still using the built in scheduler in torque.  I haven't installed
> maui yet.
>

Not sure if this will work with pbs_sched,
but may be worth trying.

1) In server_priv/nodes add some 'properties' to your nodes,
something like this:

n001 np=8 generic
n002 np=8 generic
...
n019 np=8 generic
n020 np=8 hydro

'generic' and 'hydro' are node 'properties',
you can call them any string you want, and use as many
'properties' you want/need for each node.

http://www.adaptivecomputing.com/resources/docs/torque/3-0-3/3.2nodeproperties.php
http://www.adaptivecomputing.com/resources/docs/torque/3-0-3/4.1queueconfig.php#mapping
http://www.adaptivecomputing.com/resources/docs/torque/3-0-3/2.1jobsubmission.php

2) Reconfigure slightly your queues to default
to 'generic' and 'hydro' nodes, say:

set queue batch resources_default.neednodes = generic
set queue hydrology resources_default.neednodes = hydro

[unset the previous neednodes = 020 in the hydrology queue].

I hope this helps,
Gus Correa


>     I hope it helps,
>     Gus Correa
>
>      >     David
>      >
>      >
>      >     On Tue, Apr 24, 2012 at 10:21 AM, Christina Salls
>      > <christina.salls at noaa.gov <mailto:christina.salls at noaa.gov>
>     <mailto:christina.salls at noaa.gov <mailto:christina.salls at noaa.gov>>>
>     wrote:
>      >
>      >
>      >
>      >         On Tue, Apr 24, 2012 at 12:10 PM, Gus Correa
>      > <gus at ldeo.columbia.edu <mailto:gus at ldeo.columbia.edu>
>     <mailto:gus at ldeo.columbia.edu <mailto:gus at ldeo.columbia.edu>>> wrote:
>      >
>      >             On 04/24/2012 12:00 PM, Christina Salls wrote:
>      > > Hi David,
>      > >
>      > >        I tried using that synax and had a problem:
>      > >
>      > > Qmgr: set queue hydrology resources_default.need_nodes=<n020>
>      >
>      >             The syntax takes just the node name, I believe:
>      >
>      >             set queue hydrology resources_default.need_nodes=n020
>      >
>      >
>      >         Thanks Gus, I unset the resource and reset it without the
>     brackets.
>      >         Qmgr: unset queue hydrology resources_default.neednodes
>      >         Qmgr: set queue hydrology resources_default.neednodes= n020
>      >         Qmgr: print queue hydrology
>      >         #
>      >         # Create queues and set their attributes.
>      >         #
>      >         #
>      >         # Create and define queue hydrology
>      >         #
>      >         create queue hydrology
>      >         set queue hydrology queue_type = Execution
>      >         set queue hydrology resources_default.neednodes = n020
>      >         set queue hydrology enabled = True
>      >         set queue hydrology started = True
>      >
>      >
>      > > qmgr obj=hydrology svr=default: Unknown resource type
>      > >   resources_default.need_nodes
>      > >
>      > > This is what ended up working for me.  Thanks again for
>      >             your help!
>      > >
>      > > Qmgr: set queue hydrology resources_default.neednodes=<n020>
>      > > Qmgr: print queue hydrology
>      > > #
>      > > # Create queues and set their attributes.
>      > > #
>      > > #
>      > > # Create and define queue hydrology
>      > > #
>      > > create queue hydrology
>      > > set queue hydrology queue_type = Execution
>      > > set queue hydrology resources_default.neednodes = <n020>
>      > > set queue hydrology enabled = True
>      > > set queue hydrology started = True
>      > > Qmgr:
>      > >
>      > >
>      > >
>      > > On Tue, Apr 24, 2012 at 11:50 AM, Christina Salls
>      > > <christina.salls at noaa.gov <mailto:christina.salls at noaa.gov>
>      > <mailto:christina.salls at noaa.gov <mailto:christina.salls at noaa.gov>>
>      > <mailto:christina.salls at noaa.gov <mailto:christina.salls at noaa.gov>
>      > <mailto:christina.salls at noaa.gov
>     <mailto:christina.salls at noaa.gov>>>> wrote:
>      > >
>      > >
>      > >
>      > >     On Tue, Apr 24, 2012 at 11:38 AM, David Beer
>      > > <dbeer at adaptivecomputing.com <mailto:dbeer at adaptivecomputing.com>
>      > <mailto:dbeer at adaptivecomputing.com
>     <mailto:dbeer at adaptivecomputing.com>>
>      > <mailto:dbeer at adaptivecomputing.com
>     <mailto:dbeer at adaptivecomputing.com>
>      > <mailto:dbeer at adaptivecomputing.com
>     <mailto:dbeer at adaptivecomputing.com>>>>
>      > >     wrote:
>      > >
>      > >         Christina
>      > >
>      > >         To make the hydrology queue request <specific
>      >             node> by default -
>      > >
>      > > 'set queue hydrology
>      >             resources_default.need_nodes=<specific node>'
>      > >
>      > >         David
>      > >
>      > >
>      > >     Thanks David!!
>      > >
>      > >
>      > >
>      > >
>      > >
>      > > --
>      > > Christina A. Salls
>      > > GLERL Computer Group
>      > > help.glerl at noaa.gov <mailto:help.glerl at noaa.gov>
>     <mailto:help.glerl at noaa.gov <mailto:help.glerl at noaa.gov>>
>      > <mailto:help.glerl at noaa.gov <mailto:help.glerl at noaa.gov>
>     <mailto:help.glerl at noaa.gov <mailto:help.glerl at noaa.gov>>>
>      > > Help Desk x2127
>      > > Christina.Salls at noaa.gov <mailto:Christina.Salls at noaa.gov>
>      > <mailto:Christina.Salls at noaa.gov <mailto:Christina.Salls at noaa.gov>>
>      > <mailto:Christina.Salls at noaa.gov <mailto:Christina.Salls at noaa.gov>
>      > <mailto:Christina.Salls at noaa.gov <mailto:Christina.Salls at noaa.gov>>>
>      > > Voice Mail 734-741-2446 <tel:734-741-2446> <tel:734-741-2446
>     <tel:734-741-2446>>
>      > >
>      > >
>      > >
>      > >
>      > > _______________________________________________
>      > > torqueusers mailing list
>      > > torqueusers at supercluster.org <mailto:torqueusers at supercluster.org>
>      > <mailto:torqueusers at supercluster.org
>     <mailto:torqueusers at supercluster.org>>
>      > > http://www.supercluster.org/mailman/listinfo/torqueusers
>      >
>      >             _______________________________________________
>      >             torqueusers mailing list
>      > torqueusers at supercluster.org <mailto:torqueusers at supercluster.org>
>      > <mailto:torqueusers at supercluster.org
>     <mailto:torqueusers at supercluster.org>>
>      > http://www.supercluster.org/mailman/listinfo/torqueusers
>      >
>      >
>      >
>      >
>      >         --
>      >         Christina A. Salls
>      >         GLERL Computer Group
>      > help.glerl at noaa.gov <mailto:help.glerl at noaa.gov>
>     <mailto:help.glerl at noaa.gov <mailto:help.glerl at noaa.gov>>
>      >         Help Desk x2127
>      > Christina.Salls at noaa.gov <mailto:Christina.Salls at noaa.gov>
>     <mailto:Christina.Salls at noaa.gov <mailto:Christina.Salls at noaa.gov>>
>      >         Voice Mail 734-741-2446 <tel:734-741-2446>
>     <tel:734-741-2446 <tel:734-741-2446>>
>      >
>      >
>      >
>      >         _______________________________________________
>      >         torqueusers mailing list
>      > torqueusers at supercluster.org
>     <mailto:torqueusers at supercluster.org>
>     <mailto:torqueusers at supercluster.org
>     <mailto:torqueusers at supercluster.org>>
>      > http://www.supercluster.org/mailman/listinfo/torqueusers
>      >
>      >
>      >
>      >
>      >     --
>      >     David Beer | Software Engineer
>      >     Adaptive Computing
>      >
>      >
>      >     _______________________________________________
>      >     torqueusers mailing list
>      > torqueusers at supercluster.org
>     <mailto:torqueusers at supercluster.org>
>     <mailto:torqueusers at supercluster.org
>     <mailto:torqueusers at supercluster.org>>
>      > http://www.supercluster.org/mailman/listinfo/torqueusers
>      >
>      >
>      >
>      >
>      > --
>      > Christina A. Salls
>      > GLERL Computer Group
>      > help.glerl at noaa.gov <mailto:help.glerl at noaa.gov>
>     <mailto:help.glerl at noaa.gov <mailto:help.glerl at noaa.gov>>
>      > Help Desk x2127
>      > Christina.Salls at noaa.gov <mailto:Christina.Salls at noaa.gov>
>     <mailto:Christina.Salls at noaa.gov <mailto:Christina.Salls at noaa.gov>>
>      > Voice Mail 734-741-2446 <tel:734-741-2446>
>      >
>      >
>      >
>      >
>      > _______________________________________________
>      > torqueusers mailing list
>      > torqueusers at supercluster.org <mailto:torqueusers at supercluster.org>
>      > http://www.supercluster.org/mailman/listinfo/torqueusers
>
>     _______________________________________________
>     torqueusers mailing list
>     torqueusers at supercluster.org <mailto:torqueusers at supercluster.org>
>     http://www.supercluster.org/mailman/listinfo/torqueusers
>
>
>
>
> --
> Christina A. Salls
> GLERL Computer Group
> help.glerl at noaa.gov <mailto:help.glerl at noaa.gov>
> Help Desk x2127
> Christina.Salls at noaa.gov <mailto:Christina.Salls at noaa.gov>
> Voice Mail 734-741-2446
>
>
>
>
> _______________________________________________
> torqueusers mailing list
> torqueusers at supercluster.org
> http://www.supercluster.org/mailman/listinfo/torqueusers



More information about the torqueusers mailing list