[torqueusers] assigning resources to a queue

Christina Salls christina.salls at noaa.gov
Tue Apr 24 14:03:51 MDT 2012


On Tue, Apr 24, 2012 at 2:56 PM, Gus Correa <gus at ldeo.columbia.edu> wrote:

> On 04/24/2012 02:31 PM, Christina Salls wrote:
> >
> >
> > On Tue, Apr 24, 2012 at 1:28 PM, Gus Correa <gus at ldeo.columbia.edu
> > <mailto:gus at ldeo.columbia.edu>> wrote:
> >
> >
> >     On 04/24/2012 01:09 PM, Christina Salls wrote:
> >      >
> >      >
> >      > On Tue, Apr 24, 2012 at 12:59 PM, David Beer
> >      > <dbeer at adaptivecomputing.com <mailto:dbeer at adaptivecomputing.com>
> >     <mailto:dbeer at adaptivecomputing.com
> >     <mailto:dbeer at adaptivecomputing.com>>> wrote:
> >      >
> >      >     Sorry for the confusion, I meant that you should replace
> >     <specific
> >      >     node> with the node's name. Thanks for clarifying Gus.
> >      >
> >      > Of course, I should have realized that!  Thanks again.
> >      >
> >      > Now that I have node n020 assigned to the hydrology queue, will
> that
> >      > make it unavailable to the batch queue?
> >      >
> >
> >
> >     In maui.cfg
> >
> >     ENABLEMULTIREQJOBS   TRUE
> >
> >     See the Maui Admin Guide for the meaning:
> >
> http://www.adaptivecomputing.com/resources/docs/maui/a.fparameters.php
> >
> > I am still using the built in scheduler in torque.  I haven't installed
> > maui yet.
> >
>
> Not sure if this will work with pbs_sched,
> but may be worth trying.
>
> 1) In server_priv/nodes add some 'properties' to your nodes,
> something like this:
>
> n001 np=8 generic
> n002 np=8 generic
> ...
> n019 np=8 generic
> n020 np=8 hydro
>
> 'generic' and 'hydro' are node 'properties',
> you can call them any string you want, and use as many
> 'properties' you want/need for each node.
>
>
> http://www.adaptivecomputing.com/resources/docs/torque/3-0-3/3.2nodeproperties.php
>
> http://www.adaptivecomputing.com/resources/docs/torque/3-0-3/4.1queueconfig.php#mapping
>
> http://www.adaptivecomputing.com/resources/docs/torque/3-0-3/2.1jobsubmission.php
>
> 2) Reconfigure slightly your queues to default
> to 'generic' and 'hydro' nodes, say:
>
> set queue batch resources_default.neednodes = generic
> set queue hydrology resources_default.neednodes = hydro
>
> [unset the previous neednodes = 020 in the hydrology queue].
>
> I hope this helps,
> Gus Correa
>
>
Definitely worth a try - it makes perfect sense.  Thanks for the
suggestion.  The only roadblock I am concerned with is the fact that
something within torque dynamically modifies the nodes file.  I am hoping
it will leave my modifications intact.  I will let you know what happens.

Thanks!


>
> >     I hope it helps,
> >     Gus Correa
> >
> >      >     David
> >      >
> >      >
> >      >     On Tue, Apr 24, 2012 at 10:21 AM, Christina Salls
> >      > <christina.salls at noaa.gov <mailto:christina.salls at noaa.gov>
> >     <mailto:christina.salls at noaa.gov <mailto:christina.salls at noaa.gov>>>
> >     wrote:
> >      >
> >      >
> >      >
> >      >         On Tue, Apr 24, 2012 at 12:10 PM, Gus Correa
> >      > <gus at ldeo.columbia.edu <mailto:gus at ldeo.columbia.edu>
> >     <mailto:gus at ldeo.columbia.edu <mailto:gus at ldeo.columbia.edu>>>
> wrote:
> >      >
> >      >             On 04/24/2012 12:00 PM, Christina Salls wrote:
> >      > > Hi David,
> >      > >
> >      > >        I tried using that synax and had a problem:
> >      > >
> >      > > Qmgr: set queue hydrology resources_default.need_nodes=<n020>
> >      >
> >      >             The syntax takes just the node name, I believe:
> >      >
> >      >             set queue hydrology resources_default.need_nodes=n020
> >      >
> >      >
> >      >         Thanks Gus, I unset the resource and reset it without the
> >     brackets.
> >      >         Qmgr: unset queue hydrology resources_default.neednodes
> >      >         Qmgr: set queue hydrology resources_default.neednodes=
> n020
> >      >         Qmgr: print queue hydrology
> >      >         #
> >      >         # Create queues and set their attributes.
> >      >         #
> >      >         #
> >      >         # Create and define queue hydrology
> >      >         #
> >      >         create queue hydrology
> >      >         set queue hydrology queue_type = Execution
> >      >         set queue hydrology resources_default.neednodes = n020
> >      >         set queue hydrology enabled = True
> >      >         set queue hydrology started = True
> >      >
> >      >
> >      > > qmgr obj=hydrology svr=default: Unknown resource type
> >      > >   resources_default.need_nodes
> >      > >
> >      > > This is what ended up working for me.  Thanks again for
> >      >             your help!
> >      > >
> >      > > Qmgr: set queue hydrology resources_default.neednodes=<n020>
> >      > > Qmgr: print queue hydrology
> >      > > #
> >      > > # Create queues and set their attributes.
> >      > > #
> >      > > #
> >      > > # Create and define queue hydrology
> >      > > #
> >      > > create queue hydrology
> >      > > set queue hydrology queue_type = Execution
> >      > > set queue hydrology resources_default.neednodes = <n020>
> >      > > set queue hydrology enabled = True
> >      > > set queue hydrology started = True
> >      > > Qmgr:
> >      > >
> >      > >
> >      > >
> >      > > On Tue, Apr 24, 2012 at 11:50 AM, Christina Salls
> >      > > <christina.salls at noaa.gov <mailto:christina.salls at noaa.gov>
> >      > <mailto:christina.salls at noaa.gov <mailto:christina.salls at noaa.gov
> >>
> >      > <mailto:christina.salls at noaa.gov <mailto:christina.salls at noaa.gov
> >
> >      > <mailto:christina.salls at noaa.gov
> >     <mailto:christina.salls at noaa.gov>>>> wrote:
> >      > >
> >      > >
> >      > >
> >      > >     On Tue, Apr 24, 2012 at 11:38 AM, David Beer
> >      > > <dbeer at adaptivecomputing.com <mailto:
> dbeer at adaptivecomputing.com>
> >      > <mailto:dbeer at adaptivecomputing.com
> >     <mailto:dbeer at adaptivecomputing.com>>
> >      > <mailto:dbeer at adaptivecomputing.com
> >     <mailto:dbeer at adaptivecomputing.com>
> >      > <mailto:dbeer at adaptivecomputing.com
> >     <mailto:dbeer at adaptivecomputing.com>>>>
> >      > >     wrote:
> >      > >
> >      > >         Christina
> >      > >
> >      > >         To make the hydrology queue request <specific
> >      >             node> by default -
> >      > >
> >      > > 'set queue hydrology
> >      >             resources_default.need_nodes=<specific node>'
> >      > >
> >      > >         David
> >      > >
> >      > >
> >      > >     Thanks David!!
> >      > >
> >      > >
> >      > >
> >      > >
> >      > >
> >      > > --
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://www.supercluster.org/pipermail/torqueusers/attachments/20120424/12335255/attachment-0001.html 


More information about the torqueusers mailing list