[torqueusers] assigning resources to a queue
Christina Salls
christina.salls at noaa.gov
Tue Apr 24 14:03:51 MDT 2012
On Tue, Apr 24, 2012 at 2:56 PM, Gus Correa <gus at ldeo.columbia.edu> wrote:
> On 04/24/2012 02:31 PM, Christina Salls wrote:
> >
> >
> > On Tue, Apr 24, 2012 at 1:28 PM, Gus Correa <gus at ldeo.columbia.edu
> > <mailto:gus at ldeo.columbia.edu>> wrote:
> >
> >
> > On 04/24/2012 01:09 PM, Christina Salls wrote:
> > >
> > >
> > > On Tue, Apr 24, 2012 at 12:59 PM, David Beer
> > > <dbeer at adaptivecomputing.com <mailto:dbeer at adaptivecomputing.com>
> > <mailto:dbeer at adaptivecomputing.com
> > <mailto:dbeer at adaptivecomputing.com>>> wrote:
> > >
> > > Sorry for the confusion, I meant that you should replace
> > <specific
> > > node> with the node's name. Thanks for clarifying Gus.
> > >
> > > Of course, I should have realized that! Thanks again.
> > >
> > > Now that I have node n020 assigned to the hydrology queue, will
> that
> > > make it unavailable to the batch queue?
> > >
> >
> >
> > In maui.cfg
> >
> > ENABLEMULTIREQJOBS TRUE
> >
> > See the Maui Admin Guide for the meaning:
> >
> http://www.adaptivecomputing.com/resources/docs/maui/a.fparameters.php
> >
> > I am still using the built in scheduler in torque. I haven't installed
> > maui yet.
> >
>
> Not sure if this will work with pbs_sched,
> but may be worth trying.
>
> 1) In server_priv/nodes add some 'properties' to your nodes,
> something like this:
>
> n001 np=8 generic
> n002 np=8 generic
> ...
> n019 np=8 generic
> n020 np=8 hydro
>
> 'generic' and 'hydro' are node 'properties',
> you can call them any string you want, and use as many
> 'properties' you want/need for each node.
>
>
> http://www.adaptivecomputing.com/resources/docs/torque/3-0-3/3.2nodeproperties.php
>
> http://www.adaptivecomputing.com/resources/docs/torque/3-0-3/4.1queueconfig.php#mapping
>
> http://www.adaptivecomputing.com/resources/docs/torque/3-0-3/2.1jobsubmission.php
>
> 2) Reconfigure slightly your queues to default
> to 'generic' and 'hydro' nodes, say:
>
> set queue batch resources_default.neednodes = generic
> set queue hydrology resources_default.neednodes = hydro
>
> [unset the previous neednodes = 020 in the hydrology queue].
>
> I hope this helps,
> Gus Correa
>
>
Definitely worth a try - it makes perfect sense. Thanks for the
suggestion. The only roadblock I am concerned with is the fact that
something within torque dynamically modifies the nodes file. I am hoping
it will leave my modifications intact. I will let you know what happens.
Thanks!
>
> > I hope it helps,
> > Gus Correa
> >
> > > David
> > >
> > >
> > > On Tue, Apr 24, 2012 at 10:21 AM, Christina Salls
> > > <christina.salls at noaa.gov <mailto:christina.salls at noaa.gov>
> > <mailto:christina.salls at noaa.gov <mailto:christina.salls at noaa.gov>>>
> > wrote:
> > >
> > >
> > >
> > > On Tue, Apr 24, 2012 at 12:10 PM, Gus Correa
> > > <gus at ldeo.columbia.edu <mailto:gus at ldeo.columbia.edu>
> > <mailto:gus at ldeo.columbia.edu <mailto:gus at ldeo.columbia.edu>>>
> wrote:
> > >
> > > On 04/24/2012 12:00 PM, Christina Salls wrote:
> > > > Hi David,
> > > >
> > > > I tried using that synax and had a problem:
> > > >
> > > > Qmgr: set queue hydrology resources_default.need_nodes=<n020>
> > >
> > > The syntax takes just the node name, I believe:
> > >
> > > set queue hydrology resources_default.need_nodes=n020
> > >
> > >
> > > Thanks Gus, I unset the resource and reset it without the
> > brackets.
> > > Qmgr: unset queue hydrology resources_default.neednodes
> > > Qmgr: set queue hydrology resources_default.neednodes=
> n020
> > > Qmgr: print queue hydrology
> > > #
> > > # Create queues and set their attributes.
> > > #
> > > #
> > > # Create and define queue hydrology
> > > #
> > > create queue hydrology
> > > set queue hydrology queue_type = Execution
> > > set queue hydrology resources_default.neednodes = n020
> > > set queue hydrology enabled = True
> > > set queue hydrology started = True
> > >
> > >
> > > > qmgr obj=hydrology svr=default: Unknown resource type
> > > > resources_default.need_nodes
> > > >
> > > > This is what ended up working for me. Thanks again for
> > > your help!
> > > >
> > > > Qmgr: set queue hydrology resources_default.neednodes=<n020>
> > > > Qmgr: print queue hydrology
> > > > #
> > > > # Create queues and set their attributes.
> > > > #
> > > > #
> > > > # Create and define queue hydrology
> > > > #
> > > > create queue hydrology
> > > > set queue hydrology queue_type = Execution
> > > > set queue hydrology resources_default.neednodes = <n020>
> > > > set queue hydrology enabled = True
> > > > set queue hydrology started = True
> > > > Qmgr:
> > > >
> > > >
> > > >
> > > > On Tue, Apr 24, 2012 at 11:50 AM, Christina Salls
> > > > <christina.salls at noaa.gov <mailto:christina.salls at noaa.gov>
> > > <mailto:christina.salls at noaa.gov <mailto:christina.salls at noaa.gov
> >>
> > > <mailto:christina.salls at noaa.gov <mailto:christina.salls at noaa.gov
> >
> > > <mailto:christina.salls at noaa.gov
> > <mailto:christina.salls at noaa.gov>>>> wrote:
> > > >
> > > >
> > > >
> > > > On Tue, Apr 24, 2012 at 11:38 AM, David Beer
> > > > <dbeer at adaptivecomputing.com <mailto:
> dbeer at adaptivecomputing.com>
> > > <mailto:dbeer at adaptivecomputing.com
> > <mailto:dbeer at adaptivecomputing.com>>
> > > <mailto:dbeer at adaptivecomputing.com
> > <mailto:dbeer at adaptivecomputing.com>
> > > <mailto:dbeer at adaptivecomputing.com
> > <mailto:dbeer at adaptivecomputing.com>>>>
> > > > wrote:
> > > >
> > > > Christina
> > > >
> > > > To make the hydrology queue request <specific
> > > node> by default -
> > > >
> > > > 'set queue hydrology
> > > resources_default.need_nodes=<specific node>'
> > > >
> > > > David
> > > >
> > > >
> > > > Thanks David!!
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > --
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://www.supercluster.org/pipermail/torqueusers/attachments/20120424/12335255/attachment-0001.html
More information about the torqueusers
mailing list