[Mauiusers] nodeaccesspolicy based on queue and job?
David B Jackson
jacksond at clusterresources.com
Wed Oct 19 21:51:34 MDT 2005
> I think it is good enough for now, but I'll take a raincheck on that
> favor :)
We coded it up already but changed it a bit to 'CLASSCFG[X]
NODEACCESSPOLICY=Y' to make it compatible with Moab. Even though its
finished, we'll still honor your raincheck. :)
> I just now (a few minutes ago) got things working with a QOS. I found
> that you can't override a global "NODEACCESSPOLICY SINGLEJOB" with a
> per-job "-W x=NACCESSPOLICY:SHARED", there's just no support for it
> maui. Fortunately the other way around works:
> NODEACCESSPOLICY SHARED
> CLASSCFG[cmbshared] QDEF=shared QLIST=shared
> QOSCFG[DEFAULT] QFLAGS=DEDICATED
> QOSCFG[shared] QFLAGS=RESERVEALWAYS
> Where I have a routing queue in TORQUE called "cmb" sending single-proc
> jobs to cmbshared and the rest to cmbmain. It seems to work, but seems
> like a fragile config. I don't know why i need "QFLAGS=RESERVEALWAYS",
> but a second job simply doesn't start without it.
> On Wed, Oct 19, 2005 at 09:31:51PM -0600, David B Jackson alleged:
>> We will add support for 'CLASSCFG[X] NODEACCESSPOLICY=X' tonight.
>> Will this work?
>> > On my large cluster with a global "NODEACCESSPOLICY SINGLEJOB", I'm
>> > trying to meet a specific requirement of letting single-proc jobs
>> > a specific class share nodes. This should be transparent to the user
>> > and not require additional arguments to qsub (from TORQUE).
>> > I can't think of a way to do this purely in maui.cfg. It seems like I
>> > should able to do this with a QOS, but it doesn't seem possible.
>> > Other possibilities that I can think of include:
>> > - In TORQUE, single-proc jobs go through a routing queue that adds
>> > NACCESSPOLICY:SHARED to the RM extensions (doesn't seem possible).
>> > - In TORQUE, route single-proc jobs to a different execution queue,
>> > maui.cfg has "CLASSCFG[foo] NODEACCESSPOLICY SHARED" (also doesn't
>> > seem possible).
>> > - A qsub filter that adds "-W x=NACCESSPOLICY:SHARED" for single-proc
>> > jobs in the correct queue.
>> > Anyone have any suggestions for me?
>> > --
>> > Garrick Staples, Linux/HPCC Administrator
>> > University of Southern California
>> > _______________________________________________
>> > mauiusers mailing list
>> > mauiusers at supercluster.org
>> > http://www.supercluster.org/mailman/listinfo/mauiusers
> Garrick Staples, Linux/HPCC Administrator
> University of Southern California
> mauiusers mailing list
> mauiusers at supercluster.org
More information about the mauiusers