[Mauiusers] nodeaccesspolicy based on queue and job?

[David B Jackson]

Garrick,

> I think it is good enough for now, but I'll take a raincheck on that
> favor :)

  We coded it up already but changed it a bit to 'CLASSCFG[X]
NODEACCESSPOLICY=Y' to make it compatible with Moab.  Even though its
finished, we'll still honor your raincheck. :)

Dave


> I just now (a few minutes ago) got things working with a QOS.  I found
> that you can't override a global "NODEACCESSPOLICY SINGLEJOB" with a
> per-job "-W x=NACCESSPOLICY:SHARED", there's just no support for it
> maui.  Fortunately the other way around works:
>
> NODEACCESSPOLICY           SHARED
>
> CLASSCFG[cmbmain]
> CLASSCFG[cmbshared]     QDEF=shared QLIST=shared
> QOSCFG[DEFAULT]         QFLAGS=DEDICATED
> QOSCFG[shared]          QFLAGS=RESERVEALWAYS
>
> Where I have a routing queue in TORQUE called "cmb" sending single-proc
> jobs to cmbshared and the rest to cmbmain.  It seems to work, but seems
> like a fragile config.  I don't know why i need "QFLAGS=RESERVEALWAYS",
> but a second job simply doesn't start without it.


>
>
>
> On Wed, Oct 19, 2005 at 09:31:51PM -0600, David B Jackson alleged:
>> Garrick,
>>
>>   We will add support for 'CLASSCFG[X] NODEACCESSPOLICY=X' tonight.
>>
>>   Will this work?
>>
>> Dave
>>
>> > On my large cluster with a global "NODEACCESSPOLICY SINGLEJOB", I'm
>> > trying to meet a specific requirement of letting single-proc jobs
>> within
>> > a specific class share nodes.  This should be transparent to the user
>> > and not require additional arguments to qsub (from TORQUE).
>> >
>> > I can't think of a way to do this purely in maui.cfg.  It seems like I
>> > should able to do this with a QOS, but it doesn't seem possible.
>> >
>> > Other possibilities that I can think of include:
>> >
>> > - In TORQUE, single-proc jobs go through a routing queue that adds
>> >   NACCESSPOLICY:SHARED to the RM extensions (doesn't seem possible).
>> >
>> > - In TORQUE, route single-proc jobs to a different execution queue,
>> then
>> >   maui.cfg has "CLASSCFG[foo] NODEACCESSPOLICY SHARED" (also doesn't
>> >   seem possible).
>> >
>> > - A qsub filter that adds "-W x=NACCESSPOLICY:SHARED" for single-proc
>> >   jobs in the correct queue.
>> >
>> > Anyone have any suggestions for me?
>> >
>> > --
>> > Garrick Staples, Linux/HPCC Administrator
>> > University of Southern California
>> > _______________________________________________
>> > mauiusers mailing list
>> > mauiusers at supercluster.org
>> > http://www.supercluster.org/mailman/listinfo/mauiusers
>> >
>>
>
> --
> Garrick Staples, Linux/HPCC Administrator
> University of Southern California
> _______________________________________________
> mauiusers mailing list
> mauiusers at supercluster.org
> http://www.supercluster.org/mailman/listinfo/mauiusers
>