[torqueusers] Queue Node Type and ppn

Jan Kasiak j.kasiak at gmail.com
Wed Oct 26 15:31:16 MDT 2011


I tried a simple bash script with 'exit -1' and it didn't work on an
older version of torque (2.2.1), but it does work on the machine I
want with newer torque (3.0.0.).

I think I'll be good from here :-)

-Jan

On Wed, Oct 26, 2011 at 5:16 PM, Jan Kasiak <j.kasiak at gmail.com> wrote:
> I would greatly appreciate it if you could send it to me.
>
> Thanks,
> -Jan
>
> On Oct 26, 2011 5:05 PM, "Sreedhar Manchu" <sm4082 at nyu.edu> wrote:
>>
>> Hello,
>>
>> Yes. It catches only qsub script. What I did was to make it check all the
>> arguments as well as file. There are tons of options for qsub and most of
>> the time we don't have to  about ckecking all of them. Overall it got quite
>> complicated with what I wanted wrapper to do. If you want I can send you
>> mine just to build on it. Let me know.
>>
>> Sreedhar.
>>
>> --
>> Sent from my phone. Please excuse my brevity and any typos.
>>
>> On Oct 26, 2011, at 16:53, Jan Kasiak <j.kasiak at gmail.com> wrote:
>>
>> > I have run into an issue with trying to implement a submission filter:
>> >
>> > The filter only catches the request if its:
>> > qsub myjob.sh
>> >
>> > And it does not catch the following:
>> > qsub -I -lnodes=2:ppn=2
>> >
>> > Do I have to write wrapper to qsub as well as a submission filter?
>> >
>> > Thanks,
>> > -Jan
>> >
>> > On Mon, Oct 24, 2011 at 5:23 PM, Jan Kasiak <j.kasiak at gmail.com> wrote:
>> >> Gareth,
>> >>
>> >> I had started to write my own wrapper to the qsub binary. I didnt know
>> >> that
>> >> torque had submit filter support. I will proceed with this option and
>> >> see
>> >> how it goes.
>> >>
>> >> Many Thanks,
>> >> -Jan
>> >>
>> >> On Oct 24, 2011 4:32 PM, <Gareth.Williams at csiro.au> wrote:
>> >>>
>> >>>> -----Original Message-----
>> >>>> From: Jan Kasiak [mailto:j.kasiak at gmail.com]
>> >>>> Sent: Sunday, 23 October 2011 10:10 AM
>> >>>> To: torqueusers at supercluster.org
>> >>>> Subject: [torqueusers] Queue Node Type and ppn
>> >>>>
>> >>>> Hello Everyone,
>> >>>>
>> >>>> I'm using torque-3.0.0 and maui-3.3_pbs
>> >>>> I have searched far and wide for a solution to this problem..and I
>> >>>> can't find out how to set this up.
>> >>>> I have 3 node types: (13) * p5300, (16) * p5400 and (39) * towel (set
>> >>>> in my nodes file):
>> >>>>
>> >>>> towel01 np=12 towel
>> >>>> ...
>> >>>> p530001 np=8 p5300
>> >>>> ...
>> >>>> p540001 np=8 p5400
>> >>>> ...
>> >>>>
>> >>>> I want to prevent users from mixing node types for their jobs.
>> >>>>
>> >>>> I want to set up 3 queues, one for each node type, in such a way that
>> >>>> if you submit to queue p5300, it will error for the following:
>> >>>> qsub -I -q p5300 -lnodes=14:ppn=8 (more than 13 nodes)
>> >>>> qsub -I -q p5300 -lnodes=13:ppn=9 (ppn greater than available for
>> >>>> p5300)
>> >>>> qsub -I -q p5300 -lnodes=2:ppn=9 (ppn greater than available for
>> >>>> p5300)
>> >>>>
>> >>>> Is this possible to set up?
>> >>>>
>> >>>> Thanks,
>> >>>> -Jan Kasiak
>> >>>
>> >>> Hi Jan,
>> >>>
>> >>> I'll stick my neck out and state that the only way to reject jobs
>> >>> based on
>> >>> the nodes and ppn as you would like is to use a submit filter.
>> >>>
>> >>> The rest can be done with reservations for each type of nodes and
>> >>> queues/classes that can access those reservations, or maybe just with
>> >>> types
>> >>> and defaults on queues.
>> >>>
>> >>> Gareth
>> >>> _______________________________________________
>> >>> torqueusers mailing list
>> >>> torqueusers at supercluster.org
>> >>> http://www.supercluster.org/mailman/listinfo/torqueusers
>> >>
>> > _______________________________________________
>> > torqueusers mailing list
>> > torqueusers at supercluster.org
>> > http://www.supercluster.org/mailman/listinfo/torqueusers
>> _______________________________________________
>> torqueusers mailing list
>> torqueusers at supercluster.org
>> http://www.supercluster.org/mailman/listinfo/torqueusers
>


More information about the torqueusers mailing list