[torqueusers] qsub wrapper examples for filtering on memory request

Andrew Ring apring at umn.edu
Mon Feb 25 14:52:20 MST 2013


Sreedhar,

Thank you for sharing this.  It looks like a really great script.

-Andrew

On 02/25/2013 03:35 PM, Sreedhar Manchu wrote:
> Hi Andrew,
>
> I use qsub wrapper to do many things on our clusters. It works based on queues (declared or undeclared). It might look very big but it is a very simple script and has been working very well on our clusters for the past two years. I use this script to reject the jobs and also inform users whenever they submit jobs requesting either more memory or wrong queues, etc. If you are interested in using it and need little bit more help let me know and I will get back to you with little bit more detail some time tomorrow.
>
> Please find the attached script. This version was added to one of our new clusters in September 2012.
>
>
>
>
>
>
>
>
>
>
> Sreedhar.
>
> On Feb 25, 2013, at 3:49 PM, Andrew Ring <apring at umn.edu> wrote:
>
>> tl;dr - Requesting qsub wrapper examples to reject jobs that ask for too
>> much RAM or alt method.
>>
>> Hello,
>>
>> I wish to immediately reject jobs that ask for too much RAM.  I would
>> like to make my filter as simple and comprehensive as possible.  I have
>> found two example qsub filters online, but neither deals directly with
>> filtering on RAM usage.  Would anyone be willing to share one?
>>
>> Is there a job parser that replicates the parsing done by torque already
>> or otherwise makes that output available?  For instance the output from
>> checkjob presents the information in a usable format.
>>
>> Has the issue of the queue limit on mem been resolved?  By which I mean
>> is this statement no longer valid on a newer version?:
>> mem	size	Amount of physical memory used by the job. (Ignored on Darwin,
>> Digital Unix, Free BSD, HPUX 11, IRIX, NetBSD, and SunOS. Also ignored
>> on Linux if number of nodes is not 1. Not implemented on AIX and HPUX 10.)
>>
>> source: http://docs.adaptivecomputing.com/torque/3-0-5/4.1queueconfig.php
>>
>> Thank you,
>> Andrew
>> _______________________________________________
>> torqueusers mailing list
>> torqueusers at supercluster.org
>> http://www.supercluster.org/mailman/listinfo/torqueusers
>
>
>
> _______________________________________________
> torqueusers mailing list
> torqueusers at supercluster.org
> http://www.supercluster.org/mailman/listinfo/torqueusers
>

-- 
Andrew Ring
HPC Systems Administrator
University of Minnesota Twin Cities
Phone: 612-624-8860                 Fax: 612-624-8861
Mail:                               Office:
599 Walter Library                  543 Walter Library
117 Pleasant St S.E.                117 Pleasant St S.E.
Minneapolis, MN 55455               Minneapolis, MN 55455


More information about the torqueusers mailing list