[Mauiusers] job submitted to multiple nodes is blocked

[Robert Jacobi]

Thanks Peter,

That was exactly the issue.

Upon looking for it in the Maui Admin Guide, I  noticed that the 
ENABLEMULTIREQJOBS parameter is documented in the html 
(http://www.adaptivecomputing.com/resources/docs/maui/a.fparameters.php) 
but not in the PDF version 
(http://www.adaptivecomputing.com/resources/docs/maui/pdf/mauiadmin.pdf).

Thanks again.
Robert

Peter Crosta wrote:
> Hi Robert,
>
> Do you have the following line in your maui config?
>
> ENABLEMULTIREQJOBS    TRUE
>
> I believe it is require to request multiple resources.
>
> Best,
> Peter
>  
> -----Original Message-----
> From: mauiusers-bounces at supercluster.org
> [mailto:mauiusers-bounces at supercluster.org] On Behalf Of Robert Jacobi
> Sent: Tuesday, March 29, 2011 9:30 PM
> To: mauiusers at supercluster.org
> Subject: [Mauiusers] job submitted to multiple nodes is blocked
>
> Hello,
>
> We're running Maui with Torque on our cluster (10 nodes, 8 cores each). 
> When I submit a job on multiple nodes specifying them in a certain why my
> job gets blocked by Maui, otherwise it runs just fine.
>
> Here's the line I usually use in submission script to submit jobs to
> mutliple nodes (say if I need 16 cores): "#PBS -l nodes=2:ppn=8". That works
> just fine.
>
> But when I don't need a multiple of 8 processors and don't want to block
> processors unnecessarily, I tried the following (say to get 20 cores): 
> "#PBS -l nodes=2:ppn=8+1:ppn=4"
> According to the Torque user manual that should get me 16 cores on 2 nodes
> and 4 cores on the third. I can submit it without a problem, but then it is
> blocked by Maui.
> For testing I also tried "#PBS -l nodes=1:ppn=1+1:ppn=1" and "#PBS -l
> nodes=1:ppn=8+1:ppn=8", which are blocked as well
>
> Output from showq for the blocked job:
> ================================================================
> BLOCKED JOBS----------------
> JOBNAME            USERNAME      STATE  PROC     WCLIMIT            
> QUEUETIME
> 1272                 robert  BatchHold     1    00:00:30  Tue Mar 29 
> 18:06:47
> ================================================================
>
> The relevant policies (as far as I know), which are set in maui.cfg, are:
> NODEACCESSPOLICY        SHARED
> JOBNODEMATCHPOLICY      EXACTNODE
>
> Please, can anybody point me to where the problem might be? If there are
> queue specific settings that could cause this, I'd be more than happy to
> provide more information.
>
> Thanks,
> Robert
>
> PS: I am aware that I could just reserve multiple of 8 processors and let
> some of them sit idle, but on our relatively small cluster that amounts to s
> significant waste of resources.
>
> --
> Robert Jacobi
> Research Assistant
> University of Arizona
> Department of Aerospace & Mechanical Engineering
> 1130 N. Mountain Ave.
> Tucson, AZ, 85721-0119
>
> tel: +1 (520) 621 4369
> mail: rjacobi at email.arizona.edu
>
>
> The less time you spent on algebra in life, the more time you have to be a
> happy person. (Kerschen)
>
> Doubt is not a pleasant condition, but certainty is absurd. (Voltaire)
>
> All great truths begin as blasphemies. (Shaw)
>
> Denken ist etwas, das auf Schwierigkeiten folgt und dem das Handeln
> vorausgeht.(Brecht)
>
> _______________________________________________
> mauiusers mailing list
> mauiusers at supercluster.org
> http://www.supercluster.org/mailman/listinfo/mauiusers
>
>
>   

-- 
Robert Jacobi
Research Assistant
University of Arizona
Department of Aerospace & Mechanical Engineering
1130 N. Mountain Ave.
Tucson, AZ, 85721-0119

tel: +1 (520) 621 4369
mail: rjacobi at email.arizona.edu


The less time you spent on algebra in life, the more time you have to be a happy person. (Kerschen)

Doubt is not a pleasant condition, but certainty is absurd. (Voltaire)

All great truths begin as blasphemies. (Shaw)

Denken ist etwas, das auf Schwierigkeiten folgt und dem das Handeln vorausgeht.(Brecht)