[Mauiusers] Problem configuring a simple queue

Diego M. Vadell dvadell at linuxclusters.com.ar
Wed Dec 10 12:28:17 MST 2008


Hi,

  I'm having a hard time configuring a simple queue with more priority than 
the other. I may be no seeing something really big, so I ask for your help.

  Queue "rapida" must have, always, more priority than queue "default", which 
is the default queue. I've configured maui and, if I submit several test 
jobs, I seem to get the priorities right:

Job                    PRIORITY*   Cred( User:Group:Class)  Serv(QTime)
             Weights   --------       1(    1:    1:   10)     1(    1)

6741                     100010   100.0(  0.0:  0.0:10000)   0.0( 10.1)
6756                     100003   100.0(  0.0:  0.0:10000)   0.0(  2.8)
6757                     100003   100.0(  0.0:  0.0:10000)   0.0(  2.8)
6758                     100003   100.0(  0.0:  0.0:10000)   0.0(  2.8)
6759                     100003   100.0(  0.0:  0.0:10000)   0.0(  2.8)
6760                     100003   100.0(  0.0:  0.0:10000)   0.0(  2.8)
6761                     100003   100.0(  0.0:  0.0:10000)   0.0(  2.8)
6762                     100003   100.0(  0.0:  0.0:10000)   0.0(  2.8)
6763                         13    78.4(  0.0:  0.0:  1.0)  21.6(  2.8)
6764                         13    78.4(  0.0:  0.0:  1.0)  21.6(  2.8)
6765                         13    78.4(  0.0:  0.0:  1.0)  21.6(  2.8)
6766                         13    78.4(  0.0:  0.0:  1.0)  21.6(  2.8)
6767                         13    78.4(  0.0:  0.0:  1.0)  21.6(  2.8)
6768                         13    78.4(  0.0:  0.0:  1.0)  21.6(  2.8)
6769                         13    78.4(  0.0:  0.0:  1.0)  21.6(  2.8)

But a minute later, the ones with priority 13 get scheduled to run!

Job                    PRIORITY*   Cred( User:Group:Class)  Serv(QTime)
             Weights   --------       1(    1:    1:   10)     1(    1)

6741                     100010   100.0(  0.0:  0.0:10000)   0.0( 10.4)
6756                     100003   100.0(  0.0:  0.0:10000)   0.0(  3.0)
6757                     100003   100.0(  0.0:  0.0:10000)   0.0(  3.0)
6758                     100003   100.0(  0.0:  0.0:10000)   0.0(  3.0)
6759                     100003   100.0(  0.0:  0.0:10000)   0.0(  3.0)
6760                     100003   100.0(  0.0:  0.0:10000)   0.0(  3.0)
6761                     100003   100.0(  0.0:  0.0:10000)   0.0(  3.0)
6762                     100003   100.0(  0.0:  0.0:10000)   0.0(  3.0)
6766                         13    76.6(  0.0:  0.0:  1.0)  23.4(  3.0)
6767                         13    76.6(  0.0:  0.0:  1.0)  23.4(  3.0)
6768                         13    76.6(  0.0:  0.0:  1.0)  23.4(  3.0)
6769                         13    76.6(  0.0:  0.0:  1.0)  23.4(  3.0)

Percent Contribution   --------   100.0(  0.0:  0.0:100.0)   0.0(  0.0)

Some time later, 6741  (priority: 100010) started. 

So it seems maui is scheduling some jobs from one queue, and some from the 
other, when it should just use the priority and schedule all the ones that 
belong to the "rapida" queue first.

I ran into the output of "diagnose -c" 

Class/Queue Status

Name    Priority Flags  QDef  QOSList* PartitionList        Target Limits

rapida    10000 [NONE]  [NONE]  [NONE] [NONE]  0.00  MAXJOB=2:100000
  MAXJOBPERUSER=100000,100000
default         1  [NONE] [NONE]  [NONE]  [NONE]  0.00  [NONE]


What does that "MAXJOB=2:100000" means? I can't find MAXJOB defined anywhere 
in maui.cfg nor in showconfig, nor in qmgr's "p s".


My maui.cfg looks like this:

----------------------------------------
RMPOLLINTERVAL          00:00:30
SERVERHOST              bose.fisica.unlp.edu.ar
SERVERPORT              42559
SERVERMODE              NORMAL
RMCFG[base]             TYPE=PBS

# Admin: http://supercluster.org/mauidocs/a.esecurity.html
# ADMIN1 users have full scheduler control
ADMIN1                maui root
LOGFILE               maui.log
LOGFILEMAXSIZE        10000000
LOGLEVEL              3

# Job Priority: http://supercluster.org/mauidocs/5.1jobprioritization.html
QUEUETIMEWEIGHT       1
# Throttling Policies: 
http://supercluster.org/mauidocs/6.2throttlingpolicies.html

# NONE SPECIFIED

# Backfill: http://supercluster.org/mauidocs/8.2backfill.html

BACKFILLPOLICY        FIRSTFIT
RESERVATIONPOLICY     CURRENTHIGHEST

# Node Allocation: http://supercluster.org/mauidocs/5.2nodeallocation.html
#NODEALLOCATIONPOLICY  MINRESOURCE
NODEALLOCATIONPOLICY     PRIORITY

# QOS: http://supercluster.org/mauidocs/7.3qos.html
CLASSCFG[rapida]  PRIORITY=10000 MAXJOB=8
CLASSCFG[default] PRIORITY=1
CLASSWEIGHT   10
CREDWEIGHT 1
USERWEIGHT 1
GROUPWEIGHT 1

# Standing Reservations: 
http://supercluster.org/mauidocs/7.1.3standingreservations.html

# SRSTARTTIME[test] 8:00:00
# SRENDTIME[test]   17:00:00
# SRDAYS[test]      MON TUE WED THU FRI
# SRTASKCOUNT[test] 20
# SRMAXTIME[test]   0:30:00

# Creds: http://supercluster.org/mauidocs/6.1fairnessoverview.html

# USERCFG[DEFAULT]      FSTARGET=25.0
# USERCFG[john]         PRIORITY=100  FSTARGET=10.0-
# GROUPCFG[staff]       PRIORITY=1000 QLIST=hi:low QDEF=hi
# CLASSCFG[batch]       FLAGS=PREEMPTEE
# CLASSCFG[interactive] FLAGS=PREEMPTOR
------------------------


schedctl -l returns:
-------------------------------------
# Maui version 3.2.6p19 (PID: 26905)
# global policies

REJECTNEGPRIOJOBS[0]              FALSE
ENABLENEGJOBPRIORITY[0]           FALSE
ENABLEMULTINODEJOBS[0]            TRUE
ENABLEMULTIREQJOBS[0]             FALSE
BFPRIORITYPOLICY[0]               [NONE]
JOBPRIOACCRUALPOLICY            QUEUEPOLICY
NODELOADPOLICY                  ADJUSTSTATE
USEMACHINESPEED                 FALSE
USESYSTEMQUEUETIME              TRUE
USELOCALMACHINEPRIORITY         FALSE
NODEUNTRACKEDLOADFACTOR         1.2
JOBNODEMATCHPOLICY[0]

JOBMAXSTARTTIME[0]                  INFINITY

METAMAXTASKS[0]                   0
NODESETPOLICY[0]                  [NONE]
NODESETATTRIBUTE[0]               [NONE]
NODESETLIST[0]
NODESETDELAY[0]                   00:00:00
NODESETPRIORITYTYPE[0]            MINLOSS
NODESETTOLERANCE[0]                 0.00

BACKFILLPOLICY[0]                 FIRSTFIT
BACKFILLDEPTH[0]                  0
BACKFILLPROCFACTOR[0]             0
BACKFILLMAXSCHEDULES[0]           10000
BACKFILLMETRIC[0]                 PROCS

BFCHUNKDURATION[0]                00:00:00
BFCHUNKSIZE[0]                    0
PREEMPTPOLICY[0]                  REQUEUE
MINADMINSTIME[0]                  00:00:00
RESOURCELIMITPOLICY[0]
NODEAVAILABILITYPOLICY[0]         COMBINED:[DEFAULT]
NODEALLOCATIONPOLICY[0]           PRIORITY
TASKDISTRIBUTIONPOLICY[0]         DEFAULT
RESERVATIONPOLICY[0]              CURRENTHIGHEST
RESERVATIONRETRYTIME[0]           00:00:00
RESERVATIONTHRESHOLDTYPE[0]       NONE
RESERVATIONTHRESHOLDVALUE[0]      0

FSPOLICY                        [NONE]
FSPOLICY                        [NONE]
FSINTERVAL                      12:00:00
FSDEPTH                         8
FSDECAY                         1.00



# Priority Weights

SERVICEWEIGHT[0]                  1
TARGETWEIGHT[0]                   1
CREDWEIGHT[0]                     1
ATTRWEIGHT[0]                     1
FSWEIGHT[0]                       1
RESWEIGHT[0]                      1
USAGEWEIGHT[0]                    1
QUEUETIMEWEIGHT[0]                1
XFACTORWEIGHT[0]                  0
SPVIOLATIONWEIGHT[0]              0
BYPASSWEIGHT[0]                   0
TARGETQUEUETIMEWEIGHT[0]          0
TARGETXFACTORWEIGHT[0]            0
USERWEIGHT[0]                     1
GROUPWEIGHT[0]                    1
ACCOUNTWEIGHT[0]                  0
QOSWEIGHT[0]                      0
CLASSWEIGHT[0]                    10
FSUSERWEIGHT[0]                   0
FSGROUPWEIGHT[0]                  0
FSACCOUNTWEIGHT[0]                0
FSQOSWEIGHT[0]                    0
FSCLASSWEIGHT[0]                  0
ATTRATTRWEIGHT[0]                 0
ATTRSTATEWEIGHT[0]                0
NODEWEIGHT[0]                     0
PROCWEIGHT[0]                     0
MEMWEIGHT[0]                      0
SWAPWEIGHT[0]                     0
DISKWEIGHT[0]                     0
PSWEIGHT[0]                       0
PEWEIGHT[0]                       0
WALLTIMEWEIGHT[0]                 0
UPROCWEIGHT[0]                    0
UJOBWEIGHT[0]                     0
CONSUMEDWEIGHT[0]                 0
USAGEEXECUTIONTIMEWEIGHT[0]       0
REMAININGWEIGHT[0]                0
PERCENTWEIGHT[0]                  0
XFMINWCLIMIT[0]                   00:02:00


# partition DEFAULT policies

REJECTNEGPRIOJOBS[1]              FALSE
ENABLENEGJOBPRIORITY[1]           FALSE
ENABLEMULTINODEJOBS[1]            TRUE
ENABLEMULTIREQJOBS[1]             FALSE
BFPRIORITYPOLICY[1]               [NONE]
JOBPRIOACCRUALPOLICY            QUEUEPOLICY
NODELOADPOLICY                  ADJUSTSTATE
JOBNODEMATCHPOLICY[1]

JOBMAXSTARTTIME[1]                  INFINITY

METAMAXTASKS[1]                   0
NODESETPOLICY[1]                  [NONE]
NODESETATTRIBUTE[1]               [NONE]
NODESETLIST[1]
NODESETDELAY[1]                   00:00:00
NODESETPRIORITYTYPE[1]            MINLOSS
NODESETTOLERANCE[1]                 0.00

# Priority Weights

XFMINWCLIMIT[1]                   00:00:00

RMAUTHTYPE[0]                     CHECKSUM

CLASSCFG[[NONE]]  DEFAULT.FEATURES=[NONE]
CLASSCFG[[ALL]]  DEFAULT.FEATURES=[NONE]
CLASSCFG[rapida]  DEFAULT.FEATURES=[NONE]
CLASSCFG[default]  DEFAULT.FEATURES=[NONE]
QOSPRIORITY[0]                    0
QOSQTWEIGHT[0]                    0
QOSXFWEIGHT[0]                    0
QOSTARGETXF[0]                      0.00
QOSTARGETQT[0]                    00:00:00
QOSFLAGS[0]
QOSPRIORITY[1]                    0
QOSQTWEIGHT[1]                    0
QOSXFWEIGHT[1]                    0
QOSTARGETXF[1]                      0.00
QOSTARGETQT[1]                    00:00:00
QOSFLAGS[1]
# SERVER MODULES:  MX
SERVERMODE                      NORMAL
SERVERNAME
SERVERHOST                      bose.fisica.unlp.edu.ar
SERVERPORT                      42559
LOGFILE                         maui.log
LOGFILEMAXSIZE                  10000000
LOGFILEROLLDEPTH                1
LOGLEVEL                        3
LOGFACILITY                     fALL
SERVERHOMEDIR                   /opt/maui/
TOOLSDIR                        /opt/maui/tools/
LOGDIR                          /opt/maui/log/
STATDIR                         /opt/maui/stats/
LOCKFILE                        /opt/maui/maui.pid
SERVERCONFIGFILE                /opt/maui/maui.cfg
CHECKPOINTFILE                  /opt/maui/maui.ck
CHECKPOINTINTERVAL              00:05:00
CHECKPOINTEXPIRATIONTIME        3:11:20:00
TRAPJOB
TRAPNODE
TRAPFUNCTION
RESDEPTH                        24

RMPOLLINTERVAL                  00:00:30
NODEACCESSPOLICY                SHARED
ALLOCLOCALITYPOLICY             [NONE]
SIMTIMEPOLICY                   [NONE]
ADMIN1                          maui root
ADMINHOSTS                      ALL
NODEPOLLFREQUENCY               0
DISPLAYFLAGS
DEFAULTDOMAIN                   .local
DEFAULTCLASSLIST                [DEFAULT:1]
FEATURENODETYPEHEADER
FEATUREPROCSPEEDHEADER
FEATUREPARTITIONHEADER
DEFERTIME                       1:00:00
DEFERCOUNT                      24
DEFERSTARTCOUNT                 1
JOBPURGETIME                    0
NODEPURGETIME                   2140000000
APIFAILURETHRESHHOLD            6
NODESYNCTIME                    600
JOBSYNCTIME                     600
JOBMAXOVERRUN                   00:10:00
NODEMAXLOAD                     0.0

PLOTMINTIME                     120
PLOTMAXTIME                     245760
PLOTTIMESCALE                   11
PLOTMINPROC                     1
PLOTMAXPROC                     512
PLOTPROCSCALE                   9
SCHEDCFG[]                        MODE=NORMAL 
SERVER=bose.fisica.unlp.edu.ar:42559
# RM MODULES: PBS SSS WIKI NATIVE
RMCFG[base] AUTHTYPE=CHECKSUM EPORT=15004 TIMEOUT=00:00:09 TYPE=PBS
SIMWORKLOADTRACEFILE            workload
SIMRESOURCETRACEFILE            resource
SIMAUTOSHUTDOWN                 OFF
SIMSTARTTIME                    0
SIMSCALEJOBRUNTIME              FALSE
SIMFLAGS
SIMJOBSUBMISSIONPOLICY          CONSTANTJOBDEPTH
SIMINITIALQUEUEDEPTH            16
SIMWCACCURACY                   0.00
SIMWCACCURACYCHANGE             0.00
SIMNODECOUNT                    0
SIMNODECONFIGURATION            NORMAL
SIMWCSCALINGPERCENT             100
SIMCOMRATE                      0.10
SIMCOMTYPE                      ROUNDROBIN
COMINTRAFRAMECOST               0.30
COMINTERFRAMECOST               0.30
SIMSTOPITERATION                -1
SIMEXITITERATION                -1
-------------------------------------------------------

Thanks in advance
 -- Diego.


More information about the mauiusers mailing list