[Mauiusers] Maui not scheduling jobs correctly

Ian Miller ianm at uchicago.edu
Sun Oct 14 14:30:20 MDT 2012


To the list members,
Apologies to the list, my trackpad acted up and I fired off the email before I had put the whole file in.

-I




# maui.cfg 3.3.1
SERVERHOST            beast
# primary admin must be first in list
ADMIN1                root
# Resource Manager Definition
RMCFG[BEAST] TYPE=PBS
# Allocation Manager Definition
AMCFG[bank]  TYPE=NONE
# full parameter docs at http://supercluster.org/mauidocs/a.fparameters.html
# use the 'schedctl -l' command to display current configuration
RMPOLLINTERVAL        00:00:30
SERVERPORT            42559
SERVERMODE            NORMAL
# Admin: http://supercluster.org/mauidocs/a.esecurity.html
LOGFILE               maui.log
LOGFILEMAXSIZE        10000000
LOGLEVEL              3
# Job Priority: http://supercluster.org/mauidocs/5.1jobprioritization.html
QUEUETIMEWEIGHT       1
# FairShare: http://supercluster.org/mauidocs/6.3fairshare.html
#FSPOLICY              PSDEDICATED
#FSDEPTH               7
#FSINTERVAL            86400
#FSDECAY               0.80
# Throttling Policies: http://supercluster.org/mauidocs/6.2throttlingpolicies.html
# NONE SPECIFIED
# Backfill: http://supercluster.org/mauidocs/8.2backfill.html
BACKFILLPOLICY        FIRSTFIT
RESERVATIONPOLICY     CURRENTHIGHEST
# Node Allocation: http://supercluster.org/mauidocs/5.2nodeallocation.html
NODEALLOCATIONPOLICY PRIORITY
NODECFG[DEFAULT] PRIORITYF='0.01*AMEM - 2*LOAD'
NODEAVAILABILITYPOLICY COMBINED:MEM
SRCFG[Reinitz] HOSTLIST=minion1[2-9]
SRCFG[Reinitz] GROUPLIST=Reinitz
# QOS: http://supercluster.org/mauidocs/7.3qos.html
# QOSCFG[hi]  PRIORITY=100 XFTARGET=100 FLAGS=PREEMPTOR:IGNMAXJOB
# QOSCFG[low] PRIORITY=-1000 FLAGS=PREEMPTEE
# Standing Reservations: http://supercluster.org/mauidocs/7.1.3standingreservations.html
# SRSTARTTIME[test] 8:00:00
# SRENDTIME[test]   17:00:00
# SRDAYS[test]      MON TUE WED THU FRI
# SRTASKCOUNT[test] 20
# SRMAXTIME[test]   0:30:00
# Creds: http://supercluster.org/mauidocs/6.1fairnessoverview.html
# USERCFG[DEFAULT]      FSTARGET=25.0
# USERCFG[john]         PRIORITY=100  FSTARGET=10.0-
# GROUPCFG[staff]       PRIORITY=1000 QLIST=hi:low QDEF=hi
# CLASSCFG[batch]       FLAGS=PREEMPTEE
# CLASSCFG[interactive] FLAGS=PREEMPTOR
Ian Miller
Research Computing Administrator
ianm at uchicago.edu
(312) 402-6170


From: Ian Miller <ianm at uchicago.edu<mailto:ianm at uchicago.edu>>
Date: Sunday, October 14, 2012 12:29 PM
To: "mauiusers at supercluster.org<mailto:mauiusers at supercluster.org>" <mauiusers at supercluster.org<mailto:mauiusers at supercluster.org>>
Subject: Re: [Mauiusers] Maui not scheduling jobs correctly



From: "James A. Peltier" <jpeltier at sfu.ca<mailto:jpeltier at sfu.ca>>
Date: Saturday, October 13, 2012 12:57 PM
To: "mauiusers at supercluster.org<mailto:mauiusers at supercluster.org>" <mauiusers at supercluster.org<mailto:mauiusers at supercluster.org>>
Subject: Re: [Mauiusers] Maui not scheduling jobs correctly


________________________________
Maui Users,
I have a 36 Node systems with 8 to 12 cores in each node and have users submit up to 1000 jobs at a time.  The issue is that the cluster will only run about 90 of them at a time with 85 out of the 344 processors active and only 12 of the nodes being used.  The jobs are all going to the default queue and there are no node or cpu/memory parameters added to the submissions.
Each job runs for about 20 min.

Any ideas on how to get maui to schedule more jobs to the nodes?
Torque 2.5.7
Maui 3.3.1


Ian Miller
Research Computing Administrator
ianm at uchicago.edu<mailto:ianm at uchicago.edu>
(312) 402-6170

It may help to post your maui.cfg file
--
James A. Peltier
Manager, IT Services - Research Computing Group
Simon Fraser University - Burnaby Campus
Phone   : 778-782-6573
Fax     : 778-782-3045
E-Mail  : jpeltier at sfu.ca<mailto:jpeltier at sfu.ca>
Website : http://www.sfu.ca/itservices
          http://blogs.sfu.ca/people/jpeltier




As requested.
Maui.cfg


# NONE SPECIFIED

# Backfill: http://supercluster.org/mauidocs/8.2backfill.html

BACKFILLPOLICY        FIRSTFIT
RESERVATIONPOLICY     CURRENTHIGHEST

# Node Allocation: http://supercluster.org/mauidocs/5.2nodeallocation.html

NODEALLOCATIONPOLICY PRIORITY
NODECFG[DEFAULT] PRIORITYF='0.01*AMEM - 2*LOAD'
NODEAVAILABILITYPOLICY COMBINED:MEM

SRCFG[Reinitz] HOSTLIST=minion1[2-9]
SRCFG[Reinitz] GROUPLIST=Reinitz

# QOS: http://supercluster.org/mauidocs/7.3qos.html

# QOSCFG[hi]  PRIORITY=100 XFTARGET=100 FLAGS=PREEMPTOR:IGNMAXJOB
# QOSCFG[low] PRIORITY=-1000 FLAGS=PREEMPTEE

# Standing Reservations: http://supercluster.org/mauidocs/7.1.3standingreservations.html

# SRSTARTTIME[test] 8:00:00
# SRENDTIME[test]   17:00:00
# SRDAYS[test]      MON TUE WED THU FRI
# SRTASKCOUNT[test] 20
# SRMAXTIME[test]   0:30:00

# Creds: http://supercluster.org/mauidocs/6.1fairnessoverview.html

# USERCFG[DEFAULT]      FSTARGET=25.0
# USERCFG[john]         PRIORITY=100  FSTARGET=10.0-
# GROUPCFG[staff]       PRIORITY=1000 QLIST=hi:low QDEF=hi
# CLASSCFG[batch]       FLAGS=PREEMPTEE
# CLASSCFG[interactive] FLAGS=PREEMPTOR


-




Ian Miller
Ianm at uchicago.edu<mailto:Ianm at uchicago.edu>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://www.supercluster.org/pipermail/mauiusers/attachments/20121014/5e266f3d/attachment-0001.html 


More information about the mauiusers mailing list