Appendix F: Scheduler Parameters
Moab Workload Manager®

Appendix F:  Moab Parameters

See the Parameters Overview in the Moab Admin Manual for further information about specifying parameters.

Index: A B C D E F G H I J K L M N O P Q R S T U V W X Y Z

           

PARAMETER

ADMINHOSTS
FORMATspace delimited list of host names
DEFAULT---
DETAILSIf specified, the ADMINHOSTS parameter allows a site to specify a subset of trusted hosts. All administrative commands (level 1-3) will be rejected unless they are received from one of the hosts listed.
EXAMPLE
moab.cfg
ADMINHOSTS hostA hostB


PARAMETER

ACCOUNTCFG[<ACCOUNTID>]
FORMATlist of zero or more space delimited <ATTR>=<VALUE> pairs where <ATTR> is one of the following:
General Credential Flags, CHARGERATE, PRIORITY, ENABLEPROFILING, FSCAP, FSTARGET, JOBFLAGS, MANAGER, MEMBERULIST, PDEF, PLIST, QDEF, QLIST, or a fairness policy specification.
DEFAULT---
DETAILSspecifies account specific attributes.  See the account overview for general information and the job flag overview for a description of legal flag values.
EXAMPLE
moab.cfg
ACCOUNTCFG[projectX] MAXJOB=50 QDEF=highprio 

up to 50 jobs submitted under the account ID projectX will be allowed to execute simultaneously and will be assigned the QOS highprio by default.


PARAMETER

ACCOUNTINGINTERFACEURL
FORMAT<URL> where protocol can be one of exec, file, or sql
DEFAULT---
DETAILSspecifies the interface to use for real-time export of Moab accounting/auditing information.  See Exporting Events in Real-Time for more information.
EXAMPLE
moab.cfg
ACCOUNTINGINTERFACEURL exec:///$TOOLSDIR/dumpacc.pl


PARAMETER

ACCOUNTWEIGHT
FORMAT<INTEGER>
DEFAULT1
DETAILSspecifies the priority weight to be applied to the specified account priority.  (See Credential (CRED) Factor)
EXAMPLE
moab.cfg
ACCOUNTWEIGHT 100


PARAMETER

ADMINCFG[X]
FORMATone or more <ATTR>=<VALUE> pairs where <ATTR> is one of the following: ENABLEPROXY, USERS, SERVICES, or NAME
DEFAULT---
DETAILSallows a site to configure which services and users belong to a particular level of administration.  NOTE: The first user listed in the ADMINCFG[1] users list is considered to be the 'primary admin'
EXAMPLE
moab.cfg
ADMINCFG[1] USERS=root,john 
ADMINCFG[1] SERVICES=ALL 
ADMINCFG[1] NAME=batchadmin

ADMINCFG[3] USERS=bob,carol,smoore 
ADMINCFG[3] SERVICES=mjobctl:cancel:adjustprio:adjusthold,mcredctl,runjob
ADMINCFG[3] NAME=helpdesk
Members of the batchadmin admin role are allowed to run all commands.  Members of the helpdesk role are allowed to cancel jobs, adjust job priority, and adjust job holds.  They are also able to view and modify credential objects (ie, users, groups, accounts, etc)  See the security overview for more details.

PARAMETER

ADMIN1, ADMIN2, ADMIN3
FORMATspace delimited list of user names
DEFAULTroot
DETAILSDeprecated. Use ADMINCFG. Users listed under the parameter ADMIN1 are allowed to perform any scheduling function.  They have full control over the scheduler and access to all data.  The first user listed in the ADMIN1 user list is considered to be the 'primary admin' and is the ID under which Moab must be started and run.   Valid values include user names or the keyword 'ALL'. Again, these parameters are deprecated; use ADMINCFG.
EXAMPLE
moab.cfg
ADMIN1 moabuser steve scott jenny
all users listed have full access to Moab control commands and Moab data.  Moab must be started by and run under the 'moabuser' user id since moabuser is the primary admin.


PARAMETER

ALLOWROOTJOBS
FORMAT<BOOLEAN>
DEFAULTFALSE
DETAILSspecifies whether batch jobs from the root user (UID=0) are allowed to be execute (NOTE: the resource manager must also support root jobs).
EXAMPLE
moab.cfg
ALLOWROOTJOBS	TRUE

jobs from the root user can execute.


PARAMETER

AMCFG
FORMATone or more key-value pairs as described in the Allocation Manager Configuration Overview
DEFAULTN/A
DETAILSspecifies the interface and policy configuration for the scheduler-allocation manager interface.  Described in detail in the Allocation Manager Configuration Overview
EXAMPLE
moab.cfg
AMCFG[bank] SERVER=gold://master.ufl.edu JOBFAILUREACTION=IGNORE TIMEOUT=15

PARAMETER

APPLICATIONLIST
FORMATspace delimited list of generic resources
DEFAULTN/A
DETAILSspecifies which generic resources represent actual applications on the cluster/grid. (See 12.4 - Consumable Generic Resources for more information.)
EXAMPLE
moab.cfg
NODECFG[node01] GRES=calclab:1,powerhouse:1 RCSOFTWARE=calclab:1,powerhouse:1
NODECFG[node02] GRES=calclab:1,powerhouse:1 RCSOFTWARE=calclab:1,powerhouse:1
APPLICATIONLIST calclab,powerhouse

the generic resources 'calclab' and 'powerhouse' will now be recognized and treated as application software


PARAMETER

ATTRATTRWEIGHT
FORMAT<INTEGER>
DEFAULT0
DETAILSspecifies the priority weight to be applied to jobs with the specified job attribute.  (See Attribute (ATTR) Factor)
EXAMPLE
moab.cfg
ATTRATTRWEIGHT 100

PARAMETER

ATTRGRESWEIGHT
FORMAT<INTEGER>
DEFAULT0
DETAILSspecifies the priority weight to be applied to jobs requesting the specified generic resource. (See Attribute (ATTR) Factor)
EXAMPLE
moab.cfg
ATTRGRESWEIGHT 200

PARAMETER

ATTRSTATEWEIGHT
FORMAT<INTEGER>
DEFAULT0
DETAILSspecifies the priority weight to be applied to jobs with the specified job state. (See Attribute (ATTR) Factor)
EXAMPLE
moab.cfg
ATTRSTATEWEIGHT 200

PARAMETER

ATTRWEIGHT
FORMAT<INTEGER>
DEFAULT1
DETAILSspecifies the priority component weight to be applied to the ATTR subcomponents. (See Attribute (ATTR) Factor)
EXAMPLE
moab.cfg
ATTRWEIGHT      2
ATTRSTATEWEIGHT 200

PARAMETER

BACKFILLDEPTH
FORMAT<INTEGER>
DEFAULT0 (no limit)
DETAILSspecifies the number idle jobs to evaluate for backfill.  The backfill algorithm will evaluate the top <X> priority jobs for scheduling.  By default, all jobs are evaluated.
EXAMPLE
moab.cfg
BACKFILLDEPTH 128
evaluate only the top 128 highest priority idle jobs for consideration for backfill

PARAMETER

BACKFILLMETRIC
FORMATone of the following PROCS, PROCSECONDS, SECONDS, or NODES
DEFAULTPROCS
DETAILSspecifies the criteria used by the backfill algorithm to determine the 'best' jobs to backfill.  Only applicable when using BESTFIT or GREEDY backfill algorithms
EXAMPLE
moab.cfg
BACKFILLMETRIC PROCSECONDS

PARAMETER

BACKFILLPOLICY
FORMATone of the following: FIRSTFIT, BESTFIT, GREEDY, OPTIMISTIC, PREEMPT, or NONE
DEFAULTFIRSTFIT
DETAILSspecifies what backfill algorithm will be used.  See Configuring Backfill for more information.
EXAMPLE
moab.cfg
BACKFILLPOLICY  BESTFIT

PARAMETER

BFCHUNKDURATION
FORMAT[[[DD:]HH:]MM:]SS
DEFAULT0 (chunking disabled)
DETAILSspecifies the duration during which freed resources will be aggregated for use by larger jobs.  Used in conjunction with BFCHUNKSIZE.  See Configuring Backfill for more information.
EXAMPLE
moab.cfg
BFCHUNKDURATION 00:05:00
BFCHUNKSIZE     4
aggregate backfillable resources for up to 5 minutes, making resources available only to jobs of size 4 or larger

PARAMETER

BFCHUNKSIZE
FORMAT<INTEGER>
DEFAULT0 (chunking disabled)
DETAILSspecifies the minimum job size which can utilize chunked resources.  Used in conjunction with BFCHUNKDURATION.  See Configuring Backfill for more information
EXAMPLE
moab.cfg
BFCHUNKDURATION 00:05:00
BFCHUNKSIZE     4
aggregate backfillable resources for up to 5 minutes, making resources available only to jobs of size 4 or larger

PARAMETER

BFPRIORITYPOLICY
FORMATone of RANDOM, DURATION, or HWDURATION
DEFAULT---
DETAILSspecifies policy to use when prioritizing backfill jobs for preemption
EXAMPLE
moab.cfg
BFPRIORITYPOLICY  DURATION

use length of job in determining which backfill job to preempt


PARAMETER

BFMINVIRTUALWALLTIME
FORMAT[[[DD:]HH:]MM:]SS
DEFAULT---
DETAILSspecifies the minimum job wallclock time for virtual scaling (optimistic-like backfilling.) Any job with a wallclock time less than this setting will not be virtually scaled.
EXAMPLE
moab.cfg
BFMINVIRTUALWALLTIME  00:01:30

PARAMETER

BFVIRTUALWALLTIMECONFLICTPOLICY
FORMATone of the following: PREEMPT
DEFAULT---
DETAILSspecifies how to handle scheduling conflicts when a virtually scaled job "expands" to its original wallclock time (this occurs when the job is within one scheduling iteration - RMPOLLINTERVAL - of its virtually scaled wallclock time expiring.)
EXAMPLE
moab.cfg
BFVIRTUALWALLTIMECONFLICTPOLICY  PREEMPT 

PARAMETER

BFVIRTUALWALLTIMESCALINGFACTOR
FORMAT<DOUBLE>
DEFAULT0 (virtual scaling disabled)
DETAILSspecifies the factor by which eligible jobs' wallclock time is virtually scaled (optimistic-like backfilling.)
EXAMPLE
moab.cfg
BFVIRTUALWALLTIMESCALINGFACTOR .4 

PARAMETER

BLOCKLIST
FORMATDEPEND
DEFAULTNONE
DETAILSspecifies the additional non-default criteria which are used to determine if a job should be filtered out before idle usage is updated and idle usage policies are enforced
EXAMPLE
moab.cfg
BLOCKLIST DEPEND

PARAMETER

BYPASSCAP
FORMAT<INTEGER>
DEFAULT0
DETAILSspecifies the max weighted value allowed from the bypass count subfactor when determining a job's priority (see Priority Factors for more information)
EXAMPLE
moab.cfg
BYPASSWEIGHT 5000
BYPASSCAP    30000

PARAMETER

BYPASSWEIGHT
FORMAT<INTEGER>
DEFAULT0
DETAILSspecifies the weight to be applied to a job's backfill bypass count when determining a job's priority (see Priority Factors for more information)
EXAMPLE
moab.cfg
BYPASSWEIGHT 5000

PARAMETER

CHECKPOINTEXPIRATIONTIME
FORMAT[[[DD:]HH:]MM:]SS
DEFAULTINFINITY
DETAILSspecifies how 'stale' checkpoint data can be before it is ignored and purged.
EXAMPLE
moab.cfg
CHECKPOINTEXPIRATIONTIME 1:00:00:00

Expire checkpoint data which has been stale for over one day


PARAMETER

CHECKPOINTFILE
FORMAT<STRING>
DEFAULTmoab.ck
DETAILSname (absolute or relative) of the Moab checkpoint file.
EXAMPLE
moab.cfg
CHECKPOINTFILE /var/adm/moab/moab.ck 
Maintain the Moab checkpoint file in the file specified

PARAMETER

CHECKPOINTINTERVAL
FORMAT[[[DD:]HH:]MM:]SS
DEFAULT00:05:00
DETAILStime between automatic Moab checkpoints
EXAMPLE
moab.cfg
CHECKPOINTINTERVAL 00:15:00
Moab should checkpoint state information every 15 minutes

PARAMETER

CLASSCFG[<CLASSID>]
FORMATlist of zero or more space delimited <ATTR>=<VALUE> pairs where <ATTR> is one of the following:
General Credential Flags, DEFAULT.ATTR, DEFAULT.DISK, DEFAULT.FEATURES, DEFAULT.GRES, DEFAULT.MEM, DEFAULT.NODESET, DEFAULT.PROC, ENABLEPROFILING EXCL.FEATURES, EXCLUDEUSERLIST, JOBFLAGS, HOSTLIST, JOBEPILOG, JOBPROLOG, JOBTRIGGER, MANAGERS, MAXJOB, MAXPROCPERNODE, MAX.NODE, MAX.PROC, MAX.WCLIMIT, MIN.FEATURES, MIN.NODE, MIN.PROC, MIN.TPN, MIN.WCLIMIT, PARTITION, PRIORITY, PRIORITYF, QDEF, QLIST, REQ.FEATURES, REQUIREDUSERLIST, RESFAILPOLICY, SYSPRIO, WCOVERRUN or a usage limit or fairshare policy specification
DEFAULT---
DETAILSspecifies class specific attributes (see Credential Overview for details)
EXAMPLE
moab.cfg
CLASSCFG[batch] MAXJOB=50 QDEF=highprio
Up to 50 jobs submitted to the class batch will be allowed to execute simultaneously and will be assigned the QOS highprio by default.

PARAMETER

CLASSWEIGHT
FORMAT<INTEGER>
DEFAULT1
DETAILSspecifies the weight to be applied to the class priority of each job (See Credential (CRED) Factor and credential priority)
EXAMPLE
moab.cfg
CLASSWEIGHT 10

PARAMETER

CLIENTCFG[<X>]
FORMATone or more of <ATTR>-<VALUE> pairs where <X> indicates the specified peer and <ATTR> is one of the following: AUTH, AUTHCMD, AUTHTYPE, HOST, KEY, or DEFAULTSUBMITPARTITION
DEFAULT---
DETAILSspecifies the shared secret key and authentication method which Moab will use to communicate with the named peer daemon.  See Security Overview for more information.  NOTE: The AUTHTYPE and KEY attributes of this parameter may only be specified in the moab-private.cfg config file
EXAMPLE
moab-private.cfg
CLIENTCFG[silverB]  KEY=apple7 AUTH=admin1
Moab will use the session key apple7 for peer authentication and for encrypting and decrypting messages sent from silverB.  Also, client connections from this interface will be authorized at an admin 1 level

PARAMETER

CLIENTMAXPRIMARYRETRY
FORMAT<integer> or INFINITY
DEFAULT1
DETAILSspecifies how many times the client will attempt to retry its connection to the primary server if moab is not available.
EXAMPLE
moab.cfg
CLIENTMAXPRIMARYRETRY 5
CLIENTMAXPRIMARYRETRYTIMEOUT 1000
The client will attempt to retry its connection to the primary server 5 times with 1 second intervals before giving up.
NOTE: If INFINITY is specified, moab will attempt 2140000000 times.

PARAMETER

CLIENTMAXPRIMARYRETRYTIMEOUT
FORMAT<integer> (milliseconds)
DEFAULT2 seconds
DETAILSspecifies how much time to wait until the client will attempt to retry its connection to the primary server if moab is not available.
EXAMPLE
moab.cfg
CLIENTMAXPRIMARYRETRY 3
CLIENTMAXPRIMARYRETRYTIMEOUT 500
The client will attempt to retry its connection to the primary server 3 times with 1/2 second intervals before giving up.

PARAMETER

CLIENTTIMEOUT
FORMAT[[[DD:]HH:]MM:]SS
DEFAULT00:00:30
DETAILStime which Moab client commands will wait for a response from the Moab server   See Client Configuration for more information.  (NOTE: may also be specified as an environment variable)
EXAMPLE
moab.cfg
CLIENTTIMEOUT 00:15:00

Moab clients will wait up to 15 minutes for a response from the server before timing out


PARAMETER

CREDDISCOVERY
FORMATTRUE
DEFAULTFALSE
DETAILSSpecifies that Moab should create otherwise unknown credentials when it discovers them in the statistics files.
EXAMPLE
moab.cfg
CREDDISCOVERY TRUE

PARAMETER

CREDWEIGHT
FORMAT<INTEGER>
DEFAULT1
DETAILSSpecifies the credential component weight associated with the credential priority.  See Credential (CRED) Factor for more information.
EXAMPLE
moab.cfg
CREDWEIGHT 2

PARAMETER

DEADLINEPOLICY
FORMATone of CANCEL ESCALATE, HOLD, IGNORE, or RETRY
DEFAULTHOLD
DETAILSspecifies what to do when a requested deadline cannot be reached (See Job Deadlines)
EXAMPLE
moab.cfg
DEADLINEPOLICY  IGNORE

PARAMETER

DEFAULTCLASSLIST
FORMATspace delimited list of one or more <STRING>'s
DEFAULT---
DETAILSspecifies the default classes supported on each node for RM systems which do not provide this information
EXAMPLE
moab.cfg
DEFAULTCLASSLIST serial parallel

PARAMETER

DEFAULTSUBMITLANGUAGE
FORMATone of LSF, PBS, LL or SLURM
DEFAULTPBS
DETAILSspecifies the default job language to use when interpreting commandline arguments and command file scripts associated with the msub command.
EXAMPLE
moab.cfg
DEFAULTSUBMITLANGUAGE LSF

PARAMETER

DEFAULTSUBMITPARTITION
FORMATsee parameter CLIENTCFG[]
DEFAULT---
DETAILSIf a user submits a job using msub which does not specify host, feature, or partition constraints, then the msub client will insert the specified default submit partition into the newly submitted job as a hard requirement.
EXAMPLE
moab.cfg
CLIENTCFG[DEFAULT] DEFAULTSUBMITPARTITION=partition1 

PARAMETER

DEFERCOUNT
FORMAT<INTEGER>
DEFAULT24
DETAILSspecifies the number of times a job can be deferred before it will be placed in batch hold.
EXAMPLE
moab.cfg
DEFERCOUNT 12

PARAMETER

DEFERSTARTCOUNT
FORMAT<INTEGER>
DEFAULT1
DETAILSspecifies the number of times a job will be allowed to fail in its start attempts before being deferred.  NOTE: A job's startcount will increase each time a start request is made to the resource manager regardless of whether or not this request succeeded.  This means start count increases if job starts fail or if jobs are started and then rejected by the resource manager.
EXAMPLE
moab.cfg
DEFERSTARTCOUNT 3

PARAMETER

DEFERTIME
FORMAT[[[DD:]HH:]MM:]SS
DEFAULT1:00:00
DETAILSspecifies the amount of time a job will be held in the deferred state before being released back to the Idle job queue  NOTE: A job's defer time will be restarted if Moab is restarted.
EXAMPLE
moab.cfg
DEFERTIME 0:05:00

PARAMETER

DELETESTAGEOUTFILES
FORMATTRUE
DEFAULTFALSE
DETAILSspecifies whether the scheduler should delete explicitly specified stageout files after they are successfully staged. By default, such files are not deleted but are left on the nodes where the job ran.
EXAMPLE
moab.cfg
DELETESTAGEOUTFILES TRUE

Example of an explicit stageout request

msub x=MSTAGEOUT:ssh://source_node/tmp/file,file:///results_folder
job.cmd

With this parameter set to true, /tmp/file on source_node is deleted after it is copied to the specified destination (file:///results_folder). If the parameter is not set, or if it is set to false, /tmp/file remains on source_node after the job terminates.


PARAMETER

DIRECTORYSERVER
FORMAT<HOST>[:<PORT>]
DEFAULT---
DETAILSspecifies the interface for the directory server
EXAMPLE
moab.cfg
DIRECTORYSERVER calli3.icluster.org:4702

PARAMETER

DISABLESAMEQOSPREEMPTION
FORMAT<BOOLEAN>
DEFAULTFALSE
DETAILSspecifies whether or not a preemptor job can preempt a preemptee job which possesses the same QoS.
EXAMPLE
moab.cfg
DISABLESAMEQOSPREEMPTION TRUE

PARAMETER

DISABLESCHEDULING
FORMAT<BOOLEAN>
DEFAULTFALSE
DETAILSspecifies whether or not the scheduler will schedule jobs.  If set to TRUE, Moab will continue to update node and job state but will not start, preempt, or otherwise modify jobs.  The command mschedctl -r will clear this parameter and resume normal scheduling.
EXAMPLE
moab.cfg
DISABLESCHEDULING FALSE

PARAMETER

DISABLESLAVEJOBSUBMIT
FORMAT<BOOLEAN>
DEFAULTTRUE
DETAILSThis parameter can be added to the moab.cfg file on a slave Moab server (in a grid configuration) to prevent users from submitting jobs to the master Moab server from the slave Moab server. Some grid configurations allow the user to submit jobs on the slave that are migrated to the master and submitted from the master. Other grid configurations do not allow the jobs to be migrated to the master from the slave, in which case, jobs submitted from the slave remain idle on the slave and never run. This parameter will reject the job submissions on the slave to prevent the submission of jobs that will never run.
EXAMPLE
moab.cfg
DISABLESLAVEJOBSUBMIT TRUE

example (node04 is a slave and node06 is the master)

[test@node04 moab-slurm]$ echo sleep 100 | msub
ERROR:    cannot submit job from slave

PARAMETER

DISKWEIGHT
FORMAT<INTEGER>
DEFAULT0
DETAILSspecifies the priority weight to be applied to the amount of dedicated disk space required per task by a job (in MB)
EXAMPLE
moab.cfg
RESWEIGHT  10
DISKWEIGHT 100 

if a job requires 12 tasks and 512 MB per task of dedicated local disk space, Moab will increase the job's priority by 10 * 100 * 12 * 512


PARAMETER

DISPLAYFLAGS
FORMATone or more of the following values (space delimited)

ACCOUNTCENTRIC, HIDEBLOCKED, or NODECENTRIC

DEFAULT---
DETAILSspecifies flags which control how Moab client commands will display various information.
ACCOUNTCENTRIC will display account information in showq, rather than group information
HIDEBLOCKED will prevent showq from listing information about blocked jobs which are not owned by the user if the user is not an admin
NODECENTRIC will display node allocation information instead of processor allocation information in showq
EXAMPLE
moab.cfg
DISPLAYFLAGS NODECENTRIC

PARAMETER

ENABLEFSVIOLATIONPREEMPTION
FORMAT<BOOLEAN>
DEFAULTFALSE
DETAILSif set to TRUE, Moab will allow jobs within the same class/queue to preempt when the preemptee is violating a fairshare target and the preemptor is not.
EXAMPLE
moab.cfg
ENABLEFSVIOLATIONPREEMPTION TRUE

PARAMETER

EMULATIONMODE
FORMAT{ SLURM }
DEFAULT---
DETAILSspecifies whether or not the scheduler will preform the automatic setup of a particular resource manager environment
EXAMPLE
moab.cfg
EMULATIONMODE SLURM

Moab will perform the automated setup steps as if it were interfacing with a slurm resource manager (automatic QOS creation).


PARAMETER

ENABLEMULTINODEJOBS
FORMAT<BOOLEAN>
DEFAULTTRUE
DETAILSspecifies whether or not the scheduler will allow jobs to span more than one node
EXAMPLE
moab.cfg
ENABLEMULTINODEJOBS FALSE

PARAMETER

ENABLEMULTIREQJOBS
FORMAT<BOOLEAN>
DEFAULTFALSE
DETAILSspecifies whether or not the scheduler will allow jobs to specify multiple independent resource requests (i.e., PBS jobs with resource specifications such as '-l nodes=3:fast+1:io')
EXAMPLE
moab.cfg
ENABLEMULTIREQJOBS TRUE

PARAMETER

ENABLENEGJOBPRIORITY
FORMAT<BOOLEAN>
DEFAULTFALSE
DETAILSif set to TRUE, the scheduler allows job priority value to range from -INFINITY to MMAX_PRIO; otherwise, job priority values are given a lower bound of '1'. (For more information, see REJECTNEGPRIOJOBS.)
EXAMPLE
moab.cfg
ENABLENEGJOBPRIORITY TRUE

Job priority may range from -INFINITY to MMAX_PRIO.


PARAMETER

ENABLENODEADDRLOOKUP
FORMAT<BOOLEAN>
DEFAULTFALSE
DETAILSif set to TRUE, the scheduler will use the default host name service lookup mechanism (i.e., /etc/hosts, DNS, NIS, etc) to determine the IP address of the nodes reported by the resource manager.  This information is used to correlate information reported by multi-homed hosts.
EXAMPLE
moab.cfg
ENABLENODEADDRLOOKUP TRUE

PARAMETER

ENABLEPOSUSERPRIORITY
FORMAT<BOOLEAN>
DEFAULTFALSE
DETAILSif set to TRUE, the scheduler will allow users to specify positive job priority values which will be honored. In other words, users can specify a priority that falls in the range of -1024 to +1023, inclusive. If set to FALSE (the default), user priority values are given an upper bound of '0' when users request a positive priority.
EXAMPLE
moab.cfg
ENABLEPOSUSERPRIORITY TRUE

Users may now specify positive job priorities and have them take effect (e.g. msub -p 100 job.cmd).


PARAMETER

ENABLESPVIOLATIONPREEMPTION
FORMAT<BOOLEAN>
DEFAULTFALSE
DETAILSif set to TRUE, Moab will allow jobs within the same class/queue to preempt when the preemptee is violating a soft usage policy and the preemptor is not.
EXAMPLE
moab.cfg
ENABLESPVIOLATIONPREEMPTION TRUE

PARAMETER

ENABLESTARTESTIMATESTATS
FORMAT<BOOLEAN>
DEFAULTFALSE
DETAILSif set to TRUE, Moab will collect job start time estimation stats for all submitted jobs and will use those statistics to improve future estimates.  Resource availability queries which can utilize this info can be made using the showstart command.  Current estimation statistics can be viewed using the mdiag -S command.  To flush current statistics, use the mschedctl -f command.  NOTE: This parameter can be resource intensive so sites with large job queues (>10,000 jobs) may want to consider leaving this set to FALSE, see Considerations for Large Clusters for more details.
EXAMPLE
moab.cfg
ENABLESTARTTIMEESTIMATESTATS TRUE

PARAMETER

ENFORCEACCOUNTACCESS
FORMAT<BOOLEAN>
DEFAULTFALSE
DETAILSspecifies whether or not Moab will enforce account access constraints without an allocation manager.
EXAMPLE
moab.cfg
ENFORCEACCOUNTACCESS TRUE

PARAMETER

ENFORCEINTERNALCHARGING
FORMAT<BOOLEAN>
DEFAULTFALSE
DETAILSspecifies whether or not the scheduler will enforce internal credit tracking (see Internal Charging).
EXAMPLE
moab.cfg
ENFORCEINTERNALCHARGING TRUE

PARAMETER

EVENTSERVER
FORMAT<HOST>[:<PORT>]
DEFAULT---
DETAILSspecifies the interface for the event server
EXAMPLE
moab.cfg
EVENTSERVER   calli3.icluster.org:4702

PARAMETER

FEATURENODETYPEHEADER
FORMAT<STRING>
DEFAULT---
DETAILSspecifies the header used to specify node type via node features (ie, LL features or PBS node attributes).
EXAMPLE
moab.cfg
FEATURENODETYPEHEADER xnt

Moab will interpret all node features with the leading string xnt as a nodetype specification - as used by Gold and other allocation managers, and assign the associated value to the node. i.e., xntFast


PARAMETER

FEATUREPARTITIONHEADER
FORMAT<STRING>
DEFAULT---
DETAILSspecifies the header used to specify node partition via node features (ie, LL features or PBS node attributes).
EXAMPLE
moab.cfg
FEATUREPARTITIONHEADER xpt

Moab will interpret all node features with the leading string xpt as a partition specification and assign the associated value to the node. i.e., xptGold


PARAMETER

FEATUREPROCSPEEDHEADER
FORMAT<STRING>
DEFAULT---
DETAILSspecifies the header used to extract node processor speed via node features (i.e., LL features or PBS node attributes).  NOTE: Adding a trailing '$' character will specifies that only features with a trailing number be interpreted.  For example, the header 'sp$' will match 'sp450' but not 'sport'
EXAMPLE
moab.cfg
FEATUREPROCSPEEDHEADER xps

Moab will interpret all node features with the leading string xps as a processor speed specification and assign the associated value to the node. i.e., xps950


PARAMETER

FEATURERACKHEADER
FORMAT<STRING>
DEFAULT---
DETAILSspecifies the header used to extract node rack index via node features (i.e., LL features or PBS node attributes).  NOTE: Adding a trailing '$' character will specifies that only features with a trailing number be interpreted.  For example, the header 'rack$' will match 'rack4' but not 'racket'
EXAMPLE
moab.cfg
FEATURERACKHEADER rack

Moab will interpret all node features with the leading string rack as a rack index specification and assign the associated value to the node. i.e., rack16


PARAMETER

FEATURESLOTHEADER
FORMAT<STRING>
DEFAULT---
DETAILSspecifies the header used to extract node slot index via node features (i.e., LL features or PBS node attributes).  NOTE: Adding a trailing '$' character will specifies that only features with a trailing number be interpreted.  For example, the header 'slot$' will match 'slot12' but not 'slotted'
EXAMPLE
moab.cfg
FEATURESLOTHEADER slot

Moab will interpret all node features with the leading string slot as a slot index specification and assign the associated value to the node. i.e., slot16


PARAMETER

FEEDBACKPROGRAM
FORMAT<STRING>
DEFAULT---
DETAILSspecifies the name of the program to be run at the completion of each job.  If not fully qualified, Moab will attempt to locate this program in the 'tools' subdirectory.
EXAMPLE
moab.cfg
FEEDBACKPROGRAM /var/moab/fb.pl

Moab will run the specified program at the completion of each job.


PARAMETER

FILEREQUESTISJOBCENTRIC
FORMAT<BOOLEAN>
DEFAULTFALSE
DETAILSspecifies whether a job's file request is a total request for the job or a per task request
EXAMPLE
moab.cfg
FILEREQUESTISJOBCENTRIC TRUE

Moab will treat file requests as a total request per job


PARAMETER

FORCERSVSUBTYPE
FORMAT<BOOLEAN>
DEFAULTFALSE
DETAILSspecifies that admin reservations must have a subtype associated with them
EXAMPLE
moab.cfg
FORCERSVSUBTYPE TRUE

Moab will require all admin reservations to include a subtype


PARAMETER

FSACCOUNTWEIGHT
FORMAT<INTEGER>
DEFAULT0
DETAILSspecifies the weight assigned to the account subcomponent of the fairshare component of priority
EXAMPLE
moab.cfg
FSACCOUNTWEIGHT 10

PARAMETER

FSCAP
FORMAT<DOUBLE>
DEFAULT0 (NO CAP)
DETAILSspecifies the maximum allowed absolute value for a job's total pre-weighted fairshare component
EXAMPLE
moab.cfg
FSCAP 10.0

Moab will bound a job's pre-weighted fairshare component by the range +/- 10.0


PARAMETER

FSCLASSWEIGHT
FORMAT<INTEGER>
DEFAULT0
DETAILSspecifies the weight assigned to the class subcomponent of the fairshare component of priority
EXAMPLE
moab.cfg
FSCLASSWEIGHT 10

PARAMETER

FSDECAY
FORMAT<DOUBLE>
DEFAULT1.0
DETAILSspecifies decay rate applied to past fairshare interval when computing effective fairshare usage.  Values may be in the range of 0.01 to 1.0.  A smaller value causes more rapid decay causing aged usage to contribute less to the overall effective fairshare usage.  A value of 1.0 indicates that no decay will occur and all fairshare intervals will be weighted equally when determining effective fairshare usage.  (See Fairshare Overview)
EXAMPLE
moab.cfg
FSPOLICY   DEDICATEDPS
FSDECAY    0.8
FSDEPTH    8
Moab will apply a decay rate of 0.8 to all fairshare windows


PARAMETER

FSDEPTH
FORMAT<INTEGER>
DEFAULT8
DETAILSNOTE: The number of available fairshare windows is bounded by the MAX_FSDEPTH value (32 in Moab).  See Fairshare Overview
EXAMPLE
moab.cfg FSDEPTH 12

PARAMETER

FSENABLECAPPRIORITY
FORMATBoolean
DEFAULTFALSE
DETAILSfairshare priority will increase to target and stop
EXAMPLE
moab.cfg FSENABLECAPPRIORITY TRUE

PARAMETER

FSGROUPWEIGHT
FORMAT<INTEGER>
DEFAULT0
DETAILS 
EXAMPLE
moab.cfg FSGROUPWEIGHT 4

PARAMETER

FSINTERVAL
FORMAT[[[DD:]HH:]MM:]SS
DEFAULT12:00:00
DETAILSspecifies the length of each fairshare window
EXAMPLE
moab.cfg
FSINTERVAL 12:00:00
track fairshare usage in 12 hour blocks

PARAMETER

FSJPUWEIGHT
FORMAT<INTEGER>
DEFAULT0
DETAILSspecifies the fairshare weight assigned to jobs per user
EXAMPLE
moab.cfg
FSJPUWEIGHT 10

PARAMETER

FSPOLICY
FORMAT<POLICY>[*] where <POLICY> is one of the following: DEDICATEDPS, DEDICATEDPES, UTILIZEDPS, PDEDICATEDPS, or SDEDICATEDPES
DEFAULT---
DETAILSspecifies the unit of tracking fairshare usage.  DEDICATEDPS tracks dedicated processor seconds.  DEDICATEDPES tracks dedicated processor-equivalent seconds.  UTILIZEDPS tracks the number of utilized processor seconds.  SDEDICATEDPES tracks dedicated processor-equivalent seconds scaled by the speed of the node.  PDEDICATEDPS tracks dedicated processor seconds scaled by the processor speed of the node.  If the optional '%' (percentage) character is specified, percentage based fairshare will be used.  See Fairshare Overview and Fairshare Consumption Metrics or more information.
EXAMPLE
moab.cfg
FSPOLICY DEDICATEDPES

Moab will track fairshare usage by dedicated process-equivalent seconds


PARAMETER

FSPPUWEIGHT
FORMAT<INTEGER>
DEFAULT0
DETAILSspecifies the fairshare weight assigned to processors per user.
EXAMPLE
moab.cfg
FSPPUWEIGHT 10

PARAMETER

FSPSPUWEIGHT
FORMAT<INTEGER>
DEFAULT0
DETAILSspecifies the fairshare weight assigned to processor-seconds per user.
EXAMPLE
moab.cfg
FSPSPUWEIGHT 10

PARAMETER

FSQOSWEIGHT
FORMAT<INTEGER>
DEFAULT0
DETAILSspecifies the priority weight assigned to the QOS fairshare subcomponent
EXAMPLE
moab.cfg
FSQOSWEIGHT 16

PARAMETER

FSTARGETISABSOLUTE
FORMAT<BOOLEAN>
DEFAULTFALSE
DETAILSspecifies whether Moab should base fairshare targets off of delivered cycles or up/available cycles.
EXAMPLE
moab.cfg
FSTARGETISABSOLUTE TRUE

PARAMETER

FSTREE
FORMATlist of zero or more space delimited <ATTR>=<VALUE> pairs where <ATTR> is one of the following:
SHARES or MEMBERLIST
DEFAULT---
DETAILSspecifies the share tree distribution for job fairshare prioritization (see Hierarchical Share Tree Overview)
EXAMPLE
moab.cfg
FSTREE[geo]  SHARES=16  MEMBERLIST=geo103,geo313,geo422

PARAMETER

FSTREEACLPOLICY
FORMATOFF, PARENT, or FULL
DEFAULTFULL
DETAILSspecifies how Moab should interpret credential membership when building the FSTREE (see Hierarchical Share Tree Overview)
EXAMPLE
moab.cfg
FSTREEACLPOLICY	PARENT

Credentials will be given access to their parent node when applicable


PARAMETER

FSTREEISREQUIRED
FORMAT<BOOLEAN>
DEFAULTFALSE
DETAILSspecifies whether a job must have an applicable node in the partition's FSTREE in order to execute within that partition (see Hierarchical Share Tree Overview)
EXAMPLE
moab.cfg
FSTREEISREQUIRED TRUE

Jobs must have an applicable node in the FSTREE in order to execute


PARAMETER

FSTREEUSERISREQUIRED
FORMAT<BOOLEAN>
DEFAULTFALSE
DETAILSspecifies whether the user must be given explicit access to a branch in the FSTREE (see Hierarchical Share Tree Overview)
EXAMPLE
moab.cfg
FSTREEUSERISREQUIRED TRUE

Users must be given explicit access to FSTREE nodes in order to gain access to the FSTREE


PARAMETER

FSUSERWEIGHT
FORMAT<INTEGER>
DEFAULT0
DETAILSspecifies the priority weight assigned to the user fairshare subfactor.
EXAMPLE
moab.cfg
FSUSERWEIGHT 8

PARAMETER

FSWEIGHT
FORMAT<INTEGER>
DEFAULT1
DETAILSspecifies the priority weight assigned to the summation of the fairshare subfactors (see Priority Factor and Fairshare overviews)
EXAMPLE
moab.cfg
FSWEIGHT 500

PARAMETER

GEVENTCFG[<GEVENT>]
FORMATlist of zero or more space delimited <ATTR >=<VALUE> pairs where <ATTR> is one of the following:
ACTION or REARM
DEFAULT---
DETAILSspecifies how scheduler should behave when various cluster events are detected.  See the Generic Events Overview.
EXAMPLE
moab.cfg
GEVENTCFG[hitemp] ACTION=avoid,record,notify  REARM=00:10:00

If a hitemp event is detected, Moab will adjust the node allocation policy to minimize the allocation of the node.  Moab will also send emails to cluster admins and report the event in the Moab event log.


PARAMETER

GRESCFG[<GRES>]
FORMATlist of zero or more space delimited <ATTR >=<VALUE> pairs where <ATTR> is one of the following:
TYPE
DEFAULT---
DETAILSspecifies associations of generic resources into resource groups.   See the Generic Consumable Resource Overview.
EXAMPLE
moab.cfg
GRESCFG[scsi1] TYPE=fastio
GRESCFG[scsi2] TYPE=fastio
GRESCFG[scsi3] TYPE=fastio

The generic resources scsi1, scsi2, and scsi3 are all associated with the generic resource type fastio.


PARAMETER

GRESTOJOBATTRMAP
FORMATcomma delimited list of generic resources
DEFAULT---
DETAILSThe list of generic resources will also be interpreted as JOB features. See 7.1.5 Managing Reservations
EXAMPLE
moab.cfg
GRESTOJOBATTRMAP  matlab,ccs
Jobs which request the generic resources matlab or ccs will have a corresponding job attribute assigned to them.

PARAMETER

ENABLEHIGHTHROUGHPUT
FORMAT<BOOLEAN>
DEFAULTFALSE
DETAILSconfigures Moab so that it will accept msub submissions, start jobs, process triggers, etc., in a manner which minimizes their processing time. The downside is that Moab will return minimal information about these jobs at submit time (no job ID is returned). It is recommended that jobs be submitted with a "-N <JOBNAME>" argument so users can keep track of their jobs.
EXAMPLE
moab.cfg
EnableHighThroughput TRUE

Moab can now accept hundreds of jobs per second using msub instead of 20-30.


PARAMETER

GROUPCFG[<GROUPID>]
FORMATlist of zero or more space delimited <ATTR>=<VALUE> pairs where <ATTR> is one of the following:
General Credential Flags, PRIORITY, ENABLEPROFILING, FSTARGET, QLIST, QDEF, PLIST, PDEF, FLAGS, or a fairness policy specification.
DEFAULT---
DETAILSspecifies group specific attributes.   See the flag overview for a description of legal flag values.
EXAMPLE
moab.cfg
GROUPCFG[staff] MAXJOB=50 QDEF=highprio
up to 50 jobs submitted by members of the group staff will be allowed to execute simultaneously and will be assigned the QOS highprio by default.


PARAMETER

GROUPWEIGHT
FORMAT<INTEGER>
DEFAULT1
DETAILSspecifies the priority weight assigned to the specified group priority (See Credential (CRED) Factor)
EXAMPLE
moab.cfg
GROUPWEIGHT 20

PARAMETER

HAPOLLINTERVAL
FORMAT[[[DD:]HH:]MM:]SS
DEFAULT30
DETAILSspecifies the amount of time between subsequent high availability pings. (See High Availability Overview for more info)
EXAMPLE
moab.cfg
HAPOLLINTERVAL 00:00:15
The Moab fallback server will check the health of the Moab primary every 15 seconds.

PARAMETER

IDCFG[X]
FORMATone or more of the following attribute/value pairs: BLOCKEDCREDLIST, CREATECRED, CREATECREDURL, REFRESHPERIOD, RESETCREDLIST or SERVER
DEFAULT---
DETAILSThis parameter enables the identity manager interface allowing credential, policy, and usage information to be shared with an external information service.
EXAMPLE
moab.cfg
IDCFG[info] SERVER=exec:///opt/moab/dbquery.pl REFRESHPERIOD=hour

Moab will refresh credential info every hour using the specified script.


PARAMETER

IGNORECLASSES
FORMAT[!]<CLASS>[,<CLASS>]...
DEFAULT---
DETAILSBy default, jobs from all listed classes are ignored and not scheduled, tracked, or otherwise processed by Moab.  If the not (i.e., '!') character is specified, only jobs from listed classes are processed. (see Moab Side by Side Analysis)
EXAMPLE
moab.cfg
IGNORECLASSES dque,batch

Moab will ignore jobs from classes dque and batch.


PARAMETER

IGNOREJOBS
FORMAT[!]<JOBID>[,<JOBID>]...
DEFAULT---
DETAILSBy default, listed jobs are ignored and not scheduled, tracked, or otherwise processed by Moab.  If the not (i.e., '!') character is specified, only listed jobs are processed. (see Moab Side by Side Analysis)
EXAMPLE
moab.cfg
IGNOREJOBS !14221,14223

Moab will ignore jobs all classes except 14221 and 14223.


PARAMETER

IGNORENODES
FORMAT[!]<NODE>[,<NODE>]...
DEFAULT---
DETAILSBy default, all listed nodes are ignored and not scheduled, tracked, or otherwise processed by Moab.  If the not (i.e., '!') character is specified, only listed nodes are processed. (see Moab Side by Side Analysis)
EXAMPLE
moab.cfg
IGNORENODES !host3,host4

Moab will only process nodes host3 and host4.


PARAMETER

IGNOREPREEMPTEEPRIORITY
FORMAT<BOOLEAN>
DEFAULTFALSE
DETAILSBy default, preemptor jobs can only preempt preemptee jobs if the preemptor has a higher job priority than the preemptee.  When this parameter is set to true, the priority constraint is removed allowing any preemptor to preempt any preemptee.
EXAMPLE
moab.cfg
IGNOREPREEMPTEEPRIORITY TRUE

All preemptor job can preempt any preemptee jobs.


PARAMETER

IGNOREUSERS
FORMAT[!]<USERNAME>[,<USERNAME>]...
DEFAULT---
DETAILSBy default, jobs from all listed users are ignored and not scheduled, tracked, or otherwise processed by Moab.  If the not (i.e., '!') character is specified, only jobs from listed users are processed. (see Moab Side by Side Analysis)
EXAMPLE
moab.cfg
IGNOREUSERS testuser1,annapolis

Moab will ignore jobs from users testuser1 and annapolis.


PARAMETER

#INCLUDE
FORMAT<STRING>
DEFAULT---
DETAILSspecifies another file which contains more configuration parameters.
EXAMPLE
moab.cfg
#INCLUDE moab.acct

 Moab will process the parameters in moab.acct as well as moab.cfg


PARAMETER

INSTANTSTAGE
FORMAT<BOOLEAN>
DEFAULTFALSE
DETAILSspecifies whether Moab should instantly stage jobs to the underlying resource manager when a job is submitted through msub.
EXAMPLE
moab.cfg
INSTANTSTAGE TRUE

PARAMETER

INVALIDFSTREEMSG
FORMAT"<STRING>"
DEFAULT"no valid fstree node found"
DETAILSspecifies the error message that should be attached to jobs that cannot run because of a fairshare tree configuration violation.
EXAMPLE
moab.cfg
INVALIDFSTREEMSG        "account is invalid for requested partition"

PARAMETER

JOBACTIONONNODEFAILURE
FORMATone of CANCEL, FAIL, HOLD, IGNORE, MIGRATE, NOTIFY, or REQUEUE
DEFAULT---
DETAILSspecifies the action to take if Moab detects that a node allocated to an active job has failed (state is down).  By default, Moab only reports this information via diagnostic commands.  If this parameter is set, Moab will cancel or requeue the active job.
EXAMPLE
moab.cfg
JOBACTIONONNODEFAILURE REQUEUE

Moab will requeue active jobs which have allocated nodes which have failed during the execution of the job.


PARAMETER

JOBAGGREGATIONTIME
FORMAT[[[DD:]HH:]MM:]SS
DEFAULT0
DETAILSspecifies the minimum amount of time the scheduler should wait after receiving a job event until it should process that event.  This parameter allows sites with bursty job submissions to process job events in groups decreasing total job scheduling cycles and allowing the scheduler to make more intelligent choices by aggregating job submissions and choosing between the jobs. (See Considerations for Large Clusters)
EXAMPLE
moab.cfg
JOBAGGREGATIONTIME 00:00:04
RMPOLLINTERVAL     00:00:30

Moab will wait 4 seconds between scheduling cycles when job events have been received and will wait 30 seconds between scheduling cycles otherwise


PARAMETER

JOBCFG
FORMAT<ATTR>=<VAL> where <ATTR> is one of FLAGS, GRES, NODERANGE, PROCRANGE, QOS, RARCH, REQFEATURES, ROPSYS, or TARGETLOAD
DEFAULT---
DETAILSspecifies attributes for jobs which satisfy the specified profile.  NOTE: The index to the JOBCFG parameter can either be an admin-chosen job template name or the exact name of job reported by one or more workloadqueries.  See Wiki Attributes, Dynamic Jobs and Job Template Extensions
EXAMPLE
moab.cfg
JOBCFG[sql] REQFEATURES=sqlnode QOS=service

When the sql job is detected, it will have the specified default qos and node feature attributes set.


PARAMETER

JOBCPURGETIME
FORMAT[[[DD:]HH:]MM:]SS
DEFAULT00:05:00
DETAILSSpecifies the amount of time Moab will preserve detailed information about a completed job (see JOBPURGETIME, showq -c and checkjob)
EXAMPLE
moab.cfg
JOBCPURGETIME 02:00:00

Moab will maintain detailed job information for two hours after a job has completed.


PARAMETER

JOBMATCHCFG
FORMAT<ATTR>=<VAL> where <ATTR> is one of JMIN, JMAX, JDEF, JSET, or JSTAT
DEFAULT---
DETAILSspecifies the job templates which must be matched and which will be applied in the case of a match.
EXAMPLE
moab.cfg
JOBMATCHCFG[sql] JMIN=interactive JSTAT=istat


PARAMETER

JOBMAXHOLDTIME
FORMAT[[[DD:]HH:]MM:]SS
DEFAULT---
DETAILSSpecifies the amount of time a job can be held before it is canceled automatically.
EXAMPLE
moab.cfg
JOBMAXHOLDTIME 02:00:00

Moab will keep jobs in any HOLD state for 2 hours before canceling them.


PARAMETER

JOBMAXNODECOUNT
FORMAT<INTEGER>
DEFAULT1024
DETAILSspecifies the maximum number of nodes which can be allocated to a job.  After changing this parameter, Moab must be restarted.  NOTE: This value cannot exceed either MMAX_NODE or MMAX_TASK_PER_JOB.  If larger values are required, these values must also be increased.  Moab must be restarted before changes to this command will take affect.   The command mdiag -S will indicate if any job node count overflows have occurred. (see Consideration for Large Clusters)
EXAMPLE
moab.cfg
JOBMAXNODECOUNT 4000

PARAMETER

JOBMAXOVERRUN
FORMAT[[[[DD:]HH:]MM:]SS,][[[DD:]HH:]MM:]SS
DEFAULT(no soft limit), 10 minutes (hard limit)
DETAILSsoft and hard limit of the amount of time Moab will allow a job to exceed its wallclock limit before it first sends a mail to the primary admin (soft limit) and then terminates the job (hard limit).  See WCVIOLATIONACTION or Resource Usage Limit Overview.
EXAMPLE
moab.cfg
JOBMAXOVERRUN 15:00,1:00:00

Jobs may exceed their wallclock limit by up to 1 hour, but Moab will send an email to the primary administrator when a job exceeds its walltime by 15 minutes


PARAMETER

JOBMAXPREEMPTPERITERATION
FORMAT<INTEGER>
DEFAULT0 (No Limit)
DETAILSmaximum number of jobs allowed to be preempted per iteration
EXAMPLE
moab.cfg
JOBMAXPREEMPTPERITERATION 10

PARAMETER

JOBMAXSTARTPERITERATION
FORMAT<INTEGER>
DEFAULT0 (No Limit)
DETAILSmaximum number of jobs allowed to start per iteration
EXAMPLE
moab.cfg
JOBMAXSTARTPERITERATION  10

PARAMETER

JOBMAXSTARTTIME
FORMAT[[[DD:]HH:]MM:]SS
DEFAULT-1 (NO LIMIT)
DETAILSlength of time a job is allowed to remain in a 'starting' state.  If a 'started' job does not transition to a running state within this amount of time, Moab will cancel the job, believing a system failure has occurred. 
EXAMPLE
moab.cfg
JOBMAXSTARTTIME 2:00:00

jobs may attempt to start for up to 2 hours before being canceled by the scheduler


PARAMETER

JOBNODEMATCHPOLICY
FORMATzero or more of the following: EXACTNODE or EXACTPROC
DEFAULT---
DETAILSspecifies additional constraints on how compute nodes are to be selected. EXACTNODE indicates that Moab should select as many nodes as requested even if it could pack multiple tasks onto the same node.  EXACTPROC indicates that Moab should select only nodes with exactly the number of processors configured as are requested per node even if nodes with excess processors are available.
EXAMPLE
moab.cfg
JOBNODEMATCHPOLICY EXACTNODE

In a PBS/Native job with resource specification 'nodes=<x>:ppn=<y>', Moab will allocate exactly <y> task on each of <x> distinct nodes.


PARAMETER

JOBPREEMPTMINACTIVETIME
FORMAT[[[DD:]HH:]MM:]SS
DEFAULT0
DETAILSThe minimum amount of time a job must be active before being considered eligible for preemption. (See Job Preemption)
EXAMPLE
moab.cfg
JOBPREEMPTMINACTIVETIME 00:05:00

A job must execute for 5 minutes before Moab will consider it eligible for preemption.


PARAMETER

JOBPRIOACCRUALPOLICY
FORMATone of the following:  ACCRUE or RESET
DEFAULTACCRUE
DETAILSspecifies how Moab should track the dynamic aspects of a job's priority.  ACCRUE indicates that the job will accrue queuetime based priority from the time it is submitted unless it violates any of the policies not specified in JOBPRIOEXCEPTIONSRESET indicates that it will accrue priority from the time it is submitted unless it violates any of the JOBPRIOEXCEPTIONS. However, with RESET, if the job does violate JOBPRIOEXCEPTIONS then its queuetime based priority will be reset to 0.

NOTE: the following old JOBPRIOACCRUALPOLICY values have been deprecated and should be adjusted to the following values:

  • QUEUEPOLICY = ACCRUE and JOBPRIOEXCEPTIONS SOFTPOLICY,HARDPOLICY
  • QUEUEPOLICYRESET = RESET and JOBPRIOEXCEPTIONS SOFTPOLICY,HARDPOLICY
  • ALWAYS = ACCRUE and JOBPRIOEXCEPTIONS ALL
  • FULLPOLICY = ACCRUE and JOBPRIOEXCEPTIONS NONE
  • FULLPOLICYRESET = RESET and JOBPRIOEXCEPTIONS NONE
EXAMPLE
moab.cfg
JOBPRIOACCRUALPOLICY   RESET

Moab will adjust the job's dynamic priority subcomponents, i.e., QUEUETIME, XFACTOR, and TARGETQUEUETIME, etc. each iteration that the job does not violate any JOBPRIOEXCEPTIONS, if it is found in violation, its queuetime will be reset to 0.


PARAMETER

JOBPRIOEXCEPTIONS
FORMATcomma delimited list of any of the following: DEFER, DEPENDS, SOFTPOLICY, HARDPOLICY, IDLEPOLICY, USERHOLD, BATCHHOLD, and SYSTEMHOLD (ALL or NONE can also be specified on their own)
DEFAULTNONE
DETAILSspecifies exceptions for calculating a job's dynamic priority (QUEUETIME, XFACTOR, TARGETQUEUETIME).  Normally, when a job violates a policy, is placed on hold, or has an unsatisfied dependency, it will not accrue priority.  Exceptions can be configured to allow a job to accrue priority inspite of any of these violations. With DEPENDS a job will increase in priority even if there exists an unsatisfied dependency.  With SOFTPOLICY, HARDPOLICY, or IDLEPOLICY a job can accrue priority despite violating a specific limit.  With DEFER, USERHOLD, BATCHHOLD, or SYSTEMHOLD a job can accrue priority despite being on hold.
EXAMPLE
moab.cfg
JOBPRIOEXCEPTIONS BATCHHOLD,SYSTEMHOLD,DEPENDS

job's will accrue priority in spite of batchholds, systemholds, or unsatisfied dependencies


PARAMETER

JOBPRIOF
FORMAT<ATTRIBUTE>[<VALUE>]=<PRIORITY> where <ATTRIBUTE> is one of ATTR, GRES or STATE
DEFAULT---
DETAILSspecifies attribute priority weights for jobs with specific attributes, generic resource requests, or states.  State values must be one of the standard Moab job states.   (see Attribute Based Job Prioritization)
EXAMPLE
moab.cfg
JOBPRIOF         STATE[Running]=100  STATE[Suspended]=1000  ATTR[PREEMPTEE]=200  GRES[biocalc]=5
ATTRATTRWEIGHT   1
ATTRSTATEWEIGHT  1
Moab will adjust the job's dynamic priority subcomponents.


PARAMETER

JOBPURGETIME
FORMAT[[[DD:]HH:]MM:]SS
DEFAULT0 (purge immediately if the resource manager does not report the job)
DETAILSThe amount of time Moab will keep a job record which is no longer reported by the resource manager.  Useful when using a resource manager which drops information about a job due to internal failures. (see JOBCPURGETIME)
EXAMPLE
moab.cfg
JOBPURGETIME 00:05:00

Moab will maintain a job record for 5 minutes after the last update regarding that object received from the resource manager.


PARAMETER

JOBREJECTPOLICY
FORMATzero or more of CANCEL, HOLD, IGNORE (beta), MAIL, or RETRY
DEFAULTCANCEL
DETAILSspecifies the action to take when the scheduler determines that a job can never run.  CANCEL issues a call to the resource manager to cancel the job.  HOLD places a batch hold on the job preventing the job from being further evaluated until released by an administrator. (NOTE: Administrators can dynamically alter job attributes and possibly fix the job with mjobctl -m.)  With IGNORE (currently in beta), the scheduler will allow the job to exist within the resource manager queue but will neither process it nor report it.  MAIL will send email to both the admin and the user when rejected jobs are detected. If RETRY is set, then Moab will allow the job to remain idle and will only attempt to start the job when the policy violation is resolved.  Any combination of attributes may be specified. (See QOSREJECTPOLICY.)
EXAMPLE
moab.cfg
JOBREJECTPOLICY  MAIL,CANCEL

PARAMETER

JOBRETRYTIME
FORMAT[[[DD:]HH:]MM:]SS
DEFAULT60 seconds
DETAILSPeriod of time Moab will continue to attempt to start a job which has failed to start due to transient failures or which has successfully started and was then rejected by the resource manager due to transient failures.  See Reservation Policies and RESERVATIONRETRYTIME.
EXAMPLE
moab.cfg
JOBRETRYTIME   00:05:00

Moab will try for up to 5 minutes to restart jobs if the job start has failed due to transient errors.


PARAMETER

JOBSIZEPOLICY
FORMAT<N/A>
DEFAULT---
DETAILS<N/A>
EXAMPLE<N/A>

PARAMETER

JOBSYNCTIME
FORMAT[[[DD:]HH:]MM:]:SS
DEFAULT00:10:00
DETAILSspecifies the length of time after which Moab will synchronize a job's expected state with an unexpected reported state.  IMPORTANT NOTE: Moab will not allow a job to run while its expected state does not match the state reported by the resource manager.
EXAMPLE
moab.cfg
JOBSYNCTIME 00:01:00

PARAMETER

LIMITEDJOBCP
FORMAT<BOOLEAN>
DEFAULTFALSE
DETAILSspecifies whether there should be limited job checkpointing (see Consideration for Large Clusters)
EXAMPLE
moab.cfg
LIMITEDJOBCP TRUE

Moab will only maintain scheduler checkpoint information for jobs with explicitly modified job attributes. (some minor job performance and usage statistics may be lost)


PARAMETER

LIMITEDNODECP
FORMAT<BOOLEAN>
DEFAULTFALSE
DETAILSspecifies whether there should be limited node checkpointing (see Consideration for Large Clusters)
EXAMPLE
moab.cfg
LIMITEDNODECP TRUE

Moab will only maintain scheduler checkpoint information for nodes with explicitly modified job attributes. (some minor node performance and usage statistics may be lost)


PARAMETER

LOADALLJOBCP
FORMAT<BOOLEAN>
DEFAULTFALSE
DETAILSspecifies whether Moab should load, during startup, all non-completed jobs in the checkpoint files regardless of whether or not their corresponding resource managers are active. For example, this allows source peers to continue showing remote jobs in the queue based on checkpointed info, even though the destination peer is offline.
EXAMPLE
moab.cfg
LOADALLJOBCP TRUE

Moab will load, at startup, all non-completed jobs from all checkpoint files.


PARAMETER

LOGDIR
FORMAT<STRING>
DEFAULTlog
DETAILSspecifies the directory in which log files will be maintained.  If specified as a relative path, LOGDIR will be relative to $(MOABHOMEDIR)  See Logging Overview for more information.
EXAMPLE
moab.cfg
LOGDIR /var/spool/moab

Moab will record its log files directly into the /var/spool/moab directory


PARAMETER

LOGFACILITY
FORMATcolon delimited list of one or more of the following:   fCORE, fSCHED, fSOCK, fUI, fLL, fCONFIG, fSTAT, fSIM, fSTRUCT, fFS, fCKPT, fBANK, fRM, fPBS, fWIKI, fALL
DEFAULTfALL
DETAILSspecifies which types of events to log (see Logging Overview)
EXAMPLE
moab.cfg
LOGFACILITY fRM:fPBS 

Moab will log only events involving general resource manager or PBS interface activities.


PARAMETER

LOGFILE
FORMAT<STRING>
DEFAULTmoab.log
DETAILSname of the Moab log file.  This file is maintained in the directory pointed to by <LOGDIR> unless <LOGFILE> is an absolute path (see Logging Overview)
EXAMPLE
moab.cfg
LOGFILE moab.test.log

Log information will be written to the file moab.test.log located in the directory pointed to by the LOGDIR parameter


PARAMETER

LOGFILEMAXSIZE
FORMAT<INTEGER>
DEFAULT10000000
DETAILSmaximum allowed size (in bytes) the log file before it will be rolled (see Logging Overview)
EXAMPLE
moab.cfg
LOGFILEMAXSIZE 50000000

Log files will be rolled when they reach 50 MB in size


PARAMETER

LOGFILEROLLDEPTH
FORMAT<INTEGER>
DEFAULT3
DETAILSnumber of old log files to maintain (i.e., when full, moab.log will be renamed moab.log.1, moab.log.1 will be renamed moab.log.2, ... (see Logging Overview)
EXAMPLE
moab.cfg
LOGFILEROLLDEPTH 5 

Moab will maintain and roll the last 5 log files.


PARAMETER

LOGLEVEL
FORMAT<INTEGER> (0-9)
DEFAULT0
DETAILSspecifies the verbosity of Moab logging where 9 is the most verbose (NOTE: each logging level is approximately an order of magnitude more verbose than the previous level) (see Logging Overview)
EXAMPLE
moab.cfg
LOGLEVEL 4

Moab will write all Moab log messages with a threshold of 4 or lower to the moab.log file


PARAMETER

MAILPROGRAM
FORMAT[ <Full_Path_To_Mail_Command> | DEFAULT | NONE ][@<DEFAULTMAILDOMAIN>]
DEFAULTNONE
DETAILSif set to NONE, no mail will be sent.  If set to DEFAULT, the default mail program, /usr/bin/sendmail, will be used.  NOTE: By default, Moab mail notification is disabled.  To enable, MAILPROGRAM must be set to DEFAULT or to the locally available mail program.  If the default mail domain is set, emails will be routed to this domain unless a per-user domain is specified using the EMAILADDRESS attribute of the USERCFG parameter. (see Notify Admins)
EXAMPLE
moab.cfg
MAILPROGRAM /usr/local/bin/sendmail

PARAMETER

MAXJOB
FORMAT<INTEGER>
DEFAULT4096
DETAILSspecifies the maximum number of simultaneous jobs which can be evaluated by the scheduler.  If additional jobs are submitted to the resource manager, Moab will ignore these jobs until previously submitted jobs complete.  NOTE: Moab must be restarted for any changes to this parameter to take affect.  The command mdiag -S will indicate if any job overflows have occurred.
EXAMPLE
moab.cfg
MAXJOB 45000

PARAMETER

MAXRSVPERNODE
FORMAT<INTEGER>
DEFAULT24
DETAILSspecifies the maximum number of reservations which can be on any single node.  IMPORTANT NOTE: On large way SMP systems, this value often must be increased.  To be on the safe side, this value should be approximately twice the average sum of admin, standing, and job reservations present.  Moab must be restarted for any changes to this parameter to take affect.   The command mdiag -S will indicate if any node reservation overflows have occurred. (see Considerations for Large Clusters)
EXAMPLE
moab.cfg
MAXRSVPERNODE 64

PARAMETER

MEMREFRESHINTERVAL
FORMAT[[[DD:]HH:]MM:]:SS | job:<COUNT>
DEFAULT---
DETAILSspecifies the time interval or total job query count at which Moab will perform garbage collection to free memory associated with resource manager API's which possess memory leaks (i.e., Loadleveler, etc)
EXAMPLE
moab.cfg
# free memory associated with leaky RM API
MEMREFRESHINTERVAL 24:00:00

Moab will perform garbage collection once a day


PARAMETER

MEMWEIGHT
FORMAT<INTEGER>
DEFAULT0
DETAILSspecifies the coefficient to be multiplied by a job's MEM (dedicated memory in MB) factor. See Resource Priority Overview
EXAMPLE
moab.cfg
RESWEIGHT 10
MEMWEIGHT 1000 

each job's priority will be increased by 10 * 1000 * <request memory>


PARAMETER

MINADMINSTIME
FORMAT<INTEGER>
DEFAULT60 seconds
DETAILSSpecifies the minimum time a job will be suspended if suspended by an administrator or by a scheduler policy.
EXAMPLE
moab.cfg
MINADMINSTIME 00:10:00
each job suspended by administrators or policies will stay in the suspended state for at least 10 minutes

PARAMETER

NODEACCESSPOLICY
FORMATone of the following: SHARED, SHAREDONLY, SINGLEJOB, SINGLETASK , SINGLEUSER, or UNIQUEUSER
DEFAULTSHARED
DETAILSspecifies how node resources will be shared by various tasks (See the Node Access Overview for more information)
EXAMPLE
moab.cfg
NODEACCESSPOLICY SINGLEUSER 

Moab will allow resources on a node to be used by more than one job provided that the job's are all owned by the same user


PARAMETER

NODEALLOCATIONPOLICY
FORMATone of the following: FIRSTAVAILABLE,
LASTAVAILABLE, MINRESOURCE, CPULOAD, LOCAL, CONTIGUOUS, MAXBALANCE, PRIORITY, or FASTEST
DEFAULTLASTAVAILABLE
DETAILSspecifies how Moab should allocate available resources to jobs.  See Node Allocation Overview for more information.
EXAMPLE
moab.cfg
NODEALLOCATIONPOLICY MINRESOURCE

Moab will apply the node allocation policy MINRESOURCE to all jobs by default


PARAMETER

NODEALLOCRESFAILUREPOLICY
FORMATone of the following: CANCEL, HOLD, IGNORE, MIGRATE, NOTIFY, or REQUEUE
DEFAULTCANCEL
DETAILSspecifies how Moab should handle active jobs which experience node failures during execution.  (see the RESFAILPOLICY resource manager extension or the Node Availability Overview).
EXAMPLE
moab.cfg
NODEALLOCRESFAILUREPOLICY REQUEUE

Moab will requeue jobs which have allocated nodes fail during execution


PARAMETER

NODEAVAILABILITYPOLICY
FORMAT<POLICY>[:<RESOURCETYPE>] ...

where 
POLICY is one of COMBINED, DEDICATED, or UTILIZED
and
RESOURCETYPE is one of
PROC, MEM, SWAP, or DISK

DEFAULTCOMBINED
DETAILSspecifies how Moab will evaluate node availability on a per resource basis. (See the Node Availability section of the Admin manual for more information)
EXAMPLE
moab.cfg
NODEAVAILABILITYPOLICY DEDICATED:PROCS COMBINED:MEM

Moab will ignore resource utilization information in locating available processors for jobs but will use both dedicated and utilized memory information in determining memory availability


PARAMETER

NODECATCREDLIST
FORMAT

<LABEL>=<NODECAT>[,<NODECAT>]...[ <LABEL>=<NODECAT>[,<NODECAT>]...]... where
<LABEL> is any string and <NODECAT> is one of the defined node categories.

DEFAULT---
DETAILSif specified, Moab will generate node category groupings and each iteration will assign usage of matching resources to pseudo-credentials with a name matching the specified label. (See the Node Categorization section of the Admin manual for more information)
EXAMPLE
moab.cfg
NODECATCREDLIST down=BatchFailure,HardwareFailure,NetworkFailure idle=Idle

Moab will create a down user, group, account, class, and QoS and will associate BatchFailure, HardwareFailure, and NetworkFailure resources with these credentials.  Additionally, Moab will assign all Idle resources to matching idle credentials.


PARAMETER

NODECFG[X]
FORMATlist of space delimited <ATTR>=<VALUE> pairs where <ATTR> is one of the following:
ACCESS, CHARGERATE, FEATURES, GRES, LOGLEVEL, MAXJOB, MAXJOBPERUSER, MAXLOAD, MAXNETLOAD, MAXPE, NODETYPE, PARTITION, POOL, PRIORITY, PRIORITYF, PROCSPEED, RACK, RADISK, SLOT, SPEED, or TRIGGER
DEFAULT---
DETAILSspecifies node-specific attributes for the node indicated in the array field.  See the General Node Administration Overview for more information.
EXAMPLE
moab.cfg
NODECFG[nodeA] MAXJOB=2 SPEED=1.2

Moab will only allow two simultaneous jobs to run on node nodeA and will assign a relative machine speed of 1.2 to this node.


PARAMETER

NODEBUSYSTATEDELAYTIME
FORMAT[[[DD:]HH:]MM:]SS
DEFAULT0:01:00 (one minute)
DETAILSlength of time Moab will assume busy nodes will remain unavailable for scheduling if a system reservation is not explicitly created for the node.
EXAMPLE
moab.cfg
NODEBUSYSTATEDELAYTIME 0:30:00

Moab will assume busy nodes are not available for scheduling for at least 30 minutes from the current time.  Thus, these nodes will never be allocated to starting jobs.  Also, these nodes will only be available for reservations starting more than 30 minutes in the future.


PARAMETER

NODEDOWNSTATEDELAYTIME
FORMAT[[[DD:]HH:]MM:]SS
DEFAULT1:00:00 (one hour)
DETAILSlength of time Moab will assume down, drained (offline), or corrupt nodes will remain unavailable for scheduling if a system reservation is not explicitly created for the node. Specifying "-1" will cause Moab to never create job reservations on down nodes. See Node Availability for more information.
EXAMPLE
moab.cfg
NODEDOWNSTATEDELAYTIME 0:30:00

Moab will assume down, drained, and corrupt nodes are not available for scheduling for at least 30 minutes from the current time. Thus, these nodes will never be allocated to starting jobs. Also, these nodes will only be available for reservations starting more than 30 minutes in the future.


PARAMETER

NODEDRAINSTATEDELAYTIME
FORMAT[[[DD:]HH:]MM:]SS
DEFAULT3:00:00 (three hours)
DETAILSlength of time Moab will assume drained nodes will remain unavailable for scheduling if a system reservation is not explicitly created for the node. Specifying "-1" will cause Moab to never create job reservations on drained nodes. See Node Availability for more information.
EXAMPLE
moab.cfg
NODEDRAINSTATEDELAYTIME 0:30:00

Moab will assume down, drained, and corrupt nodes are not available for scheduling for at least 30 minutes from the current time. Thus, these nodes will never be allocated to starting jobs. Also, these nodes will only be available for reservations starting more than 30 minutes in the future.


PARAMETER

NODEFAILURERESERVETIME
FORMAT[[[DD:]HH:]MM:]SS
DEFAULT0:05:00
DETAILSduration of reservation Moab will place on any node in which it detects a failure from the resource manager (0 indicates no reservation will be placed on the node).  See Node Availability for more information. See also RMCFG[] NODEFAILURERSVPROFILE.
EXAMPLE
moab.cfg
NODEFAILURERESERVETIME 10:00

Moab will reserve failed nodes for 10:00


PARAMETER

NODEIDFORMAT
FORMAT<STRING>
DEFAULT*$N*
DETAILSspecifies how a node id can be processed to extract possible node, rack, slot, and cluster index information.  The value of the parameter may include the markers '$C' (cluster index), '$N' (node index), '$R' (rack index), or '$S' (slot index) separated by '* (asterisk - representing any number of non-numeric characters) or other characters to indicate this encoding.  See Node Selection for more information on use of node, rack, and slot indices.
EXAMPLE
moab.cfg
NODEIDFORMAT *$R*$S

Moab will extract rack and slot information from the cluster node ids (ie, tg-13s08)


PARAMETER

NODELOADPOLICY
FORMATone of the following:  ADJUSTSTATE or ADJUSTPROCS
DEFAULTADJUSTSTATE
DETAILSspecifies whether a node's load affects its state or its available processors.  The ADJUSTSTATE policy specifies that Moab should mark the node busy when the node's maximum load is reached.  The ADJUSTPROCS policy causes the node's available procs to be equivalent to MIN(ConfiguredProcs - DedicatedProcs,MaxLoad - CurrentLoad)  NOTENODELOADPOLICY only affects a node if MAXLOAD has been set.
EXAMPLE
moab.cfg
NODELOADPOLICY ADJUSTSTATE

Moab will mark a node busy if its measured load exceeds its maximum cpu load limit


PARAMETER

NODEMAXLOAD
FORMAT<DOUBLE>
DEFAULT0.0
DETAILSspecifies that maximum cpu load on a idle or running node.  If the node's load reaches or exceeds this value, Moab will mark the node busy (See Load Balancing Features)
EXAMPLE
moab.cfg
NODEMAXLOAD 0.75

Moab will adjust the state of all idle and running nodes with a load >= .75 to the state busy


PARAMETER

NODEPOLLFREQUENCY
FORMAT<INTEGER>
DEFAULT0 (Poll Always)
DETAILSspecifies the number of scheduling iterations between scheduler initiated node manager queries.  If set to '-2, Moab will never query the node manager daemons.  If set to '-1', Moab will only query on the first iteration.  NOTE: this parameter is most often used with OpenPBS an