Maui Administrator's Guide - Resource Manager Extensions
13.3 Resource Manager Extensions
All resource managers are not created equal.
There is a wide range in what capabilities are available from system to system.
Additionally, there is a large body of functionality which many if not all
resource managers have no concept of. A good example of this is job
QoS. Since most resource managers do not have a concept of quality
of service, they do not provide a mechanism for users to specify this information.
In many cases, Maui is able to add capabilities at a global level.
However, a number of features require a 'per job' specification. Resource
manager extensions allow this information to be associated with the job.
How this is done varies with the resource manager.
Both Loadleveler and Wiki allow the specification of a comment field.
(In Loadleveler, specified as '#@comment="<X>"`) PBS
does not support this ability by default but is extensible via the '-W
' flag. (see the PBS Resource
Manager Extension Overview
Using the resource manager specific method, the following job extensions
are currently available:
|specifies that reserved resources are required to run the job. If
<RESID> is specified, then only resources within the specified reservation
may be allocated
||dedicated memory per task in MB
||one or more of the following comma separated keywords
ADVRES[:RESID], RESTARTABLE, PREEMPTEE, PREEMPTOR, NOQUEUE
||associates various flags with the job
||comma delimited list of generic resources where each resource is specified using the format <RESTYPE>[@<COUNT>]
||indicates generic resources required by the job on a per task basis. If a <COUNT> is not specified, the resource count defaults to 1.
||comma delimited list of hostnames
||indicates a exact set, superset, or subset of nodes on which the job
|one of SHARED, SINGLEJOB, SINGLETASK
, or SINGLEUSER
|specifies how node resources should be accessed
|one of the valid settings for the parameter
|specifies how node resources should be selected and
allocated to the job
||specifies nodeset constraints for job resource allocation. (See
the NodeSet Overview for more information)
||specifies the partition (or partitions) in which the job must run.
NOTE: the job must have access to this partition based on system
wide or credential based partition access lists.
(The job must only run in the math partition or the
one of TRUE or FALSE
|| Indicates whether or not the scheduler should queue the job if
resources are not available to run the job immediately
If more than one extension is required in a given job,
extensions can be concatenated with a semicolon separator using the format
See the following examples:
# Loadleveler command file
Job must run on nodes node1 and node2
using the QoS special. The job is also associated with the
system id silverA allowing the silver daemon to monitor and control
# PBS command file
# PBS -W x=\"NODESET:ONEOF:NETWORK;DMEM:64\"
Job will have resources allocated subject to network
based nodeset constraints. Further, each task will dedicate 64 MB of
# qsub -l nodes=4,walltime=1:00:00 -W x="FLAGS:ADVRES:john.1"
Job will be forced to run within the john.1
Resource Manager Overview