[Mauiusers] Regarding MAXJOB, MAXIJOB and MAXPROC
Gareth.Williams at csiro.au
Gareth.Williams at csiro.au
Mon Mar 28 17:04:40 MDT 2011
> -----Original Message-----
> From: sorrillo at jlab.org [mailto:sorrillo at jlab.org]
> Sent: Monday, 28 March 2011 2:15 PM
> To: mauiusers at supercluster.org
> Subject: [Mauiusers] Regarding MAXJOB, MAXIJOB and MAXPROC
> Someone asked this question regarding Maui:
> 1- Is there any relation between MAXJOB and MAXIJOB? According to manual:
> MAXJOB: Limits the number of jobs a credential may have active (starting
> running) at any given time
> MAXIJOB: Idle (or queued) job limits control which jobs are eligible for
In one sense, there is no relationship between the parameters. MAXJOB is straightforward - the number of jobs that can be run concurrently (usually per user but could be per queue or related to another credential). MAXIJOB limits how start priorities are calculated on queue jobs, in particular, how many jobs are eligible to be started and how priority factors based on time in the queue are calculated. Jobs blocked by a MAXIJOB limit do not accrue priority based on XFACTOR or QUEUETIME and probably other related factors).
> Now what does "USERCFG[default] MAXJOB=10 MAXIJOB=3" mean?
> a. each user can *run* 10 jobs and *enqueue* 3 jobs. So the total jobs of
> user is 13.
> b. each user can *run* 7 jobs and *enqueue* 3 jobs. So the total jobs of
> user is 10.
Neither. Each user can *run* up to 10 jobs and 3 of their queued jobs will accrue priority and be considered for starting. MAXIJOB is mostly (IMHO) a mechanism for moderating 'queue stuffing' where an individual submitting many jobs blocks out other users. Otherwise I'm pretty sure maui will only consider a limited number of jobs each cycle anyway and the top of the queue may be dominated by one user, with other users jobs never getting considered.
> 2- If I have defined "USERCFG[default] MAXJOB=2 MAXIJOB=1 MAXPROC=4", and
> a user
> submit requesting these resources:
> job1: -l nodes=7
> job2: -l nodes=1:ppn=1
> job3: -l nodes=4:ppn=2
> job4: -l nodes=10
> what is the result?
Jobs must satisfy all limits, so the MAXPROC setting would prevent all of these from running except the serial job.
> 3- If I have 10 chassis each has 16 processors, I can set MAXNODE=1 to
> that a user can no longer request more that 16 processors (in another word
> will implicitly define MAXPROC=16). Is that right?
Yes this would effectively prevent the user from requesting more than 16 processors, but it would not be the same thing as MAXPROC=16. MAXNODE=1 would mean they could only run on one node, (maybe with multiple jobs sharing the node... not sure) but MAXPROC=16 would limit the total number of processors across all the user jobs to 16. eg. they could have 16 concurrently running serial jobs which might (partially) occupy anywhere between 1 and 16 nodes.
> Also I am assuming that I can aggregate (like so) for an account called
> ACCOUNTCFG[tomil] FSTARGET=0.1- MAXPROC=16,64 MAXJOB=1,3
> to explicitly and simultaneously throttle both the maximum number of cores
> and the jobs the account can run? We have dual quad core nodes.
The set of running tomil jobs must satisfy both conditions. The soft limit part will apply if there are no other queued jobs.
Note that "dual quad core nodes" seems inconsistent with "10 chassis each has 16 processors", but that is probably not important.
More information about the mauiusers