[Mauiusers] node allocation issue
abhig at princeton.edu
Thu Dec 2 12:04:28 MST 2010
We have not used NODEAVAILABILITYPOLICY, NODELOADPOLICY and
Currently we are only using 'NODEALLOCATIONPOLICY MINRESOURCE'
Jeff Anderson-Lee wrote:
> On 12/2/2010 9:35 AM, Abhishek Gupta wrote:
>> Hi Jeff,
>> Yes I did verified that multiple jobs are running on same logical cpu.
> What is your NODEAVAILABILITYPOLICY set to? We use:
> NODEAVAILABILITYPOLICY COMBINED:MEM COMBINED:PROC COMBINED:SWAP
> Also check out NODELOADPOLICY and JOBNODEMATCHPOLICY.
>> Jeff Anderson-Lee wrote:
>>> On 12/2/2010 9:07 AM, Abhishek Gupta wrote:
>>>> Our job scheduler is acting little weird. The jobs submitted are going
>>>> on only a few nodes and each node is running more jobs than the total
>>>> number of CPUs on that node. We have not changed anything recently.
>>>> Can anyone suggest what is the best node allocation policy that make
>>>> sure we do not run more jobs than number of cores available on a node
>>>> and jobs are evenly distributed on all the nodes and not on the few
>>> We find that many users understate the number of cores/procs needed
>>> in their requests. They ask for a single cpu, then spawn multiple
>>> tasks, or run Java in a way that runs two or more active threads
>>> instead of one. Maui does not seem to set any cpu affinity to
>>> prevent interference nor enforce the requested number of cores as
>>> far as I know.
>>> Do you know for certain that you are getting multiple jobs allocated
>>> to the same logical cpu and not just user task forks?
>>> If you use Torque as your underlying scheduler, the following should
>>> help you to find true duplicate assignments:
>>> qstat -f | grep exec | sort | uniq -c | sort -n
>>> Jeff Anderson-Lee
More information about the mauiusers