[Mauiusers] Exclusive node access

Lim Ryan rlim3 at unl.edu
Fri Mar 5 09:28:31 MST 2010


Hello,

I'm trying to get exclusive node access with the Maui + Torque installation that I have.

I run
    qsub -I -l walltime=1:00:00,select=10 -W x="NACCESSPOLICY:SINGLETASK" 
but the tasks can end up all on the same machine. At least from what I read at
    http://www.clusterresources.com/products/maui/docs/5.3nodeaccess.shtml
the tasks should be spread across nodes, one task from that job per node exclusively. In my example, I'm looking to get 10 distinct nodes (from select=10).

Running checkjob on this job shows that at least Maui recognizes the singletask request, but somehow it is not honored when the resources are allocated. Do I have something wrong with my Maui installation? I have Maui 3.2.6p21 and Torque 2.3.7. Any help/suggestions is appreciated.




This is what I run and get:
rlim at logon ~$ qsub -I -l walltime=1:00:00,select=10 -W x="NACCESSPOLICY:SINGLETASK"    
qsub: waiting for job 1674361.ff-head.unl.edu to start
qsub: job 1674361.ff-head.unl.edu ready

rlim at c1518 ~$ cat $PBS_NODEFILE 
c1518
c1518
c1518
c1518
c1518
c1518
c1518
c1518
c1515
c1515




Then as root on the head node:
[root at ff-head ~]# checkjob -v 1674361


checking job 1674361 (RM job '1674361.ff-head.unl.edu')

State: Running
Creds:  user:rlim  group:swanson  class:default  qos:high
WallTime: 00:00:00 of 1:00:00
SubmitTime: Fri Mar  5 10:16:42
  (Time Queued  Total: 00:00:06  Eligible: 00:00:06)

StartTime: Fri Mar  5 10:16:48
Total Tasks: 10

Req[0]  TaskCount: 10  Partition: DEFAULT
Network: [NONE]  Memory >= 0  Disk >= 0  Swap >= 0
Opsys: [NONE]  Arch: [NONE]  Features: [NONE]
Exec:  ''  ExecSize: 0  ImageSize: 0
Dedicated Resources Per Task: PROCS: 1
Utilized Resources Per Task:  [NONE]
Avg Util Resources Per Task:  [NONE]
Max Util Resources Per Task:  [NONE]
NodeAccess: SINGLETASK
NodeCount: 0
Allocated Nodes:
[c1518:8][c1515:2]
Task Distribution: c1518,c1518,c1518,c1518,c1518,c1518,c1518,c1518,c1515,c1515


IWD: [NONE]  Executable:  [NONE]
Bypass: 0  StartCount: 1
PartitionMask: [DEFAULT][short][x8way][wrf]
Flags:       NASINGLETASK

Reservation '1674361' (00:00:00 -> 1:00:00  Duration: 1:00:00)
PE:  10.00  StartPriority:  1010088














Regards,
- ryan


Ryan Lim
Systems Administrator
Holland Computing Center
University of Nebraska - Lincoln
email: rlim3 at unl.edu / voice: (402) 554-2323 / web: http://hcc.unl.edu/







More information about the mauiusers mailing list