[torqueusers] PBS_NODEFILE incomplete

Mon Dec 20 22:44:08 MST 2010

Dear David,

Thanks for the response. We have a cluster of 8 core machines. Here are the
results of a run

1. PBS options --------------------------------------------------

#PBS -N hello
#PBS -l nodes=16
#PBS -q WitsLong

2. checkjob -v --------------------------------------------------

checking job 5766 (RM job '5766.cream-ce.core.wits.ac.za')

State: Running
Creds:  user:scott  group:scott  class:WitsLong  qos:DEFAULT
WallTime: 00:00:00 of 7:00:00:00
SubmitTime: Tue Dec 21 07:35:19
  (Time Queued  Total: 00:00:01  Eligible: 00:00:01)

StartTime: Tue Dec 21 07:35:20
Total Tasks: 16

Req[0]  TaskCount: 16  Partition: DEFAULT
Network: [NONE]  Memory >= 0  Disk >= 0  Swap >= 0
Opsys: [NONE]  Arch: [NONE]  Features: [NONE]
Exec:  ''  ExecSize: 0  ImageSize: 0
Dedicated Resources Per Task: PROCS: 1
Utilized Resources Per Task:  [NONE]
Avg Util Resources Per Task:  [NONE]
Max Util Resources Per Task:  [NONE]
NodeAccess: SHARED
NodeCount: 0
Allocated Nodes:
[n05.core.wits.ac.za:8][n04.core.wits.ac.za:8]
Task Distribution: 
n05.core.wits.ac.za,n05.core.wits.ac.za,n05.core.wits.ac.za,n05.core.wits.ac
.za,n05.core.wits.ac.za,n05.core.wits.ac.za,n05.core.wits.ac.za,n05.core.wit
s.ac.za,n04.core.wits.ac.za,n04.core.wits.ac.za,n04.core.wits.ac.za,...

IWD: [NONE]  Executable:  [NONE]
Bypass: 0  StartCount: 1
PartitionMask: [ALL]
Flags:       RESTARTABLE

Reservation '5766' (00:00:00 -> 7:00:00:00  Duration: 7:00:00:00)
PE:  16.00  StartPriority:  1

---------------------------------------------------------------------------

3. Result of qstat -f

Job Id: 5766.cream-ce.core.wits.ac.za
    Job_Name = hello
    Job_Owner = scott at cream-ce.core.wits.ac.za
    resources_used.cput = 00:00:02
    resources_used.mem = 18520kb
    resources_used.vmem = 388956kb
    resources_used.walltime = 00:00:03
    job_state = R
    queue = WitsLong
    server = cream-ce.core.wits.ac.za
    Checkpoint = u
    ctime = Tue Dec 21 07:35:19 2010
    Error_Path = cream-ce.core.wits.ac.za:/home/scott/hello.e5766
    exec_host = 
n04.core.wits.ac.za/7+n04.core.wits.ac.za/6+n04.core.wits.ac.z

a/5+n04.core.wits.ac.za/4+n04.core.wits.ac.za/3+n04.core.wits.ac.za/2+
        n04.core.wits.ac.za/1+n04.core.wits.ac.za/0
    Hold_Types = n
    Join_Path = n
    Keep_Files = n
    Mail_Points = a
    mtime = Tue Dec 21 07:35:20 2010
    Output_Path = cream-ce.core.wits.ac.za:/home/scott/hello.o5766
    Priority = 0
    qtime = Tue Dec 21 07:35:19 2010
    Rerunable = True
    Resource_List.cput = 400:00:00
    Resource_List.nodect = 16
    Resource_List.nodes = 16
    Resource_List.walltime = 168:00:00
    session_id = 929
    Variable_List = PBS_O_HOME=/home/scott,PBS_O_LANG=en_US.UTF-8,
        PBS_O_LOGNAME=scott,

PBS_O_PATH=/home/scott/lib/bin:/usr/local/hadoop/bin:/opt/exp_soft/bi

n:/opt/exp_soft/tgicl/bin:/usr/lib64/openmpi/1.3.2-gcc/bin:/usr/kerber

os/bin:/opt/edg/bin:/opt/glite/bin:/opt/globus/bin:/opt/lcg/bin:/usr/l
        ocal/bin:/bin:/usr/bin:/usr/X11R6/bin,
        PBS_O_MAIL=/var/spool/mail/scott,PBS_O_SHELL=/bin/tcsh,
        PBS_SERVER=cream-ce.core.wits.ac.za,
        PBS_O_HOST=cream-ce.core.wits.ac.za,PBS_O_WORKDIR=/home/scott,
        PBS_O_QUEUE=WitsLong
    etime = Tue Dec 21 07:35:19 2010
    submit_args = wjob
    start_time = Tue Dec 21 07:35:20 2010
    start_count = 1

---------------------------------------------------------------------------

4. Output of PBS_NODES

n04.core.wits.ac.za
n04.core.wits.ac.za
n04.core.wits.ac.za
n04.core.wits.ac.za
n04.core.wits.ac.za
n04.core.wits.ac.za
n04.core.wits.ac.za
n04.core.wits.ac.za

<html><p><font face = "verdana" size = "0.8" color = "navy">This communication is intended for the addressee only. It is confidential. If you have received this communication in error, please notify us immediately and destroy the original message. You may not copy or disseminate this communication without the permission of the University. Only authorized signatories are competent to enter into agreements on behalf of the University and recipients are thus advised that the content of this message may not be legally binding on the University and may contain the personal views and opinions of the author, which are not necessarily the views and opinions of The University of the Witwatersrand, Johannesburg. All agreements between the University and outsiders are subject to South African Law unless the University agrees in writing to the contrary.</font></p></html>