[torqueusers] "Not terminated" mpi jobs on one of my nodes

Abraham Zamudio abraham.zamudio at gmail.com
Tue Sep 28 15:26:42 MDT 2010


*node quad4  (8 procs)   <--- NOT TERMINATED*

09/28/2010 16:20:08;0001;   pbs_mom;Job;TMomFinalizeJob3;job 81.master
started, pid = 2999
09/28/2010 16:20:08;0008;   pbs_mom;Job;81.master;start_process: task
started, tid 2, sid 3065, cmd /bin/sh
09/28/2010 16:20:08;0008;   pbs_mom;Job;81.master;start_process: task
started, tid 3, sid 3066, cmd /bin/sh
09/28/2010 16:20:08;0008;   pbs_mom;Job;81.master;start_process: task
started, tid 4, sid 3067, cmd /bin/sh
09/28/2010 16:20:08;0008;   pbs_mom;Job;81.master;start_process: task
started, tid 5, sid 3068, cmd /bin/sh
09/28/2010 16:20:08;0008;   pbs_mom;Job;81.master;start_process: task
started, tid 6, sid 3069, cmd /bin/sh
09/28/2010 16:20:08;0008;   pbs_mom;Job;81.master;start_process: task
started, tid 7, sid 3070, cmd /bin/sh
09/28/2010 16:20:08;0008;   pbs_mom;Job;81.master;start_process: task
started, tid 8, sid 3071, cmd /bin/sh
09/28/2010 16:20:08;0008;   pbs_mom;Job;81.master;start_process: task
started, tid 9, sid 3072, cmd /bin/sh



node quad2 (4 procs)
[mpiX at quad2 ~]$ cat /var/spool/torque/mom_logs/20100928 | grep 81.master
09/28/2010 16:20:17;0008;   pbs_mom;Job;81.master;JOIN JOB as node 1
09/28/2010 16:20:17;0008;   pbs_mom;Job;81.master;start_process: task
started, tid 10, sid 5799, cmd /bin/sh
09/28/2010 16:20:17;0008;   pbs_mom;Job;81.master;start_process: task
started, tid 11, sid 5800, cmd /bin/sh
09/28/2010 16:20:17;0008;   pbs_mom;Job;81.master;start_process: task
started, tid 12, sid 5801, cmd /bin/sh
09/28/2010 16:20:17;0008;   pbs_mom;Job;81.master;start_process: task
started, tid 13, sid 5802, cmd /bin/sh
09/28/2010 16:20:17;0080;   pbs_mom;Job;81.master;scan_for_terminated: job
81.master task 10 terminated, sid=5799
09/28/2010 16:20:17;0080;   pbs_mom;Job;81.master;scan_for_terminated: job
81.master task 11 terminated, sid=5800
09/28/2010 16:20:17;0080;   pbs_mom;Job;81.master;scan_for_terminated: job
81.master task 12 terminated, sid=5801
09/28/2010 16:20:17;0080;   pbs_mom;Job;81.master;scan_for_terminated: job
81.master task 13 terminated, sid=5802

Separately if they finish their work

-- 
Abraham Zamudio Ch.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://www.supercluster.org/pipermail/torqueusers/attachments/20100928/7d78b9f2/attachment.html 


More information about the torqueusers mailing list