[torqueusers] Job stdout/stderr file empty after transfer

[Jan Ploski]

Hello,

I am using TORQUE 2.1.6, trying to transfer stdout of a job using the -o 
option of qsub. Unfortunately, no matter whether I transfer via scp or set 
up $usecp, the transferred file is created with size 0 (zero). When I use 
the option "-k oe" instead, the file remains in $HOME on the execute 
machine and contains the expected output. Can anyone please explain this 
or give a tip which log file to inspect or what experiments to perform to 
gather more information?

More details follow...

My PBS batch script is trivial:

#--------------------------------------- 
#!/bin/sh
#PBS -l nodes=node1
#PBS -m n
#PBS -k n
#PBS -o /home/jploski/torque/jpl1.OUT
#PBS -e /home/jploski/torque/jpl1.ERR

echo testing
exit 0
#---------------------------------------

I also started pbs_mom on the execute node with the environment variable 
PBSDEBUG=1. Here is what I see in the daemon's console output after 
submission:

do_rpp: got a resource monitor request
do_rpp: got a resource monitor request
saving extra job info stdout=0 stderr=0 taskid=1 nodeid=0
===== MD5 0868E7EC6EE72ECE16E33F06256A1F48
saving extra job info stdout=-1 stderr=-1 taskid=2 nodeid=0
saving extra job info stdout=-1 stderr=-1 taskid=2 nodeid=0
Terminating job, sending IM_KILL_JOB to sisters
scan_for_exiting: task is dead
do_rpp: got a resource monitor request
do_rpp: got a resource monitor request

And in mom_logs:

04/13/2007 15:14:38;0001;   pbs_mom;Job;TMomFinalizeJob3;job 
1786.xxxxxx.offis.uni-oldenburg.de started, pid = 4422
04/13/2007 15:14:38;0080; 
pbs_mom;Job;1786.xxxxxx.offis.uni-oldenburg.de;scan_for_terminated: job 
1786.xxxxxx.offis.uni-oldenburg.de task 1 terminated, sid 4422
04/13/2007 15:14:38;0008; 
pbs_mom;Job;1786.xxxxxx.offis.uni-oldenburg.de;job was terminated

The logged output does not differ when I use "#PBS -k oe" in the script 
above.

After the job completes, the following files are created on the submit 
machine:

-rw------- 1 jploski users 0 2007-04-13 15:23 jpl1.ERR
-rw------- 1 jploski users 0 2007-04-13 15:23 jpl1.OUT

Enabling mail notification ("#PBS -m abe") does not produce any clues (job 
completes normally).

Best regards -
Jan Ploski 

--
Dipl.-Inform. (FH) Jan Ploski
OFFIS
Betriebliches Informationsmanagement
Escherweg 2  - 26121 Oldenburg - Germany
Fon: +49 441 9722 - 184 Fax: +49 441 9722 - 202
E-Mail: Jan.Ploski at offis.de - URL: http://www.offis.de