[Mauiusers] maui-3.3 logs verbosity

Arnau Bria arnaubria at pic.es
Mon Jan 10 03:42:39 MST 2011


Hi all,

we've upgraded maui from 3.2 to 3.3 and noticed some less verbosity in
logs in some kind of jobs (failing ones). Seems that maui log does not
say job-node relation in some "failing" jobs. 


In previous versions we used :

grep 15025090 /var/log/maui.log|grep td

*(all our wn name start with "td", so I grep by td)

to find the node, and now it does not work:

# grep 15025090 /var/log/maui.log|grep  td
#
# grep 15025090 /var/log/maui.log
01/10 11:27:58 MPBSJobLoad(15025090,15025090.pbs03.pic.es,J,TaskList,0)
01/10 11:27:58 MReqCreate(15025090,SrcRQ,DstRQ,DoCreate)
01/10 11:27:58 INFO:     job '15025090' loaded:   1 atprd005    atprd  28800       Idle   0 1294655237   [NONE] [NONE] [NONE] >=      0 >=      0 [test] 1294655273
01/10 11:28:18 INFO:     4 feasible tasks found for job 15025090:0 in partition DEFAULT (1 Needed)
01/10 11:28:18 INFO:     tasks located for job 15025090:  1 of 1 required (4 feasible)
01/10 11:28:18 MJobStart(15025090)
01/10 11:28:18 MRMJobStart(15025090,Msg,SC)
01/10 11:28:18 MPBSJobStart(15025090,base,Msg,SC)
01/10 11:28:19 INFO:     job '15025090' successfully started
01/10 11:28:19 INFO:     starting job '15025090'
01/10 11:29:43 MJobDestroy(15025090)

and this is torque's node log:

$ grep 15025038 /var/spool/pbs/mom_logs/20110110
01/10/2011 11:20:40;0001;   pbs_mom;Svr;pbs_mom;LOG_ERROR::Permission denied (13) in TMakeTmpDir, Unable to make job transient directory: /home/tmp/15025038.pbs03.pic.es
01/10/2011 11:20:40;0001;   pbs_mom;Svr;pbs_mom;LOG_ERROR::start_exec, cannot create temp dir '/home/tmp/15025038.pbs03.pic.es'
01/10/2011 11:20:40;0008;   pbs_mom;Req;send_sisters;sending ABORT to sisters for job 15025038.pbs03.pic.es
01/10/2011 11:20:40;0080;   pbs_mom;Job;15025038.pbs03.pic.es;obit sent to server


so, as you can see, the job has been dispatched to the node, but maui
is not logging that.

I've tried to increase verbosity until 4, but then, logs are so big
that they waste more than 15GB of disk space (too much).

I've looked to configurable parameters (showconfig) and I don't see
if this has become a configurable feature.

So, anyone knows who to re-enable destination-host info for failing
jobs in maui logs? 


TIA,
Arnau


More information about the mauiusers mailing list