[Mauiusers] Maui double dipping to the AM

Garrick Staples garrick at usc.edu
Fri Aug 27 17:30:39 MDT 2004


maui-3.2.6-p6.1079990700
torque-1.0.1-0.p6
qbank-2.11.0

It seems that Maui is overcharging some users.  I haven't figured out the
pattern yet, but I believe specifying "nodes=XXppn=1" where XX > 1 triggers
the problem.

From torque's accounting:
08/26/2004 13:50:33;Q;2548.hpc-master.usc.edu;queue=default
08/26/2004 13:50:33;Q;2548.hpc-master.usc.edu;queue=medium
08/26/2004 13:50:33;Q;2548.hpc-master.usc.edu;queue=main
08/26/2004 13:50:36;S;2548.hpc-master.usc.edu;user=pap group=chem-ar account=lc_seb jobname=run.test queue=main ctime=1093553433 qtime=1093553433 etime=1093553433 start=1093553436 exec_host=hpc0573/0+hpc0563/0+hpc0562/0+hpc0561/0+hpc0560/0+hpc0559/0+hpc0558/0+hpc0557/0+hpc0556/0+hpc0555/0 Resource_List.neednodes=hpc0573+hpc0563+hpc0562+hpc0561+hpc0560+hpc0559+hpc0558+hpc0557+hpc0556+hpc0555 Resource_List.nodect=10 Resource_List.nodes=10:ppn=1 Resource_List.walltime=10:00:00 
08/26/2004 18:32:33;E;2548.hpc-master.usc.edu;user=pap group=chem-ar account=lc_seb jobname=run.test queue=main ctime=1093553433 qtime=1093553433 etime=1093553433 start=1093553436 exec_host=hpc0573/0+hpc0563/0+hpc0562/0+hpc0561/0+hpc0560/0+hpc0559/0+hpc0558/0+hpc0557/0+hpc0556/0+hpc0555/0 Resource_List.neednodes=10:ppn=1 Resource_List.nodect=10 Resource_List.nodes=10:ppn=1 Resource_List.walltime=10:00:00 session=13461 end=1093570353 Exit_status=0 resources_used.cput=00:00:00 resources_used.mem=26292kb resources_used.vmem=55460kb resources_used.walltime=04:41:47

From qbank's bnklog:
REQUEST=COMMAND=make_reservation AUTH=maui MACHINE=hpc ACCOUNT=lc_seb USER=pap WCLIMIT=36000 PROCCOUNT=10 QOS=DEFAULT CLASS=[DEFAULT] NODETYPE=DEFAULT TYPE=maui JOBID=2548 JOBTYPE=job NODES=10
REQUEST=COMMAND=remove_reservation AUTH=maui ACCOUNT=lc_seb JOBID=2548
REQUEST=COMMAND=make_withdrawal AUTH=maui MACHINE=hpc ACCOUNT=lc_seb USER=pap WCTIME=852 PROCCOUNT=20 PROCCRATE=1.00 QOS=DEFAULT CLASS=[DEFAULT] NODETYPE= JOBID=2548 JOBTYPE=job NODES=10
REQUEST=COMMAND=remove_reservation AUTH=maui ACCOUNT=lc_seb JOBID=2548
REQUEST=COMMAND=make_withdrawal AUTH=maui MACHINE=hpc ACCOUNT=lc_seb USER=pap WCTIME=2359 PROCCOUNT=20 PROCCRATE=1.00 QOS=DEFAULT CLASS=[DEFAULT] NODETYPE= JOBID=2548 JOBTYPE=job NODES=10
REQUEST=COMMAND=remove_reservation AUTH=maui ACCOUNT=lc_seb JOBID=2548
REQUEST=COMMAND=make_withdrawal AUTH=maui MACHINE=hpc ACCOUNT=lc_seb USER=pap WCTIME=2631 PROCCOUNT=20 PROCCRATE=1.00 QOS=DEFAULT CLASS=[DEFAULT] NODETYPE= JOBID=2548 JOBTYPE=job NODES=10
REQUEST=COMMAND=remove_reservation AUTH=maui ACCOUNT=lc_seb JOBID=2548
REQUEST=COMMAND=make_withdrawal AUTH=maui MACHINE=hpc ACCOUNT=lc_seb USER=pap WCTIME=3204 PROCCOUNT=20 PROCCRATE=1.00 QOS=DEFAULT CLASS=[DEFAULT] NODETYPE= JOBID=2548 JOBTYPE=job NODES=10
REQUEST=COMMAND=remove_reservation AUTH=maui ACCOUNT=lc_seb JOBID=2548
REQUEST=COMMAND=make_withdrawal AUTH=maui MACHINE=hpc ACCOUNT=lc_seb USER=pap WCTIME=3421 PROCCOUNT=20 PROCCRATE=1.00 QOS=DEFAULT CLASS=[DEFAULT] NODETYPE= JOBID=2548 JOBTYPE=job NODES=9
REQUEST=COMMAND=remove_reservation AUTH=maui ACCOUNT=lc_seb JOBID=2548
REQUEST=COMMAND=make_withdrawal AUTH=maui MACHINE=hpc ACCOUNT=lc_seb USER=pap WCTIME=3633 PROCCOUNT=20 PROCCRATE=1.00 QOS=DEFAULT CLASS=[DEFAULT] NODETYPE= JOBID=2548 JOBTYPE=job NODES=10
REQUEST=COMMAND=remove_reservation AUTH=maui ACCOUNT=lc_seb JOBID=2548
REQUEST=COMMAND=make_withdrawal AUTH=maui MACHINE=hpc ACCOUNT=lc_seb USER=pap WCTIME=4292 PROCCOUNT=20 PROCCRATE=1.00 QOS=DEFAULT CLASS=[DEFAULT] NODETYPE= JOBID=2548 JOBTYPE=job NODES=10

See how all of the withdrawal's PROCCOUNT are doubled? 

I don't have maui's logs since they are currently rotating too fast.


-- 
Garrick Staples, Linux/HPCC Administrator
University of Southern California
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 189 bytes
Desc: not available
Url : http://www.supercluster.org/pipermail/mauiusers/attachments/20040827/83667fc1/attachment.bin


More information about the mauiusers mailing list