[gold-users] Enforce charging of actual processor use vs. requested tasks

Steve Jones stevejones at stanford.edu
Thu Aug 1 15:59:16 MDT 2013


Hi,

I'm looking for a way to charge based on total processors used on a node versus tasks requested.

I'm currently running torque 2.5.3, maui 3.2.6p21 and gold 2.2.0.5

I have a maui node access policy of singlejob that from memory displays showq status as "24" regardless of number of processors requested with "ppn=", shown below.

Our basic configuration is as follows:

maui.cfg
AMCFG[bank] TYPE=GOLD SERVER=gold://some.server.com:7112 SOCKETPROTOCOL=HTTP WIREPROTOCOL=XML CHARGEPOLICY=DEBITALLBLOCKED JOBFAILUREACTION=IGNORE NODECHARGEPOLICY=MAX TIMEOUT=15
NODEACCESSPOLICY      SINGLEJOB
NODEALLOCATIONPOLICY  MINRESOURCE
JOBNODEMATCHPOLICY      EXACTNODE


A typical entry in the nodes file looks like this:
compute-124-4 np=24 compute


I've submitted three jobs, nodes=1:ppn=1, nodes=1:ppn=12, nodes=1:ppn=24, running with 24 processors on each node (fluent mpi tasks=24):
job id: 269559
qsub -I -lnodes=1:ppn=1  -lwalltime=1:00:00
job id: 269559
qsub -I -lnodes=1:ppn=24  -lwalltime=1:00:00
job id: 269560
qsub -I -lnodes=1:ppn=12  -lwalltime=1:00:00


When I run showq it shows all three jobs with 24 processors, though above you can see the values are different:
269558              userA    Running    24    00:58:20  Thu Aug  1 14:16:26
269559              userA    Running    24    00:58:25  Thu Aug  1 14:16:31
269560              userA    Running    24    00:58:27  Thu Aug  1 14:16:33



When I check details on the transactions after jobs complete the charges reflect what the user requested for tasks, but the job actually used 24 processors for each run:
269558
WallDuration=581,Processors=24,QualityOfService=default,Queue=default,Type=job,ItemizedCharges:=( ( ( 24 [Processors] * 0.0084 [ChargeRate{VBR}{Processors}] ) ) * 581 [WallDuration] ) = 117 

269559
WallDuration=566,Processors=1,QualityOfService=default,Queue=default,Type=job,ItemizedCharges:=( ( ( 1 [Processors] * 0.0084 [ChargeRate{VBR}{Processors}] ) ) * 566 [WallDuration] ) = 5 

269560
WallDuration=576,Processors=12,QualityOfService=default,Queue=default,Type=job,ItemizedCharges:=( ( ( 12 [Processors] * 0.0084 [ChargeRate{VBR}{Processors}] ) ) * 576 [WallDuration] ) = 58 


What I'd like to accomplish is to enforce charging for use of a full node, rather than userA requesting nodes=1:ppn=1 and actually using all processors on the node.

Any way to achieve this? Or do I need to re-think the node access policies in maui?

Steve


More information about the gold-users mailing list