[torqueusers] torque accounting - summary per queue ?

Sreedhar Manchu sm4082 at nyu.edu
Thu Aug 22 09:54:18 MDT 2013


Hi Chris,

We here at NYU also use UbMoD (old version). We use this to get per-user,
per-group as well as per-queue information (for example how many jobs were
run under a specific queue). It doesn't give any information about idle
jobs though.

For an example, this is what it looks like: ( I took out the real netids)

# queue.py bigmem
bigmem
  User  Number of Jobs  CPU Cores Used  CPU Time (h)  Used Time (h)
 Walltime (h)
 user1               1              24        0.4814         0.1192
96.0000
 user2               1              24        0.3314         0.1586
 0.6667
 user3               2               4       40.8778        40.8811
 192.0000
 user4              3              28       12.5278        12.5386
 144.0000
 user5               7             184     1054.3161       108.8275
 444.0000
 user6               8             156        7.8814         7.9039
 384.0000
 user7               9              96       76.5414        14.1222
84.0000
 user8               9             144        1.9125         2.8325
 216.0000
 user9              11             162       99.8969        99.0467
 816.0000
 user10              19            1612     1571.8494       211.2658
1536.0000
 user11             27            1488     6210.1456      1050.5697
3600.0000
 user12              31             928     4147.9892       265.5856
2976.0000
 user13             37              74        1.0750         1.1222
3552.0000
 user14            40             704      652.9183       604.0575
2018.0000
 user15              41             948     7962.6314       733.4542
3792.0000
 user16             88             176       76.5419        76.9297
 692.5000
 user17             348            8472     6246.9650       651.8536
6012.0000
 user18             553           13248    10758.2558       959.6442
 51694.7000
 Total            1235           28472    38923.1383      4840.9128
 78249.8667


I am not sure you're looking to find something like this. This script gets
information from UbMoD database and spits out information based on
arguments such as time, etc.

I would be interested in seeing what others use. By the way thanks for
mentioning and giving links to pbsacct.

Regards,
Sreedhar

Sreedhar Manchu
HPC Support Specialist
eSystems & Research Services
New York University, New York 10012



On Thu, Aug 22, 2013 at 11:34 AM, Chris Hunter <chris.hunter at yale.edu>wrote:

> Can anyone suggest a method to provide per-queue summary information
> based on torque accounting files ?
>
> We have software such as ubmod, and custom scripts such as pbsacct to
> provide per-user and per-group information but we would like to provide
> summary information for each queue. In particular, how many running and
> idle jobs for each queue.
>
> regards,
> chris hunter
> yale hpc group
>
> 1 ubmod - http://ubmod.sourceforge.net/
> 2 pbsacct - ftp://ftp.fysik.dtu.dk/pub/Torque/
> _______________________________________________
> torqueusers mailing list
> torqueusers at supercluster.org
> http://www.supercluster.org/mailman/listinfo/torqueusers
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://www.supercluster.org/pipermail/torqueusers/attachments/20130822/03aebe9b/attachment.html 


More information about the torqueusers mailing list