[torqueusers] reducing energy usage of torque

Gareth.Williams at csiro.au Gareth.Williams at csiro.au
Mon Feb 27 16:35:07 MST 2012


Hi Arka,

Your approach seems fine. There should be no particular complications, just take sufficient care to ensure that nodes are actually idle. The nodes are essentially stateless for your purpose.

Gareth

From: Arka Aloke Bhattacharya [mailto:arkaaloke at gmail.com]
Sent: Monday, 27 February 2012 10:24 AM
To: torqueusers at supercluster.org
Subject: [torqueusers] reducing energy usage of torque

Hi everyone,

I am a PhD student at UC Berkeley, and I wanted to add a "turning off idle/underutilized servers" feature to our 100 server torque+maui deployment. However, I want to implement this feature using only existing torque+ maui interfaces and extensions ( i,e without modifying the torque or maui source code in any way ).

My proposed way is to
1. monitor the maui queue length , and estimate the number of servers I can switch off.
2. I would then use "pbsnodes -o <nodename>" command to render a certain number of servers offline for scheduling.
3. A bash script would turn the servers off.

The servers would be turned back on (and added to the torque nodes list) when the queue length increases beyond a certain threshold.

I had two questions :

1. Is there any existing open source code which already implements the "turning off idle servers" functionality in torque ?
2. Are there complications that would arise if I implemented the "turning-off idle servers" feature in my proposed way ? [ e.g - Is it possible that after turning off servers, they would lose some state and hence would not get added to the torque <nodes_list> when turned back on? Are there long lived TCP connections which need to be restarted separately ? , etc ]

It would be great if anyone could help.

Thanks a lot,
Arka.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://www.supercluster.org/pipermail/torqueusers/attachments/20120228/0fd7a45a/attachment.html 


More information about the torqueusers mailing list