[Mauiusers] memory restriction
Jacques Foury
Jacques.Foury at math.u-bordeaux1.fr
Mon Jul 7 09:42:19 MDT 2008
Hi Abhishek,
Yes, yes, of course !
First of all mention a default memory amount in your queue definitions :
set queue q1sem16p resources_default.mem = 100mb
(I think it is bad if users don't care about the memory the consume !)
Then run a script in master's root's crontab doing :
STALLED=`qstat | grep " S " | grep -v Queue`
USERSTALLED=`qstat | grep " S " | grep -v Queue | awk '{print $3}'`
if [[ -n $STALLED ]]
then
echo $STALLED | /bin/mail -s"Batch stoppe" my at email.com
for i in $USERSTALLED
do
echo $MESSAGE | /bin/mail -s"Batch stoppe" $i at email.com
done
fi
Then you receive the mail and the user receives the mail too !
Abhishek Gupta a écrit :
> Hi Jacques,
> Thanks for your reply. If user do not mention the memory requirement,
> then it uses all the memory available on that node. The suggested
> method will only work if the user mention the memory required for the
> job. So is there any way that I put limit on the memory usage per core
> bases.
> Also I would like to receive the mails if there is any error on with
> any job. In PBS script, user only mention his own ID where mails for
> redirected. But is there any parameter which will allow me to receive
> a copy of all the error mails which goes to user as well.
> Thanks,
> Abhishek Gupta.
>
> Jacques Foury wrote:
>> Abhishek Gupta a écrit :
>>> Hi all,
>>> Is there any way that I can put an upper limit on memory consumption
>>> on each node so that any process do not consume whole of the memory?
>>> We have two different kind of nodes, one with 4 core and 2GB memory,
>>> and other one with 2 core 4GB memory.
>>> Abhishek Gupta.
>>
>> We just suspend jobs if they take more memory than announced with
>> #PBS -l mem=
>>
>> That works pretty well, and the admin can check what's wrong, and if
>> needed change the memory requirement manually with qalter.
>>
>>
>> Just put
>>
>> RESOURCELIMITPOLICY MEM:ALWAYS:SUSPEND
>>
>> in your maui.cfg
>>
--
Jacques Foury
Institut de Mathematiques de Bordeaux
http://www.math.u-bordeaux1.fr/maths/cellule
More information about the mauiusers
mailing list