[Mauiusers] Preferential Nodes?

Donald Tripp dtripp at hawaii.edu
Fri Jul 6 01:59:21 MDT 2007


Another option is to create a resource called Myrinet, then list the  
nodes with that resource, and require users which use Myrinet jobs to  
request the resource Myrinet.  That way jobs which do not use Myrinet  
can run on any node.


- Donald Tripp
   dtripp at hawaii.edu
----------------------------------------------
HPC Systems Administrator
High Performance Computing Center
University of Hawai'i at Hilo
200 W. Kawili Street
Hilo,   Hawaii   96720
http://www.hpc.uhh.hawaii.edu


On Jul 5, 2007, at 7:39 PM, Chris Samuel wrote:

> On Fri, 25 May 2007, Randy Philipp wrote:
>
>> I am currently running a cluster with several nodes that have lost  
>> their
>> Myrinet cards.  I wanted to make these nodes available to run serial
>> jobs without restricting the jobs to these nodes, preferentially
>> scheduling the jobs to run the Myrnetless nodes first.
>
> What we do is list the nodes that have lost their Myrinet cards  
> (must be
> catching) in a standing reservation that only permits jobs  
> requesting 1 CPU
> to run on them.
>
> It's not perfect, theoretically someone could build their serial  
> code with a
> Myrinet enabled MPICH and find they get an error when the MPI stack  
> tries to
> do the Myrinet DMA allocations and fails because it can't get to  
> the card,
> but we've not seen that happen.
>
> Here is what is in our current Moab configuration, but it should  
> work in Maui
> (caveat emptor, batteries not included, etc).
>
> SRCFG[nomyrinet] STARTTIME=0:0:0 ENDTIME=23:59:59
> SRCFG[nomyrinet] DEPTH=30
> SRCFG[nomyrinet] HOSTLIST=node009,node035,node062,node084,node085
> SRCFG[nomyrinet] PROCLIMIT=1
> SRCFG[nomyrinet] PERIOD=INFINITY
> SRCFG[nomyrinet] ACCESS=DEDICATED FLAGS=ignstate
>
> Best of luck!
> Chris
> -- 
>  Christopher Samuel - (03)9925 4751 - VPAC Deputy Systems Manager
>  Victorian Partnership for Advanced Computing http://www.vpac.org/
>  Bldg 91, 110 Victoria Street, Carlton South, VIC 3053, Australia
>
> _______________________________________________
> mauiusers mailing list
> mauiusers at supercluster.org
> http://www.supercluster.org/mailman/listinfo/mauiusers

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://www.supercluster.org/pipermail/mauiusers/attachments/20070705/db5c5171/attachment.html


More information about the mauiusers mailing list