[Mauiusers] MPI / IB setup

[Alexis Cousein]

Jacques Foury wrote:
> Hello all.
> 
> 
> we have here a setup of Infiniband nodes, grouped around IB switches.
> 
> I wonder if it's possible to have MPI jobs run on a set of nodes that 
> are connected on the *same* IB switch.
> 
> I thought about special attributes for the nodes, but it is by no way 
> dynamical.
> 
> 
> 
> Let me be more precise :
> - we have 64 nodes, connected by groups of 4 nodes per chassis.
> - we have 4 "leaves" IB switches, all receiving 16 nodes (4 chassis) IB 
> plugs.
> ... and 2 more spine IB switches.
> 
> 
> We want the jobs fitting on 16 nodes to run on a set of nodes all 
> connected to the same leaf switch.
> 
> Does anyone have already configured such a setup ?
> 
http://www.clusterresources.com/products/maui/docs/8.3nodesetoverview.shtml

Haven't used it in Maui, but I have used it in MOAB. AFAIK, that's
exactly designed for this purpose.