[torqueusers] openmpi, pbsdsh, and iptables

[Ken Nielson]

When pbsdsh runs or MPI the Mother Superior opens two dynamic ports for all
of the sister nodes to connect to and send their stdout and stderr
information. The sister nodes use dynamic ports as well.

Ken

On Fri, Apr 27, 2012 at 1:09 PM, David Chin <chindw at wfu.edu> wrote:

> I am having some trouble getting openmpi-1.5.5 working with Torque
> integration, and I have narrowed down the issue to firewall rules.
>
> However, I am not sure which ports to open up.
>
> I compiled openmpi-1.5.5 on RHEL6 against the libtorque that
> EPEL provides -- version 2.5.7-9.el6. I found that openmpi jobs
> cannot communicate between nodes if iptables is running. I have
> also found, by starting an interactive job, that pbsdsh cannot
> connect to other nodes allocated for the job. Once I turn the
> firewall off on compute nodes openmpi jobs run fine.
>
> Our firewall rules *do* allow inter-node ssh, and I have verified
> that this is so.
>
> What port range can I open to allow pbsdsh to work?
>
> Thanks in advance,
>    Dave
>
> --
> David Chin, Ph.D.
> chindw at wfu.edu                  High Performance Computing Systems Analyst
> Office: +1.336.758.2964         Wake Forest University
> Mobile: +1.336.608.0793         Winston-Salem, NC
> Email-to-txt: 3366080793 at mms.att.net           Google Talk: chindw at wfu.edu
> Web: http://www.wfu.edu/~chindw
>      https://plus.google.com/108169173177119739731/about
> _______________________________________________
> torqueusers mailing list
> torqueusers at supercluster.org
> http://www.supercluster.org/mailman/listinfo/torqueusers
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://www.supercluster.org/pipermail/torqueusers/attachments/20120430/f153fddf/attachment.html