[torqueusers] OpenMPI and version changed to Torque

[Peter A Ruprecht]

On 6/29/12 10:54 AM, "Axel Kohlmeyer" <akohlmey at cmm.chem.upenn.edu> wrote:

>On Fri, Jun 29, 2012 at 12:12 PM, David Beer
><dbeer at adaptivecomputing.com> wrote:
>> Peter,
>>
>> I am under the impression that the different sites running 4.x (either
>>on
>> test or production systems) haven't had to recompile their version of
>>MPI.
>> It'd be nice to hear input from different admins on this subject, but my
>> impression is that this isn't necessary, and I know that we didn't
>>change
>> the tm interface. I will respond to some of your other questions below.
>
>you did change the soname of libtorque.so, right?
>
>this is likely what keeps OpenMP from failing,
>since the corresponding plugin won't load anymore.
>here is the ldd output from an OpenMPI 1.4.x installation
>on a Torque 2.5.5 machine:
>
>[akohlmey at login2 openmpi]$ ldd mca_ras_tm.so
>	linux-vdso.so.1 =>  (0x00002aaaaaacb000)
>	libtorque.so.2 => /opt/torque-2.5.5/lib/libtorque.so.2
>(0x00002aaaaaed0000)
>	libnsl.so.1 => /lib64/libnsl.so.1 (0x00002aaaab1f1000)
>	libutil.so.1 => /lib64/libutil.so.1 (0x00002aaaab40a000)
>	libm.so.6 => /lib64/libm.so.6 (0x00002aaaab60d000)
>	libpthread.so.0 => /lib64/libpthread.so.0 (0x00002aaaab892000)
>	libc.so.6 => /lib64/libc.so.6 (0x00002aaaabaae000)
>	/lib64/ld-linux-x86-64.so.2 (0x00002aaaaaaab000)
>
>if there are no changes in the ABI (of what OpenMPI uses),
>the workaround for keeping OpenMPI happy and working
>may be as simple as doing a symlink from libtorque.so.4
>to libtorque.so.2.
>
>alternatively, i would try to recompile/relink only the one plugin
>and (mca_ras_tm.so) and replace it in the OpenMPI installation.
>
>OpenMPI has a very modular structure and none of the application
>binaries reference the plugin dependencies unless OpenMPI was
>compile for static linkage only.
>
>HTH,
>    axel.

Thanks Axel, great suggestions.  The MPI development experts here assured
me that the ldd output looked correct when they were testing, but I'll
double-check that.

Since the t-m interface hasn't changed (thanks for the quick responses Ken
and David) I'll start looking for possible installation-related problems.

 -Pete