[torquedev] Re: [torqueusers] Fwd: [O-MPI users] OpenMPI 1.0.1 with Torque 2.0

[Jeff Squyres]

BTW, if your CVS or SVN is open for anonymous checkout, I *might*  
have some time to help switch over your build system to AC + AM + LT  
in the next few weeks.


On Jan 3, 2006, at 5:21 PM, Garrick Staples wrote:

> We can't just make a shared object that matches each shared object we
> build.  I think people would get upset at clobbering some "libnet.so".

But you'll have that problem anyway, even if it's libnet.a.   
Specifically, if you have a Torque libnet.a and a system libnet.so  
both in the same directory, Bad Things will happen (for lack of a  
longer, banal explanation).

FWIW, I don't think I've ever seen PBS/Torque installed under /usr.

> And we can't limit ourselves to just building libpbs.so, because other
> programs need the other libs.

I'm assume you mean other 3rd party apps, right?  Internal to Torque,  
I'm assuming you'd be willing to change all linkage.

What libraries do 3rd party apps link to (that you're aware of)?  LAM  
and Open MPI link to libpbs only.

> Unless we just always install into a private torque lib directory, but
> then linking 3rd party stuff is more complicated because that requires
> rpaths.

True (or LD_LIBRARY_PATH or ld_so.conf).  Such is the price of shared  
libraries...

> I think the best solution for TORQUE is to make one libtorque.so, but
> that complicates things for the 3rd party builders.

That makes it slightly more difficult for me, for example, because  
right now we *always* look for libpbs.  It wouldn't be hard to add a  
search for libtorque, but we'd have to add a little to our configure  
scripts.

> That's why I wanted to know what PBS Pro does.  Do they make  
> liblog.so,
> libnet.so, etc.?

Here's an ls of $prefix/lib from a local PBS Pro installation:

[17:26] /usr/pbs/lib % ls -la
total 4412
drwxr-xr-x    5 root     root         4096 Jul 11 17:34 ./
drwxr-xr-x    9 root     root         4096 Jul 11 17:34 ../
-rw-r--r--    1 root     root       470170 Jan 15  2004 libattr.a
-rw-r--r--    1 root     root       421530 Jan 15  2004 libcmds.a
-rw-r--r--    1 root     root       125716 Jan 15  2004 liblog.a
-rw-r--r--    1 root     root       161176 Jan 15  2004 libnet.a
-rw-r--r--    1 root     root      2137866 Jan 15  2004 libpbs.a
-rw-r--r--    1 root     root       156262 Jan 15  2004 libsite.a
-rw-r--r--    1 root     root       983052 Jan 15  2004 pbs_sched.a
drwxr-xr-x    2 root     root         4096 Feb  9  2005 pm/
drwxr-xr-x    5 root     root         4096 Jul 11 17:34 xpbs/
drwxr-xr-x    4 root     root         4096 Jul 11 17:34 xpbsmon/

Looks like no shared libraries at all.

--
{+} Jeff Squyres
{+} The Open MPI Project
{+} http://www.open-mpi.org/