[torqueusers] job run on single node when request for multiple nodes

[Govind]

Hi,

I have am openmpi build with tm support
When i run the mpi job requesting for two nodes and 4 core it run only on
single node.

>cat mpipbs-script.sh
#PBS -N mpipbs-script
#PBS -q short
### Number of nodes: resources per node
### (4 cores/node, so ppn=4 is ALL resources on the node)
#PBS -l nodes=2:ppn=4
echo `cat $PBS_NODEFILE`
NPROCS=`wc -l < $PBS_NODEFILE`
echo This job has allocated $NPROCS processors
/opt/openmpi-1.4.2/bin/mpirun /scratch0/gsongara/mpitest/hello

 It   show only one node here is the output
===============
node47.beowulf.cluster node47.beowulf.cluster node47.beowulf.cluster
node47.beowulf.cluster
This job has allocated 4 processors
Hello World! from process 1 out of 4 on node47.beowulf.cluster
Hello World! from process 2 out of 4 on node47.beowulf.cluster
Hello World! from process 3 out of 4 on node47.beowulf.cluster
Hello World! from process 0 out of 4 on node47.beowulf.cluster
===============

torque config
set queue short resources_max.nodes = 4
set queue short resources_default.nodes = 1
set server resources_default.neednodes = 1
set server resources_default.nodect = 1
set server resources_default.nodes = 1

I also trying adding this parameter to maui as advised in some  old thread
but does not help
JOBNODEMATCHPOLICY     EXACTNODE
ENABLEMULTINODEJOBS   TRUE
NODEACCESSPOLICY         SHARED


Can someone please advise if i missing anything here.

Regards
Govind
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://www.supercluster.org/pipermail/torqueusers/attachments/20100615/ff5fb98c/attachment.html