[Mauiusers] Maximum 4096 node?

Michael Barnes Michael.Barnes at jlab.org
Wed Dec 5 14:23:09 MST 2007


On Wed, Dec 05, 2007 at 09:42:27PM +0100, Roy Dragseth wrote:
> Do anyone know if there are some hidden limit of 4096 cpus in maui?
> 
> Testing shows that a 4096 cpu job will start but not a 4097 cpu job.  I found 
> this in the maui log:
> 
> 12/05 21:37:59 
> MQueueSelectJobs(SrcQ,DstQ,HARD,5120,4096,2140000000,EVERY,FReason,FALSE)
> 12/05 21:37:59 INFO:     total jobs selected in partition ALL: 0/1 [NodeCount: 
> 1]
> 12/05 21:37:59 
> MQueueSelectJobs(SrcQ,DstQ,SOFT,5120,4096,2140000000,EVERY,FReason,TRUE)
> 12/05 21:37:59 INFO:     total jobs selected in partition ALL: 0/1 [NodeCount: 
> 1]
> 12/05 21:37:59 
> MQueueSelectJobs(SrcQ,DstQ,HARD,5120,4096,2140000000,EVERY,FReason,TRUE)
> 12/05 21:37:59 INFO:     total jobs selected in partition ALL: 0/1 [NodeCount: 
> 1]
> 12/05 21:37:59 
> MQueueSelectJobs(SrcQ,DstQ,SOFT,5120,4096,2140000000,EVERY,FReason,TRUE)
> 12/05 21:37:59 INFO:     total jobs selected in partition ALL: 0/1 [NodeCount: 
> 1]
> 
> Do any one know how to increase this limit?


I guess hack at the following:

~/src/maui-3.2.6p19% grep -r 4096 .
./contrib/UI/mauireswww/mauireswww.c:  for (size=4096; size>=1; size/=2) {
./src/mcom/MSec.c:  if ((*Pos != -1) && ((X - *Pos) < 4096))
./src/mcom/MSec.c:  int Hash[4096];
./src/mcom/MSec.c:  for (Key = 0;Key < 4096;Key++)
./include/msu.h:#define SUDEF_CPBUFFERSTEPSIZE      4096
./include/msched.h:#define MMAX_JOB           4096
./include/msched.h:#define MAX_MJOB_TRACE     4096
./include/msched-common.h:# define MAX_MTASK         4096


That was a quick look, but it does seem to have 4096 hardcoded in a few
places.  I would also check where all of the #defines are used, but it
_should_ work with some effort.

Good luck,

-mb

-- 
+-----------------------------------------------
| Michael Barnes
|
| Thomas Jefferson National Accelerator Facility
| 12000 Jefferson Ave.
| Newport News, VA 23606
| (757) 269-7634
+-----------------------------------------------


More information about the mauiusers mailing list