[torqueusers] Problems with maui scalability

Peter Wyckoff wyckoff at yahoo-inc.com
Wed Sep 5 14:12:51 MDT 2007


Hi Miles,

I'm wondering how big you've gotten maui and torque to scale, mostly
interested in number of nodes?

The docs say something like 1,000 but I think it scales well beyond that,
no?

Thanks, pete



On 8/17/07 12:48 PM, "Miles O'Neal" <meo at intrinsity.com> wrote:

> Howdy, Ronny...
> 
> |1) How can I tell maui that it's OK to only consider the first 4K jobs?
> |2) How can I keep maui playing along nicely.
> |3) How can I keep my 14 CPUs busy
> 
> Are you using routing queues?  You can set the routing
> queues for a huge number of jobs, but have them feed
> run queues that allow a smaller number of jobs.  That
> was one of the things we had to do to get torque/maui
> to even get safely to 2,000 jobs queued (we have a lot
> more nodes, which impacts things as well).
> _______________________________________________
> torqueusers mailing list
> torqueusers at supercluster.org
> http://www.supercluster.org/mailman/listinfo/torqueusers



More information about the torqueusers mailing list