[torqueusers] Queue Routing, Unexpected Behavior
Jason Williams
jasonw at jhu.edu
Wed Jun 3 07:25:36 MDT 2009
So I have set up some queue routing to test out an idea to have a
different max wall clock time for a job depending on how many CPU's it
requires. I figured, from reading the online docs, that this could be
done via queue routing. I've put my queue config at the bottom of this
email. The CPU count seems to be routing the job correctly, but the
expected behavior of the different resources_max.walltime settings per
queue routing destination seem to have no effect. Is what I am trying
to do actually possible? One other setting that is set, but not
included in the listing below for security reasons, is the acl_users
setting. I don't see any reason why that would effect it, but I figured
I would mention it for completeness. The job I tested requests 8 CPU's
and 120:00:00 of wall clock. It winds up in the default_all queue which
seemingly violates the resources_max.walltime setting. Is is a possible
bug or am I not understanding how the routing works 100%...
Thanks
--
Jason Williams
Systems Administrator
Physics and Astronomy Department
Johns Hopkins University
--- Queue Routing Setup Follows ---
create queue default
set queue default queue_type = Route
set queue default route_destinations = default_1
set queue default route_destinations += default_4
set queue default route_destinations += default_all
set queue default enabled = True
set queue default started = True
#
# queue for jobs using 1 cpu
create queue default_1
set queue default_1 queue_type = Execution
set queue default_1 resources_max.ncpus = 1
set queue default_1 resources_max.walltime = 168:00:00 # 7 days
set queue default_1 enabled = True
set queue default_1 started = True
#
# queue for jobs using more than 1 but less than 5 cpus
create queue default_4
set queue default_4 queue_type = Execution
set queue default_4 resources_min.ncpus = 2
set queue default_4 resources_max.ncpus = 4
set queue default_4 resources_max.walltime = 120:00:00 # 5 days
set queue default_4 enabled = True
set queue default_4 started = True
#
# queue for jobs using more than 5 cpus
create queue default_all
set queue default_all queue_type = Execution
set queue default_all resources_min.ncpus = 5
set queue default_all resources_max.walltime = 108:00:00 # 4.5 days
set queue default_all enabled = True
set queue default_all started = True
More information about the torqueusers
mailing list