[torqueusers] qsub: Job rejected by all possible destinations

Weiguang Chen chenweiguang82 at gmail.com
Mon Jan 19 10:12:22 MST 2009


Hi,
Thank you very much for your reply.
What i was confused is the settings about huge basically is similar to
the other queues, such as below:

set queue default route_destinations += medium
# Create and define queue medium
create queue medium
set queue medium queue_type = Execution
set queue medium Priority = 80
set queue medium max_queuable = 5
set queue medium max_user_queuable = 2
set queue medium max_running = 3
set queue medium acl_user_enable = True
set queue medium acl_users = xxx at node1
set queue medium resources_max.ncpus = 16
set queue medium resources_max.nodect = 8
set queue medium resources_max.nodes = 8
set queue medium resources_max.walltime = 168:00:00
set queue medium resources_min.ncpus = 9
set queue medium resources_min.nodect = 5
set queue medium resources_min.nodes = 5
set queue medium resources_min.walltime = 00:00:01
set queue medium resources_default.walltime = 24:00:00
set queue medium max_user_run = 1
set queue medium enabled = True
set queue medium started = True

But this queue works well. The other settings i set are used to route
different kinds of job to the appropriate queue.
According to the script of submitted job, i thought it conform the
policy of huge queue.
Now, the job can been submitted to the default queue, but can not been
routed to the huge queue. below is the settings about default queue (
if queue isn't given by the users, jobs will be routed to default
queue):
create queue default
set queue default queue_type = Route
set queue default max_running = 15
set queue default route_destinations = tiny
set queue default route_destinations += verysmall
set queue default route_destinations += small
set queue default route_destinations += medium
set queue default route_destinations += huge
set queue default route_destinations += train
set queue default route_destinations += special
set queue default enabled = True
set queue default started = True
create queue default
set queue default queue_type = Route
set queue default max_running = 15
set queue default route_destinations = tiny
set queue default route_destinations += verysmall
set queue default route_destinations += small
set queue default route_destinations += medium
set queue default route_destinations += huge
set queue default route_destinations += train
set queue default route_destinations += special
set queue default enabled = True
set queue default started = True
set server default_queue = default

Happy Spring Festival (Chinese New Year, 牛年)

ChenWeiguang

On Mon, Jan 19, 2009 at 6:14 PM, Steve Young <chemadm at hamilton.edu> wrote:
> Hi,
>        I'm guessing that this line is messing you up:
>
>> set queue default route_destinations += huge
>
> The queue you have defined "huge" is not a routing queue it is an execution
> queue. I'd remove that. I might also remove a bunch of the other settings
> you have to start out with the basic's then add in the ones you want one at
> a time so you can test to make sure they work. Hope this helps,
>
> -Steve
>
>
>
> On Jan 17, 2009, at 10:11 AM, Weiguang Chen wrote:
>
>> Hi,
>> I noticed this question was asked and the URL is
>>
>> http://www.clusterresources.com/pipermail/torqueusers/2008-January/006698.html
>> But my trouble is difference from that. I want to submit a huge job:
>> #!/bin/bash
>> #PBS -N N-top
>> ###PBS -q huge
>> #PBS -o N-top.out
>> #PBS -e N-top.err
>> #PBS -l nodes=16:ppn=2,walltime=160:00:00
>>
>> and the queue huge is set by following:
>> # Create and define queue huge
>> create queue huge
>> set queue huge queue_type = Execution
>> set queue huge Priority = 40
>> set queue huge max_queuable = 2
>> set queue huge max_user_queuable = 1
>> set queue huge max_running = 1
>> set queue huge acl_user_enable = True
>> set queue huge acl_users = xxx at node1
>> set queue huge resources_max.ncpus = 32
>> set queue huge resources_max.nodect = 16
>> set queue huge resources_max.nodes = 16
>> set queue huge resources_max.walltime = 160:00:00
>> set queue huge resources_min.ncpus = 17
>> set queue huge resources_min.nodect = 8
>> set queue huge resources_min.nodes = 8
>> set queue huge resources_min.walltime = 00:00:01
>> set queue huge resources_default.walltime = 36:00:00
>> set queue huge max_user_run = 1
>> set queue huge enabled = True
>> set queue huge started = True
>> set queue default route_destinations += huge
>>
>> The message showed as the title while i submitted it. I checked the log:
>> 01/17/2009 22:40:39;0100;PBS_Server;Job;2389.node1;enqueuing into
>> default, state 1 hop 1
>> 01/17/2009 22:40:39;0008;PBS_Server;Job;2389.node1;Job rejected by all
>> possible destinations
>> 01/17/2009 22:40:39;0100;PBS_Server;Job;2389.node1;dequeuing from
>> default, state QUEUED
>> 01/17/2009 22:40:39;0080;PBS_Server;Req;req_reject;Reject reply
>> code=15039(Job rejected by all possible destinations), aux=0,
>> type=Commit, from xxx at node1
>> 01/17/2009 22:40:39;0040;PBS_Server;Svr;node1;Scheduler sent command term
>>
>> It confused me very much.
>> --
>> Best Wishes
>> ChenWeiguang
>>
>> ************************************************
>> #               Chen, Weiguang
>> #
>> #    Postgraduate,  Ph. D
>> #  75 University Road, Physics Buliding  #  218
>> #  School of Physics & Engineering
>> #  Zhengzhou University
>> #  Zhengzhou, Henan 450052  CHINA
>> #
>> #  Tel: 86-13203730117;
>> #  E-mail:chenweiguang82 at gmail.com;
>> #            chenweiguang82 at qq.com
>> #**********************************************
>> _______________________________________________
>> torqueusers mailing list
>> torqueusers at supercluster.org
>> http://www.supercluster.org/mailman/listinfo/torqueusers
>
>



-- 
Best Wishes
ChenWeiguang

************************************************
#               Chen, Weiguang
#
#    Postgraduate,  Ph. D
#  75 University Road, Physics Buliding  #  218
#  School of Physics & Engineering
#  Zhengzhou University
#  Zhengzhou, Henan 450052  CHINA
#
#  Tel: 86-13203730117;
#  E-mail:chenweiguang82 at gmail.com;
#            chenweiguang82 at qq.com
#**********************************************


More information about the torqueusers mailing list