Moab-SGE Integration Guide

Moab-SGE Integration Guide

Overview:

   Moab can be used as an external scheduler for the Sun Grid Engine (SGE) resource management system (requires SGE v6.0 source distribution).  In this configuration, SGE manages the job queue and the compute resources while Moab queries the SGE Server to obtain up to date job, node, and configuration information.  Using this information, Moab directs SGE to manage jobs in accordance with specified Moab policies, priorities, and reservations.
 

Steps:

   Moab drives SGE via the SGE scheduling API.  To enable Moab scheduling, the following steps must be taken:

1)    Download/Install SGE

   Download

   SGE Install Overview


2)    Install Moab
  • untar Moab distributionfile
  • cd into the moab-<X>directory
  • run ./configure

  The configure script will automatically setup Moab so that the user running configure will become the default Primary Moab Administrator, $MOABADMIN.  This can be changed by modifying the 'ADMIN <USERNAME>' line in the moab.cfg file.  The primary administrator is the first user listed after the ADMIN1 parameter and is the ID under which the Moab daemon will run.

3)    Configure SGE
  • Set default PE (i.e.,qconf -ap default and add line '-pe default 1' to file $SGE_ROOT/default/common/sge_request, See SGE man page sge_pe.5 for more information)
  • Optional - Set default walltime for jobs (add line '-l h_rt=<limit>' to file $SGE_ROOT/default/common/sge_request)
  • disable default SGE scheduler (edit $SGE_ROOT/default/common/rcsge and comment out the line starting sge_schedd.)
  • If not the same user, add Moab's Primary Admin User as SGE operator (use 'qconf -am <user>')

All jobs submitted to Moab must be assigned a PE.  Jobs without an assigned PE will have a batch hold placed upon them.


4)    Configure Moab

        - specify SGE as the resource manager:

            This should be taken care of by 'configure', but if not, the following parameter must be specified in the moab.cfg file:

         RMCFG[base] TYPE=SGE

            If you have a non-standard SGE configuration, you may need to specify additional Moab parameters to point Moab to the right location:

        RMCFG[base] HOST=$SGESERVERHOST
        RMCFG[base] PORT=$SGESERVERPORT

    (See the Resource Manager Overview for more information)


5)    Start Daemons

  1. start SGE
    • issue command '$SGE_ROOT/default/common/rcsge' as user root
  2. start Moab
    • source $SGE_ROOT/default/common/settings.sh
    • issue command 'moab' as Primary Moab Admin user

Current Issues:

    <N/A>  


Trouble-shooting:

    <N/A>

See Also
© 2001-2008 Cluster Resources, Incorporated