Loadleveler Notes

Sample Code:

Loadleveler submit filter (developed by PNNL) to perform initial job sanity checks, support MP_ACCOUNT, MP_QOS, MP_WCLIMIT, and MP_QUEUEJOB and wake up maui for rapid job processing.
 

Additional Requirements:

    RESTART state API
    BLOCKINGFACTOR value via API
    NODECOUNT vs TASKCOUNT vs TASKSPERNODE info
    ARBITRARY GEOMETRY via API
    ability to 'flush' running job.
    ability to send arbitrary sting to 'pending' interactive job.
    ll_modify (requirements, wallclocklimit, account.  user vs admin)
 

Issues:

    LL Messages are not being directed to API
    Node configured class list contains corrupt pointers (SDSC/PNNL)
    LL-Maui API completely fails (ASC)
    'MP_QUEUE' not supported (need changes to MP_RETRY/poe retry behavior)
    MP_WCLIMIT, MP_REQUIREMENTS, MP_ACCOUNT (LOADL_STEP_ACCT?)
 

Testing Remaining:

   Arbitrary Geometry
 

Long Term:

    Workload Management (logical partitioning)
    Suspend-Resume
    Checkpoint-Restart
    Job Migration
    Gang Scheduling Support
    Credential Management (refresh)
    Open Source
    Event Driven API
    Command Language Translation (filter)
    Dynamic Job Support (MPI-2)

 
Setup:

  To properly use interactive jobs, you will need to set the following to prevent users from circumventing the resource manager/scheduler (LL/Maui)

    Set 'MP_RESD=YES' in /etc/environment
    Set 'MP_USE_LL=YES' in /etc/poe.limits
 

Notes:

    Set 'LLAPIERRORMSGS=yes" to obtain internal debug messages from the LL API.