Maui Cluster Scheduler

Appendix K:  Maui-Moab Differences Guide

Overview

   Maui Scheduler is a freely available cluster scheduler.  It is highly configurable and possesses powerful optimizations.  However, it is based on a older architectural design which limits its extensibility.  While it possesses great flexibility, the learning curve required to take advantage of these capabilities is significant.  Its architecture precludes many features available in Moab.  It is an excellent tool which is perhaps the most widely used scheduler in the industry.

   Moab Cluster Suite is a professional release workload management package based on a more robust, scalable, and dynamic infrastructure.  It provides a superset of all capabilities found in Maui and includes industry leading capabilities in the following areas:

• Ease of Use - full graphical cluster administration with integrated documentation and wizards
• Multi-Cluster Support - efficient integration of resources from multiple clusters
• Grid Support - advanced grid queries, policies, workload management features
• On Demand Support - the most advanced on demand intelligence and policy controls available anywhere
• Integrated Billing - highly flexible costing, allocation management, and billing
• Extended Resource Control - monitoring, co-allocating, reservation, provisioning, and reporting on compute, data, network, software, and other resources
• Cluster Visualization - true real-time visualization of what the cluster is and has been doing providing usage breakdown, failures, inefficiencies, etc
• Instant Charting and Reporting - instant display of graphs and professional reports covering any timeframe and combination of data
• ROI - unparalleled ROI features to reduce staff time, empower users, increase resource availability, improve cluster efficiency, more quickly diagnose failures, and steer the cluster with instant comprehensive feedback and dynamic policies to do what it is supposed to do.

Maui Scheduler vs. Moab Cluster Suite Summary

• Accounting/Statistics
• Charging/Costing
• Cluster Visualization
• Diagnostics
• End-User Empowerment
• Fairness Policies
• Fault Tolerance
• Grid Scheduling
• Inter-Operability
• Job Management/Scheduling
• Packaging
• Quality of Service (QOS/SLA)
• Reservation Support
• Resource Management
• Resource Optimization
• Scalability
• Security
• Support
• Testing
• Triggers
• Usability
• User Interface/Administration
• Utility Based Computing

Accounting-Statistics

Feature	Maui Scheduler	Moab Cluster Suite
Charting	N/A	Instant pie charts, bar graphs and line charts Export in standard graphics formats
Reporting	Command-line based credential usage Historical cluster performance summaries	Command-line based credential usage Historical cluster performance summaries Instant professional PDF summary reports Full system usage breakdown
Profiling	Limited historical profiling	Flexible real-time credential, cluster, and node based profiling
Statistics	Persistent job completion accounting log Persistent fairshare data Single interval credential based summary statistics	Persistent job submission, start, and completion accounting log Persistent fairshare data Daily, weekly, and monthly credential and cluster based summary statistics

Charging/Costing

Cluster Visualization

Feature	Maui Scheduler	Moab Cluster Suite
Resource Allocation TimeLine	NO	YES (view reservations, general job, and user job based resource allocation over time)
Cluster Availability TimeLine	NO	YES (view hardware and software failures, admin based reservations, and end user consumption over time)
Graphical Reservation Display	NO	YES (view when, where, and by whom resources are reserved)

Diagnostics

Feature	Maui Scheduler	Moab Cluster Suite
Object Level Messages	N/A	Full object level message support Peer service diagnostics Grid activity diagnostics Scheduler diagnostics Integrated historical job tracking Admin specified object annotation Visual job management
Credential Diagnostics	YES - report configuration only	YES - report configuration, policy violation, state, messages, failures, etc
Grid Diagnostics	NO	YES
Job Diagnostics	YES - only available for currently queued jobs	YES - available for queued and completed jobs
Node/Cluster Diagnostics	YES	YES
Queue/Job Eligibility Diagnostics	YES	YES
Reservation Diagnostics	YES	YES
Resource Manager Diagnostics	NO	YES - report resource manager failures, state, and performance statistics
Scheduler Level Diagnostics	NO	YES - collect all high level and system critical failures to single report
Integrated Email Notification	NO - possible via NOTIFICATIONPROGRAM attribute	YES

End User Empowerment

Feature	Maui Scheduler	Moab Cluster Suite
Resource Availability Query	showbf Supports continued use of resource manager specific interface commands	showbf Supports continued use of resource manager specific interface commands Web and command-line based user level graphical cluster overview with search facilities
Job Management	showq Supports continued use of resource manager specific interface commands	showq Supports continued use of resource manager specific interface commands Web and command-line based user level job management Web and command-line based job diagnostics for current and historical jobs Configurable job failure policy Web and command-line based job submission
Resource Management	N/A	Web and command-line based user level reservation support
User Statistics	N/A	Web and command-line based user level statistics

Fairness Policies

Feature	Maui Scheduler	Moab Cluster Suite
Usage Limits	Full credential based single dimensional policies Hard and soft limits Partial multi-dimensional policies	Full credential based single dimensional policies Hard and soft limits Full multi-dimensional policies Full node based policies
Prioritization	Multi-category priority management (23 independent factors) Priority factor caps	Multi-category priority management (42 independent factors) Priority factor caps Graphical, interactive priority management wizard Policy violation based priority adjustment Job state/job attribute based priority adjustment
Fairshare	Multi-dimensional fairshare support Fairshare priority adjustment	Multi-dimensional fairshare support Fairshare priority adjustment Hard and soft fairshare targets (jobs blocked if hard fairshare limit violated) Graphical, interactive fairshare management wizard Importing and Exporting of Fairshare data to external services Integrated Global and Local Fairshare Support (w/Identity Interfacing)

Fault Tolerance

Grid Scheduling

Inter-Operability

Feature	Maui Scheduler	Moab Cluster Suite
Architectures/OSs	All major UNIX based architectures and platforms supported	All major UNIX based architectures and platforms supported including MacOS
Resource Manager Support	TORQUE/OpenPBS/PBSPro LoadLeveler SLURM/WIKI SSS/Bamboo	TORQUE/OpenPBS/PBSPro LoadLeveler/LoadLeveler for Linux SLURM/WIKI SSS/Bamboo SGE BProc Ganglia xCAT
Scheduler APIs	N/A	C API Java API XML CLI
Allocation Manager Support	QBank Gold	QBank Gold GGF/AMIE Native-Batch SQL
Multi-Cluster Support	NO	Manage multiple cluster/resource manager with single scheduler Global queue support enabling inter-cluster job migration Job translation allowing jobs submitted in one language to be executed on resource manager in another
Multi-Source Cluster Query	NO	Integrate information from multiple resource managers into single cohesive view
Multi-Resource Type Cluster Query	NO	Directly interface with non-compute host resource managers including provisioning managers, license managers, network managers, and data managers.
Multi-Source Job Management	NO	Allow support for integrated interfacing to independent job monitors, performance monitors, job accounting, queue managers, suspend/resume management systems, etc
Native Resource Manager Support	NO	Allow rapid, local creation/customization of file, script, and web based services providing resource/job data or resource/job services integrated diagnostics integrated performance monitoring
Identity Manager Support	NO	Allow direct importing of user/account data into Moab configuration and policies

Job Management/Scheduling

Resource Optimization

Packaging

Feature	Maui Scheduler	Moab Cluster Suite
Source Availability	YES	YES
Binary Distributions	NO	YES
Graphical Admin Tool Included	NO	YES
User Portal Included	NO	YES
Price	Free	Competitively Priced (Only a fraction of the cost of competing packages)

Quality of Service/Service Level Agreements

Feature	Maui Scheduler	Moab Cluster Suite
Deadline Based Scheduling	N/A	Absolute per job deadline support Relative per job deadline support Per QOS and per credential deadline defaults Optional deadline based charging modifiers
Preemption	QOS Based Preemption Per Job Preemption	QOS Based Preemption Per job preemption Resource ownership based preemption Priority modifiers for suspended jobs Policy violation based preemption policies
General QOS Configuration	Parameter based administration	Parameter based administration Command-line based administration QOS diagnostics Performance based event triggers Service level based charging Service level based resource/reservation access Graphical administration

Reservation Support

Feature	Maui Scheduler	Moab Cluster Suite
Administrative Reservations	YES	YES
Advanced Reservation Features	Flexible credential based ACLs	Dynamically configurable reservations Flexible credential, resource, job attribute, and service level based ACLs Reservation groups Job to reservation binding Reservation self optimization Personal reservations Personal reservation sandbox Personal reservation limits Remote reservation support Graphical reservation management

Resource Management

Scalability

Security

Feature	Maui Scheduler	Moab Cluster Suite
Role Based Authorization	Support help_desk, operator, and admin level roles	Support 5 dynamically configurable admin roles
Encryption	YES	YES
Virtual Private Cluster	NO	YES (constrain user views of resources, jobs, credentials, and statistics)

Support

Testing

Triggers

Feature	Maui Scheduler	Moab Cluster Suite
Basic Trigger Support	NO	YES

Usability

Feature	Maui Scheduler	Moab Cluster Suite
Dynamically Configurable Scheduler Policies	YES (command-line based, not persistent)	YES (command-line and graphical based with persistence)
Parameter Diagnostics	NO	YES (verify correct configuration of parameters and values)
Dynamically Configurable Scheduler Parameters	YES (command-line based, not persistent)	YES (command-line and graphical based with persistence)
Cluster Architecture Configuration	Parameter based configuration	Parameter based configuration Dynamic command-line based configuration Graphical architecture configuration and management

User Interface Support

Feature	Maui Scheduler	Moab Cluster Suite
Graphical Admin/Management Tool	NO	YES
Web Based User Portal	NO	YES
API's to Enhance Existing Local Web Portals	NO	YES
Submission Language Translation Capabilities	NO	YES (Automatically translate between Loadleveler, LSF, PBSPro, TORQUE, and BProc based jobs)

Utility Based Computing