| Moab Workload Manager® |
A.17 Case Study: Utility Computing Data Mining Center
Overview
A commercial organization must provide on demand access to its massive proprietary data set and the ability to provide full service data mining services to customers automatically with no human intervention. Customer queries can vary from precanned standardized and periodic queries, to fully arbitrary random access searches of the data.
Resources
The organization is housed at a tier4 data center with fully redundant and high speed internet connections. Several hundred data servers process petabytes of data which can be further refined across a number of dedicated compute servers.Workload
The workload varies from requests to email final processed results of a canned query to interactive access to compute resources to allow fully arbitrary searches with manual steering.Solution
Moab's Utility Computing Suite allows the organization to offer a web based full service portal to satisfy the needs of both internal and external users of the utility data mining services. The Moab Access Portal API is utilized to generate a fully customized one stop interface allowing customer's to evaluate resource availability, submit and manage utility requests, and monitor their accounts.Using Moab, the organization is able to translate requests for data mining services into an allocation of a fully customized data-mining environment complete with dedicated compute, network, storage, and application resources. Moab further provides dynamic host and network security and scrubs and reconfigures accessible compute nodes. Using Moab's object triggers and space and time based resource co-allocation, resources are allocated, services activated, data searched, and accounts created. At the point the user actually logs in or begins his automated query, a complete environment has already been created and data pre-staged and the user is ready to immediately perform productive work.
Further, Moab tracks resources required for provisioning, resources dedicated to the customer, and resources actually utilized by the customer and provides automatic billing against the customer's account.