[gold-users] 答复: Getting Project metadata into Gold

[Jonathan Mills]

I do see how that works, yes.  But I think I run into the user education
issue with that route.  None of them are going to use the g* commands
provided by Gold.  They way they run their jobs is as simple as:

$ qsub bash.sh

where bash.sh may have a few simple PBS env variables, or none at all.
All I really want is a way to *force* them to call qsub with the -A flag
and provide a valid project/account name.  I am thinking of doing that
with a perl script called qsub that just does some input validation
before passing along the project name as an argument to the real qsub
binary.

On Sat, 2011-03-19 at 05:48 +0800, Wei Lin wrote:
> When submit a job setting with non-existing project in gold, gquote command in script will fail and then block the submit command of resource manage system. 
> Greserve/gcharge won't face such problems after the error input at submit time has been filtered. 
> Am I right? 
> 
> ------------------------------------------------------------------------------------------
> For example: 
> [@amd64dcore conf]$ glsproject
> Name                  Active Users  Machines     Description
> --------------------- ------ ------ ------------ -----------
> lsf_amd64dcore_weilin True   weilin iquadcore-01
> lsf_gold              True          iquadcore-01
> lsf_p1                True   weilin amd64dcore
> lsf_test              True                       LSF TEST
> [@amd64dcore conf]$ bsub -P non_existing_project -n 2 -W 10 sleep 1000
> Quote command: /opt/gold/bin/gquote -u weilin -p "non_existing_project" -m amd64dcore -P 2 -t 600 --verbose --quiet
> -----------------------------------------------------------
> Quote response: Project non_existing_project does not exist
> -----------------------------------------------------------
> 
> -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
> Quote failed: Project non_existing_project does not exist
> -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
> Request aborted by esub. Job not submitted.  
> 
> -----邮件原件-----
> 发件人: gold-users-bounces at supercluster.org [mailto:gold-users-bounces at supercluster.org] 代表 Jonathan Mills
> 发送时间: 2011年3月19日 3:46
> 收件人: gold-users at supercluster.org
> 主题: [gold-users] Getting Project metadata into Gold
> 
> I have Gold up and running, and there are users and jobs and
> transactions, etc.  However, the real problem we hope to solve with Gold
> is to track usage at the project level.  
> 
> No meaningful project metadata comes into Gold from Moab, because the
> users don't input anything project-specific when they call 'qsub' on the
> command line.  While you can export PBS environment variables in your
> script, I don't see one of those variables for, or relating to,
> "project".
> 
> So there's two challenges:  1) how to get the users to input project
> names when they submit a job; 2) how to validate the project names to
> prevent someone from inputting nonsense, or nonexistent projects, or a
> misspelled project name.  We may also face a user education issue....
> 
> I can imagine some scenario where the qsub binary is renamed, and called
> from a script named 'qsub'.....where the script does some validation?
> 
> However, I thought I would write and see how the community has addressed
> these points (since I am very new at this!)
> 
> Cheers,
> 
> Jonathan
> 
> 
> P.S. -- Thank you, Scott, for your helpful responses to this list!
> 
> _______________________________________________
> gold-users mailing list
> gold-users at supercluster.org
> http://www.supercluster.org/mailman/listinfo/gold-users
> _______________________________________________
> gold-users mailing list
> gold-users at supercluster.org
> http://www.supercluster.org/mailman/listinfo/gold-users