[Mauiusers] Maui/Torque and Fairshare with secondary Unix groups]

Brian Christiansen bchristiansen at clusterresources.com
Mon May 26 14:19:46 MDT 2008


The patch has been checked into trunk along with the updates to the 
CHANGELOG.

Thanks,
Brian Christiansen

Bas van der Vlies wrote:
> Brian Christiansen wrote:
>>   sounds good.
>>
>> Brian
>>
>
> As promised a new patch with this parameter default disabled, to 
> enable it:
> maui.cfg
> FSSECONDARYGROUPS TRUE
>
> PS) For the Changelog Can you add the company, Bas van der Vlies (SARA).
>
> Regards
>
>>
>> Bas van der Vlies wrote:
>>> On Apr 24, 2008, at 11:19 PM, Brian Christiansen wrote:
>>>
>>>> We have the patch implemented but haven't checked it in yet. Before
>>>> checking it in, can you provide a patch that turns on the FS groups
>>>> behavior with a parameter rather than having it be the default 
>>>> behavior?
>>>>
>>> Brian,
>>>
>>>    My first thought was also to define a parameter to enable it.
>>> After that i realized that a user can only have a fair share for one
>>> group.   If cluster resources want it a parameter for it i can create
>>> it,  What should be the name of the parameter?
>>>
>>> FSSECONDARYGROUPS TRUE
>>>
>>>
>>>> Douglas Wightman wrote:
>>>>> ------------------------------------------------------------------------ 
>>>>>
>>>>>
>>>>>
>>>>> Subject:
>>>>> Re: [Mauiusers] Maui/Torque and Fairshare with secondary Unix groups
>>>>> From:
>>>>> Bas van der Vlies <basv at sara.nl>
>>>>> Date:
>>>>> Mon, 7 Jan 2008 16:55:59 +0100
>>>>> To:
>>>>> "mauiusers at supercluster.org" <mauiusers at supercluster.org>
>>>>>
>>>>> To:
>>>>> "mauiusers at supercluster.org" <mauiusers at supercluster.org>
>>>>>
>>>>>
>>>>> I have made a patch for maui version:
>>>>>  - 3.2.6p20-snap.1182974819
>>>>>
>>>>> The patch is different then that what i suggested. It does not make
>>>>> use of the getgrouplist function nor it uses the FSGROUPS keyword.
>>>>> When the configuration file is parsed. We know the FairShare groups.
>>>>> When a user submits a job maui will now find out if it is a member of
>>>>> one of this groups. If yes then set the group credentials to this
>>>>> group and it will ignore then the PBS egroup variable.
>>>>>
>>>>> Maui did not parse the PBS group_list parameter:
>>>>>  qsub -W group_list=<value>
>>>>>
>>>>> This variable has the highest priority and will set the group
>>>>> credential to  the value specified. We at SARA want to ignore this
>>>>> parameter, because we do not want an user to specify its own group 
>>>>> and
>>>>> bypass the FairShare targets. So we added an option to ignore this
>>>>> parameter:
>>>>>  - IGNPBSGROUPLIST          TRUE
>>>>>
>>>>> This patch also fix some debug problems that i had when the debug
>>>>> level is set to another value then the default one, eg:
>>>>>  - LOGLEVEL 9
>>>>>
>>>>> Maui has a lot of keywords and the parsing of the keywords are 
>>>>> only be
>>>>> shown if a certain loglevel is set. Somebody thought it is nice that
>>>>> the maui keyword table is sorted alphabetically. This is not correct
>>>>> because now only the keywords after the LOG... definitions are shown.
>>>>> This patch moves the LOG.. keywords definition to the beginning of
>>>>> keyword table and fix this problem.
>>>>>
>>>>> patch is attached
>>>>>
>>>>> regards,
>>>>>
>>>>>
>>>>> Bas van der Vlies wrote:
>>>>>> Happy new year everyone,
>>>>>>
>>>>>>   I had some time to examine the source of maui and found two 
>>>>>> ways to
>>>>>> implement this functionality in maui. So we are not depended anymore
>>>>>> on the user primary group for Fairshare or specifying some
>>>>>> commandline parameters for qsub.
>>>>>>
>>>>>> Here are the two solutions:
>>>>>>   1) Introduce a new parameter: FSGROUPS, eg:
>>>>>>      FSGROUPS one two three
>>>>>>
>>>>>>     When a job is submitted:
>>>>>>      a) check if the user is a member of one of this groups
>>>>>>      b) if yes then set the credentials to the matching group.
>>>>>>
>>>>>> 2) When a job is submitted:
>>>>>>   a) get all the groups where the user is a member of with the
>>>>>> "getgrouplist" function. I do not know if this function is available
>>>>>> on all platforms.
>>>>>>   b) Then check if for one of the user groups a fairshare target is
>>>>>> set
>>>>>>   c) if yes then set the credentials to this group.
>>>>>>
>>>>>>
>>>>>> Option 2 has more freedom but i do not know if all OS'es support the
>>>>>> getgrouplist function.
>>>>>>
>>>>>> I want to know which solution the community thinks is the best one?
>>>>>>
>>>>>> Regards
>>>>>>
>>>>>> On Dec 10, 2007, at 3:05 PM, Bas van der Vlies wrote:
>>>>>>
>>>>>>> In our old setup the primary user group was the same as the
>>>>>>> fairshare group
>>>>>>> in Maui. so we did not have any problems with the Fairshare (FS)
>>>>>>> setup.
>>>>>>>
>>>>>>> We are now switching to a new User administration system and use
>>>>>>> the Linux
>>>>>>> setup. Every user has as primary group his own group (user: bas,
>>>>>>> group: bas).
>>>>>>>
>>>>>>> I have read some docs and the problem is that torque only sent the
>>>>>>> primary
>>>>>>> group to Maui. There are several setup's possible:
>>>>>>>   * write a torque submit filter that adds -W or -A, But to my
>>>>>>> knowledge
>>>>>>> the  submit filter does not work for batch jobs that are submitted
>>>>>>> via qsub -I
>>>>>>>
>>>>>>>   * In maui:
>>>>>>>      USERCFG[bas] QDEF=SARA
>>>>>>>      QOSCFG[SARA] FSTARGET=80.0
>>>>>>>   But this is not very scalable. Every time a new user is added we
>>>>>>> have to
>>>>>>>   restart Maui and generate a line as above.
>>>>>>>
>>>>>>>   * Are there other solutions possible?
>>>>>>>
>>>>>>> What i am thinking about is to patch Maui, like the way Torque has
>>>>>>> done it
>>>>>>> with the acl_group_sloppy paramter or patch Torque to send also the
>>>>>>> secondary groups of user.
>>>>>>>
>>>>>>> regards,
>>>>>>>
>>>>>>>
>>>>>>> -- 
>>>>>>> ******************************************************************** 
>>>>>>>
>>>>>>> *                                                                  
>>>>>>> *
>>>>>>> *  Bas van der Vlies                     e-mail: 
>>>>>>> basv at sara.nl      *
>>>>>>> *  SARA - Academic Computing Services    phone:  +31 20 592 
>>>>>>> 8012   *
>>>>>>> *  Kruislaan 415                         fax:    +31 20 
>>>>>>> 6683167    *
>>>>>>> *  1098 SJ 
>>>>>>> Amsterdam                                               *
>>>>>>> *                                                                  
>>>>>>> *
>>>>>>> ******************************************************************** 
>>>>>>>
>>>>>>> _______________________________________________
>>>>>>> mauiusers mailing list
>>>>>>> mauiusers at supercluster.org
>>>>>>> http://www.supercluster.org/mailman/listinfo/mauiusers
>>>>>> -- 
>>>>>> Bas van der Vlies
>>>>>> basv at sara.nl
>>>>>>
>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> mauiusers mailing list
>>>>>> mauiusers at supercluster.org
>>>>>> http://www.supercluster.org/mailman/listinfo/mauiusers
>>>>>
>>>>> ------------------------------------------------------------------------ 
>>>>>
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> mauiusers mailing list
>>>>> mauiusers at supercluster.org
>>>>> http://www.supercluster.org/mailman/listinfo/mauiusers
>>>> _______________________________________________
>>>> mauiusers mailing list
>>>> mauiusers at supercluster.org
>>>> http://www.supercluster.org/mailman/listinfo/mauiusers
>>> -- 
>>> Bas van der Vlies
>>> basv at sara.nl
>>>
>>>
>>>
>
>



More information about the mauiusers mailing list