[torqueusers] torque tmpdir on Lustre filesystem

rishi pathak mailmaverick666 at gmail.com
Thu Feb 23 22:10:13 MST 2012


We use HP Scalable File Share(a variant of Lustre) set as tmpdir and have
not seen this error.
It is being used widely by users via data staging and so far we have not
encountered any such errors.
Our server and clients are on RHEL5 though

On Thu, Feb 16, 2012 at 3:22 PM, Lukasz Flis <l.flis at cyf-kr.edu.pl> wrote:

> Hello,
>
> I would like to ask Lustre users if anyone has pbs_mom variable $tmpdir
> set to a directory located on Lustre filesystem?
>
> Such kind of setup in our case (Lustre 2.1.0 and Lustre 1.8.6) results
> in Torque being unable to create temprorary directory. Not all attempts
> are unsuccessful but it is still significant amount.
>
>
> Feb 14 13:56:02 n6-4-16 pbs_mom: LOG_ERROR::Permission denied (13) in
> TMakeTmpDir, Unable to make job transient directory:
> /mnt/lustre/scratch/jobs/18555591.batch.grid
> Feb 14 13:56:23 n6-4-16 pbs_mom: LOG_ERROR::Permission denied (13) in
> TMakeTmpDir, Unable to make job transient directory:
> /mnt/lustre/scratch/jobs/18555647.batch.grid
> Feb 14 14:37:35 n6-4-16 pbs_mom: LOG_ERROR::Permission denied (13) in
> TMakeTmpDir, Unable to make job transient directory:
> /mnt/lustre/scratch/jobs/18557701.batch.grid
> Feb 14 14:38:17 n6-4-16 pbs_mom: LOG_ERROR::Permission denied (13) in
> TMakeTmpDir, Unable to make job transient directory:
> /mnt/lustre/scratch/jobs/18557716.batch.grid
>
> This is not a bug in torque but problem with lustre itself.
>
> I'm just curious if we're the only site in the world facing the problem.
>
> Here is a bug report in jira at whamcloud for more details:
>
> http://jira.whamcloud.com/browse/LU-1101
>
>
> Cheers,
> --
> Lukasz Flis
> ACC Cyfronet AGH,
> Cracow, POLAND
> _______________________________________________
> torqueusers mailing list
> torqueusers at supercluster.org
> http://www.supercluster.org/mailman/listinfo/torqueusers
>



-- 
---
Rishi Pathak
National PARAM Supercomputing Facility
C-DAC, Pune, India
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://www.supercluster.org/pipermail/torqueusers/attachments/20120224/d477d678/attachment.html 


More information about the torqueusers mailing list