[torqueusers] File staging syntax

André Gemünd andre.gemuend at scai.fraunhofer.de
Thu Sep 29 05:50:57 MDT 2011


Hey Lukasz, 

I already patched our local version of pbs_submit.sh (though differently than you). That was not my point. I just didn't see mention of this in the changelog. 

Greetings
André

----- Ursprüngliche Mail -----
> Hello,
> 
> We hit this issue in Cyfronet after migrating our grid clusters to
> Torque 2.5.8.
> File staging in CREAM stopped working so we had to patch things a bit
> on
> the CREAM side.
> 
> Stagein syntax accepted by 2.5.8 requires additional escaped inverted
> commas:
> 
> Example:
> #PBS -W
> stagein=\'foo at gloria.d-grid.scai.fraunhofer.de:/tmp/foo,foo2 at gloria.d-grid.scai.fraunhofer.de:/tmp/foo2\'
> 
> 
> 
> As a workaround please specify:
> PBS_MULTIPLE_STAGING_DIRECTIVE=no
> in site-info.def and apply attached patch to
> /opt/glite/bin/pbs_submit.sh
> 
> I hope that helps
> 
> Best Regards
> --
> Lukasz Flis
> ACC Cyfronet AGH
> 
> 
> > Did you ever find time to reproduce this? It would be nice to know
> > the exact version this changed in, for the bug report on the
> > related software.
> >
> > Greetings
> > André
> >
> > ----- Ursprüngliche Mail -----
> >> Hello Ken,
> >>
> >> you just need two stagein or stageout files in one line:
> >>
> >> [andre at gloria pbs]$ cat pbstest
> >> #!/bin/bash
> >> #PBS -S /bin/bash
> >> #PBS -q local
> >> #PBS -W
> >> stagein=foo at gloria.d-grid.scai.fraunhofer.de:/tmp/foo,stagein=foo2 at gloria.d-grid.scai.fraunhofer.de:/tmp/foo2
> >> #PBS -m n
> >> echo "foo"
> >> [andre at gloria pbs]$ qsub pbstest
> >> qsub: illegal -W value
> >>
> >> [andre at gloria pbs]$ cat pbstest
> >> #!/bin/bash
> >> #PBS -S /bin/bash
> >> #PBS -q local
> >> #PBS -W
> >> stagein=foo at gloria.d-grid.scai.fraunhofer.de:/tmp/foo,foo2 at gloria.d-grid.scai.fraunhofer.de:/tmp/foo2
> >> #PBS -m n
> >> echo "foo"
> >> [andre at gloria pbs]$ qsub pbstest
> >> qsub: illegal -W value
> >>
> >> [andre at gloria pbs]$ cat pbstest
> >> #!/bin/bash
> >> #PBS -S /bin/bash
> >> #PBS -q local
> >> #PBS -W stagein=foo at gloria.d-grid.scai.fraunhofer.de:/tmp/foo
> >> #PBS -W stagein=foo2 at gloria.d-grid.scai.fraunhofer.de:/tmp/foo2
> >> #PBS -m n
> >> echo "foo"
> >> [andre at gloria pbs]$ qsub pbstest
> >> 435688.tonia.d-grid.scai.fraunhofer.de
> >>
> >> So neither the old, nor the new syntax of specifying multiple
> >> files
> >> per -W works anymore.
> >>
> >> gLite CREAM (http://glite.cern.ch/glite-CREAM/) generates these
> >> lines
> >> with its wrapper script. So this is basically a bug in that
> >> software
> >> (which is easy to solve), but it would have been nice to be
> >> notified
> >> of the change.
> >>
> >> Greetings
> >> André
> >>
> >>> Andre
> >>>
> >>> Can you send your qsub or msub line?
> >>>
> >>> Can you send your script as well?
> >>
> >>>> is it possible that the -W syntax changed again between 2.5.5
> >>>> and
> >>>> 2.5.8? We were using 2.5.5 without problems, but since I
> >>>> upgraded
> >>>> to
> >>>> 2.5.8 yesterday, PBS scripts with more than one file per staging
> >>>> line failed with "illegal -W syntax". I had to change the
> >>>> scripts
> >>>> to
> >>>> use seperate -W lines for every file. I didn't see this in the
> >>>> changelog, or maybe I just missed it?
> >>
> >>
> >>
> >> --
> >> André Gemünd
> >> Fraunhofer-Institute for Algorithms and Scientific Computing
> >> andre.gemuend at scai.fraunhofer.de
> >> Tel: +49 2241 14-2193
> >> /C=DE/O=Fraunhofer/OU=SCAI/OU=People/CN=Andre Gemuend
> >> _______________________________________________
> >> torqueusers mailing list
> >> torqueusers at supercluster.org
> >> http://www.supercluster.org/mailman/listinfo/torqueusers
> >>
> >
> 
> 
> 

-- 
André Gemünd
Fraunhofer-Institute for Algorithms and Scientific Computing
andre.gemuend at scai.fraunhofer.de
Tel: +49 2241 14-2193
/C=DE/O=Fraunhofer/OU=SCAI/OU=People/CN=Andre Gemuend


More information about the torqueusers mailing list