[torquedev] Data-Is-String format

Garrick Staples garrick at usc.edu
Thu Jun 10 09:26:33 MDT 2010


On Jun 10, 2010, at 12:20 AM, ekasit.kijsipongse at nectec.or.th wrote:

> Hi all,
>   I'm wondering what is the benefit of using the Data-Is-String format in the
> communication between pbs_server and pbs_sched, i.e. for reducing message size
> while
> maintaining readability?  I've noticed a large overhead from sending and parsing
> the
> job information to pbs_sched if the number of jobs > 10,000.  Is there any other
> options
> such as using database?

DIS pre-dates all of us, so I don't think we can give you a good justification.

I've always thought that we should add a final compression step. The data is highly highly repeated and should compress wonderfully.



More information about the torquedev mailing list