[torquedev] Data-Is-String format
garrick at usc.edu
Thu Jun 10 09:26:33 MDT 2010
On Jun 10, 2010, at 12:20 AM, ekasit.kijsipongse at nectec.or.th wrote:
> Hi all,
> I'm wondering what is the benefit of using the Data-Is-String format in the
> communication between pbs_server and pbs_sched, i.e. for reducing message size
> maintaining readability? I've noticed a large overhead from sending and parsing
> job information to pbs_sched if the number of jobs > 10,000. Is there any other
> such as using database?
DIS pre-dates all of us, so I don't think we can give you a good justification.
I've always thought that we should add a final compression step. The data is highly highly repeated and should compress wonderfully.
More information about the torquedev