RE: Question about performance handling many files..

Hi all,

I am trying to run some test myself (hoping to get some nice statistics
out of that).

Does anyone happen to know an easy way to get performance metrics out of
XMLCalabash? Just total (CPU) time and peak memory usage would suffice..

Kind regards,
Geert

-----Oorspronkelijk bericht-----
Van: Geert Josten [mailto:geert.josten@dayon.nl]
Verzonden: vrijdag 11 november 2011 16:12
Aan: XProc Dev
Onderwerp: Question about performance handling many files..

Hi,

Consider the case where I have an input folder with thousands, or perhaps
even millions of documents, and I would like to load them, apply an xslt
on each individually, and store the result. In pseudo could something like
this:

<p:directory-list/>

<p:for-each select="c:file">
    <p:load/>
    <p:xslt/>
    <p:store/>
</p:for-each>

How well would that behave? Particularly the directory-list step. If that
would generate the whole list first, and start the for-each only after the
list is complete, that would sound not very efficient.

Are there any track records on how XMLCalabash and other processors behave
with such a case?

Kind regards,
Geert

drs. G.P.H. (Geert) Josten
Senior Developer



Dayon B.V.
Delftechpark 37b
2628 XJ Delft

T +31 (0)88 26 82 570
M +31 (0)6 5438 1359

geert.josten@dayon.nl
www.dayon.nl

De informatie - verzonden in of met dit e-mailbericht - is afkomstig van
Dayon BV en is uitsluitend bestemd voor de geadresseerde. Indien u dit
bericht onbedoeld hebt ontvangen, verzoeken wij u het te verwijderen. Aan
dit bericht kunnen geen rechten worden ontleend.

Received on Monday, 14 November 2011 17:17:53 UTC