W3C home > Mailing lists > Public > xproc-dev@w3.org > November 2011

Re: Question about performance handling many files..

From: David Lee <dlee@calldei.com>
Date: Mon, 14 Nov 2011 12:28:34 -0500
Message-Id: <124DB9A0-03B8-4A2A-8478-CD843C1A6A1E@calldei.com>
Cc: XProc Dev <xproc-dev@w3.org>
To: Geert Josten <geert.josten@dayon.nl>
Try Jconsole

Sent from my iPhone

On Nov 14, 2011, at 12:17 PM, Geert Josten <geert.josten@dayon.nl> wrote:

> 
> Hi all,
> 
> I am trying to run some test myself (hoping to get some nice statistics
> out of that).
> 
> Does anyone happen to know an easy way to get performance metrics out of
> XMLCalabash? Just total (CPU) time and peak memory usage would suffice..
> 
> Kind regards,
> Geert
> 
> -----Oorspronkelijk bericht-----
> Van: Geert Josten [mailto:geert.josten@dayon.nl]
> Verzonden: vrijdag 11 november 2011 16:12
> Aan: XProc Dev
> Onderwerp: Question about performance handling many files..
> 
> Hi,
> 
> Consider the case where I have an input folder with thousands, or perhaps
> even millions of documents, and I would like to load them, apply an xslt
> on each individually, and store the result. In pseudo could something like
> this:
> 
> <p:directory-list/>
> 
> <p:for-each select="c:file">
>    <p:load/>
>    <p:xslt/>
>    <p:store/>
> </p:for-each>
> 
> How well would that behave? Particularly the directory-list step. If that
> would generate the whole list first, and start the for-each only after the
> list is complete, that would sound not very efficient.
> 
> Are there any track records on how XMLCalabash and other processors behave
> with such a case?
> 
> Kind regards,
> Geert
> 
> drs. G.P.H. (Geert) Josten
> Senior Developer
> 
> 
> 
> Dayon B.V.
> Delftechpark 37b
> 2628 XJ Delft
> 
> T +31 (0)88 26 82 570
> M +31 (0)6 5438 1359
> 
> geert.josten@dayon.nl
> www.dayon.nl
> 
> De informatie - verzonden in of met dit e-mailbericht - is afkomstig van
> Dayon BV en is uitsluitend bestemd voor de geadresseerde. Indien u dit
> bericht onbedoeld hebt ontvangen, verzoeken wij u het te verwijderen. Aan
> dit bericht kunnen geen rechten worden ontleend.
Received on Monday, 14 November 2011 17:29:07 GMT

This archive was generated by hypermail 2.2.0+W3C-0.50 : Monday, 14 November 2011 17:29:08 GMT