Re: JavaScript JSON-LD Streaming Parser

Ruben, thanks for implementing this. Implementing streaming parsers and serializers is important, but not something the WG is ready to work on quite yet. We did just discuss this in our Face to Face last week [1].

Note that the current version of the test suite is at http://w3c.github.io/json-ld-api/tests/; we need to redirect the CG version of the tests here.

Also, the CG maintains a list of implementations on the json-ld.org homepage. You may consider doing a PR to http://github.com/json-ld/json-ld.org [2] to add your implementation.

Gregg Kellogg
gregg@greggkellogg.net

[1] https://www.w3.org/2018/json-ld-wg/Meetings/Minutes/2019/2019-02-08-json-ld#section5-2
[2] https://github.com/json-ld/json-ld.org/blob/fbb52bafdb696ae0950c74952b1267f0dbb4be02/index.html#L182-L189

> On Feb 8, 2019, at 2:10 AM, Ruben Taelman <ruben.taelman@ugent.be> wrote:
> 
> Dear all,
> 
> I had a couple of use cases where I needed to be able to
> parse JSON-LD documents to RDF in a streaming way.
> To the best of my knowledge, current JavaScript implementations
> don’t support streaming parsing, which is why I implemented a streaming parser [1].
> Such a parser is especially useful when you need to parse large documents
> that don’t fully fit into your memory.
> 
> This parser can be configured to be fully spec-compliant.
> However, by default, it is not fully compliant for performance reasons.
> For example, the parser will by default throw an error
> if an @context is found as a non-first entry in an object.
> 
> Obviously, a streaming parser will never be as fast as a regular parser for all cases.
> However, we still achieve comparable performance for parsing
> typical JSON-LD documents, compared to jsonld.js [2].
> Currently, this parser is significantly slower for expanded documents,
> so I am still looking into optimizing this.
> 
> At the moment JSON-LD 1.0 is supported,
> but I aim to look into supporting the new 1.1 features in the near future.
> 
> More information on how the streaming algorithm works
> can be found in the readme [3].
> 
> [1] https://github.com/rubensworks/jsonld-streaming-parser.js <https://github.com/rubensworks/jsonld-streaming-parser.js>
> [2] https://github.com/rubensworks/jsonld-streaming-parser.js#performance <https://github.com/rubensworks/jsonld-streaming-parser.js#performance>
> [3] https://github.com/rubensworks/jsonld-streaming-parser.js#how-it-works <https://github.com/rubensworks/jsonld-streaming-parser.js#how-it-works>
> 
> Kind regards,
> Ruben Taelman