Re: A working MusicXML engraver?

We're working on a test set for MEI software that is free and open for anyone to use.

http://ddmal.github.io/mei-test-set/

(Not flashy, but it works!) We use it to test both the Verovio toolkit's rendering, as well as our Sibelius to MEI exporter. The test set is broken up in to testing specific features, e.g., Accidentals:

http://ddmal.github.io/mei-test-set/MEI-test-set/accidentals.html <http://ddmal.github.io/mei-test-set/MEI-test-set/accidentals.html>

As well as 'integration' tests with complete examples, e.g.,

http://ddmal.github.io/mei-test-set/complete-examples/Borodin_StringTrio_g.html <http://ddmal.github.io/mei-test-set/complete-examples/Borodin_StringTrio_g.html>

All of the examples are rendered 'on-the-fly' with Verovio so that we can very quickly see improvements or regressions.

We've also included some of the VexFlow to MEI rendering tests developed by Zoltan Komives.

We have included the Sibelius source files for some of our tests in the source directory. If you make improvements or add new test cases, I would simply ask that you make your changes available upstream so that everyone can benefit.

https://github.com/DDMAL/mei-test-set

Cheers,
-Andrew

> On Dec 1, 2015, at 12:55 PM, Andreas Wenger <andi.xenoage@googlemail.com> wrote:
> 
> Hi,
> 
>> Just a thought - I do wonder if a specific implementation would necessarily be a good idea (since we might get bogged down in implementation rather than discussing the specification) and it might be better to have pseudo-code algorithms to go with examples for each part of the specification
> I agree with Joshan.
> 
> I do not really know how a working MusicXML engraver would help me to make my own engraver better. Of course I could test specific cases, but it does not provide a systematic way to evaluate the quality of my own renderer.
> 
> What was really helping me so far for the Zong! open source music notation project, is the Unofficial MusicXML Test Suite from the Lilypond project,
> http://www.lilypond.org/doc/v2.18/input/regression/musicxml/collated-files.html
> Unfortunately, there are some errors in it, Lilypond does not support some features (so some result images are unusable) and it wasn't extended for a long time. But a test suite in this style (MusicXML input and expected result image) seems to be perfect for me to measure quality. What tests/benchmarks do the other MusicXML engravers use?
> 
> What I'd like to see is something like "My app reaches 164/200 points in the official MusicXML rendering benchmark. 30 points are not implemented yet, 26 others currently fail.". And a list with the detail images.
> (And the best app will be the unofficial reference app...)
> 
> Bye,
> 
> 
> Andi
> 
>