Saxon-SA Schema Test Suite results

I have today submitted test results for Saxon-SA against the
recently-published XML Schema Test Suite. The result file should be
published on the W3C site.

Summary:

Pass:             38705 tests
Bug in test:        671 tests
Problem in Saxon:    26 tests

"Pass" means that Saxon produces the same result (validity or invalidity) as
the published result.

The bugs raised against tests are all available in the W3C public bugzilla
and are linked from the test result file. By far the largest number (576)
were in the Microsoft Regex tests, which classify many schemas as valid when
they contain regular expressions that are not in fact allowed by the W3C
Schema regex grammar.

The remaining problems in Saxon are as follows:

Saxon runs out of memory on large minOccurs/maxOccurs values - 6 test groups
Saxon allows type subsumption where the specification disallows it - 13 test
groups
Saxon does not allow a user-defined type to be derived directly from
xs:anySimpleType - 3 test groups

(Some test groups contain more than one test)

To get this far, a significant number of minor bugs were fixed in Saxon.
These bug fixes will be incorporated in the next Saxon release.

Michael Kay
http://www.saxonica.com/

Received on Friday, 5 January 2007 12:49:15 UTC