Re: Zorba revision 8827 XQuery/XQueryX Update Test Suite Results

Hi Andrew,

again thanks for your efforts.

I looked over the reports and I would have some questions if I may:

- for 'Minimal Conformance' Saxon EE is shown as passing all the
tests: how is that since for test 'namespace-errors-q16' there is an
opened bug #10432 ?
Zorba reports the alternate result as proposed by Markos and agreed
upon by Michael Kay but since that alternate result is not in XQUTS at
the moment, Zorba reports 'namespace-errors-q16' as failing, which is
the correct thing, right?
Am I missing something here?

- for the optional feature 'Update Facility Static Typing Feature'
Zorba mentions that it does not support this feature (see
http://dev.w3.org/2007/xquery-update-10-test-suite/results/XQUTSReport.html#features)
yet in the first table of the report Zorba is shown in red (meaning
failed) instead of white (which stands for untested).
Could it be that there is an error in the report generation process here?
I mean shouldn't the tests for a feature that an implementation
mentions it does not support, be shown in white ?

- for the optional feature 'fn:put applied to nodes other than
document and element nodes'  there are 4 tests that Zorba 'fails' but
these tests should be run only if the XQuery processor does NOT
support the feature.
Since the tests were created by you, can you please tell us what is
the correct way to handle these tests so that we can correctly show
them as passing?

Thanks and best regards,
Sorin

On 9/14/10, Andrew Eisenberg <andrew.eisenberg@us.ibm.com> wrote:
> Thanks for providing these updated results. I've just generated and
> published new reports.
>
>                                         -- Andrew
>
> --------------------
> Andrew Eisenberg
> IBM
> 5 Technology Park Drive
> Westford, MA  01886
>
> andrew.eisenberg@us.ibm.com
> Phone: 978-399-5158
>
>
>
>
>
> From:
> Marian Sorin Nasoi <spungi@gmail.com>
> To:
> Andrew Eisenberg/Concord/IBM@IBMUS
> Cc:
> www-archive@w3.org, zorba-coders <zorba-coders@lists.inf.ethz.ch>
> Date:
> 09/13/2010 08:47 AM
> Subject:
> Zorba revision 8827 XQuery/XQueryX Update Test Suite Results
>
>
>
> Hi Andrew,
>
> please find attached the XQuery Update and XQueryX Update test suite
> results for Zorba revision 8827 (http://www.zorba-xquery.com/).
>
> The results are based on the XQUTS taken from the W3C CVS on September 13,
> 2010.
>
> I hope that the feature names and implementation-defined item names
> now match those in the catalog.
> Note that we do not support the "Update Facility Static Typing Feature".
>
> The reports show Zorba failing 33 tests and here are some details on
> these:
>
> - test 'namespace-errors-q16' fails but there is an opened bug
> (#10432) opened for this problem:
> http://www.w3.org/Bugs/Public/show_bug.cgi?id=10432
>
> - 4 tests fail in 'Optional Features/fn:put applied to nodes other
> than document and element nodes' but these tests should be run only if
> the XQuery implementation does NOT support the feature
>
> - 24 tests fail in 'Optional Features/Update Facility Static Typing
> Feature' but Zorba does NOT support the 'Update Facility Static Typing
> Feature'
>
> - 3 tests fail in 'Optional Features/Revalidation'  but these tests
> should be run only by the XQuery implementations that do NOT support
> revalidation mode 'strict' or 'lax' or 'skip'
>
> - 1 test fails in 'Optional Features/Revalidation' but this test
> should be run only by the XQuery implementations that do NOT support
> revalidation mode 'strict + skip'
>
> Please let us know if there are any problems with this submission.
>
> Again, thanks for your help.
>
> Best regards,
> Sorin
> [attachment "Zorba_r8827_XQuery(X)_update_results.zip" deleted by Andrew
> Eisenberg/Concord/IBM]
>
>

Received on Wednesday, 15 September 2010 06:32:22 UTC