Re: Test suite status

On Mittwoch, 9. September 2009, Ian Horrocks wrote:
> Hi Markus,
>
> Thanks for taking care of this -- the test results look pretty
> impressive.
>
> As far as proposed tests are concerned, we have generally been
> accepting any test that passes the basic "eyeball" test and that is
> successfully passed by two implementations. If you can send round a
> list of proposed test that fall into this category then I think that
> it is reasonable to promote them to approved status unless there is a
> positive objection.

Great, here is the list (I give IDs only, to go to the test, enter the 
respective ID into the search box at [1]). All of the following tests are DL 
semantics tests with two passing DL conformant reasoners. If nobody disagrees, 
I will change their status to "accepted":

Consistent owl:real range with DataOneOf
Consistent-but-all-unsat
Consistent-dateTime
FS2RDF-different-individuals-2-ar
FS2RDF-different-individuals-3-ar
FS2RDF-no-builtin-prefixes-ar
FS2RDF-same-individual-2-ar
Inconsistent Disjoint Dataproperties
New-Feature-AnnotationAnnotations-001
New-Feature-AxiomAnnotations-001
Qualified-cardinality-boolean
WebOnt-someValuesFrom-003
somevaluesfrom2bnode

I will send another mail with less obvious cases.

Markus

[1] http://km.aifb.uni-karlsruhe.de/projects/owltests/

>
> Thanks,
> Ian
>
> On 9 Sep 2009, at 09:19, Markus Krötzsch wrote:
> > After recent updates, the test suite now is in good shape regarding
> > accepted
> > tests [1]. There are still a number of proposed tests which have
> > had that
> > status for quite a while. I have created an overview of all these
> > tests to
> > visualize our current coverage:
> >
> > http://www.w3.org/2007/OWL/wiki/Test_Suite_Status#Proposed_tests
> >
> > Unfortunately, there are still some errors in the reports (e.g. I have
> > positive reports for CEL and FaCT++ for tests that are only
> > applicable under
> > RDF-based semantics). So some rows in that section are greener than
> > they
> > should be, but most of them should be accurate.
> >
> > Many of the proposed tests are already covered by two or more
> > implementations,
> > and thus could probably be accepted easily. Since there is no next
> > telecon
> > scheduled so far, I hope we could do this via email -- I can
> > compile a list of
> > tests that seem to be ready.
> >
> > Regards,
> >
> > Markus
> >
> > [1] http://www.w3.org/2007/OWL/wiki/Test_Suite_Status
> >
> > --
> > Markus Krötzsch
> > Institute AIFB, Universität Karlsruhe (TH), 76128 Karlsruhe
> > phone +49 (0)721 608 7362           fax +49 (0)721 608 5998
> > mak@aifb.uni-karlsruhe.de           www  http://korrekt.org
> > http://semantic-web-book.org  http://semantic-mediawiki.org


-- 
Markus Krötzsch
Institute AIFB, Universität Karlsruhe (TH), 76128 Karlsruhe
phone +49 (0)721 608 7362           fax +49 (0)721 608 5998
mak@aifb.uni-karlsruhe.de           www  http://korrekt.org
http://semantic-web-book.org  http://semantic-mediawiki.org