W3C home > Mailing lists > Public > public-media-annotation@w3.org > October 2011

Draft for MAWG TestSuite

From: Florian Stegmaier <stegmai@dimis.fim.uni-passau.de>
Date: Mon, 17 Oct 2011 09:35:02 +0200
Message-Id: <ABD48D1C-04F8-41A5-AC18-BC2F27421CDB@dimis.fim.uni-passau.de>
To: public-media-annotation@w3.org
Dear all,

here you can find a first proposal of the MAWG TestSuite:

http://dimis.fim.uni-passau.de/~stegmai/MAWGTestSuite/testsuite.html

You can use it as follows:
1) install the firefox extension which you can find in [1]
2) Click at the MAWG Extension button
3) a list of all formats from the ontology doc (except container formats) appears - here you may choose youtube and/or vimeo. Note: I know, Vimeo is not in our list, but i wanted to show you, how it could work for more than one format - will be removed in the final version.
4) Choose whether all properties should be tested or only a specific subset.
5) A table will be generated, which performs the comparison of a response to a pre-defined JSON file. At the moment it only shows if its valid or failed.

As already mentioned, our web service implementation is slightly outdated - i will try to update it during the next weeks. After that the test suite will be enlarged for this type of input.

What we have planned to do next:
a) there is a minor bug in the test suite, that may appear in the comparison if more than one format is involved.
b) integration of two level test. we will show the user, if his implementation for a specific property has failed (red), follows the basic criteria (light green - only general attributes set) or is fully compliant with the spec (dark green - also specific attributes for a property are set).
c) debug information for failed properties (e.g., what value was broken, what would have been expected).
d) some properties can not be taken into account in the live-test due to changes in the underlying system - we will mark those yellow (e.g. rating in Youtube or Vimeo may differ from day to day).
e) editorial editing in the surrounding page.

Remarks would be fine.

Cheers.

[1] http://mawg.joanneum.at/web/demo3.html
_____________________________
Dipl. Inf. Florian Stegmaier
Chair of Distributed Information Systems
University of Passau
Innstr. 43
94032 Passau

Room 248 ITZ

Tel.: +49 851 509 3063
Fax: +49 851 509 3062

stegmai@dimis.fim.uni-passau.de
https://www.dimis.fim.uni-passau.de/iris/
http://twitter.com/fstegmai
_____________________________
Received on Monday, 17 October 2011 07:35:35 GMT

This archive was generated by hypermail 2.2.0+W3C-0.50 : Monday, 17 October 2011 07:35:38 GMT