W3C home > Mailing lists > Public > public-media-annotation@w3.org > October 2011

Re: Draft for MAWG TestSuite

From: Thierry MICHEL <tmichel@w3.org>
Date: Mon, 24 Oct 2011 16:46:26 +0200
Message-ID: <4EA57A42.3010308@w3.org>
To: Florian Stegmaier <stegmai@dimis.fim.uni-passau.de>
CC: public-media-annotation@w3.org


Le 17/10/2011 09:35, Florian Stegmaier a écrit :
> Dear all,
>
> here you can find a first proposal of the MAWG TestSuite:
>
> http://dimis.fim.uni-passau.de/~stegmai/MAWGTestSuite/testsuite.html


I have copied the file on the W3C server at
http://www.w3.org/2008/WebVideo/Annotations/drafts/API/testsuite.html
>
> You can use it as follows:
> 1) install the firefox extension which you can find in [1]

Done

> 2) Click at the MAWG Extension button
> 3) a list of all formats from the ontology doc (except container formats) appears - here you may choose youtube and/or vimeo. Note: I know, Vimeo is not in our list, but i wanted to show you, how it could work for more than one format - will be removed in the final version.

OK


> 4) Choose whether all properties should be tested or only a specific subset.
> 5) A table will be generated, which performs the comparison of a response to a pre-defined JSON file. At the moment it only shows if its valid or failed.


right it only shows "valid" or "failed". What do you plan to show in the 
future version?

Also looking at the Demonstrator III at

http://mawg.joanneum.at/web/demo3.html

It does indeed extrat the Metadata for a Yutube Video.

Thanks,

Thierry.







> As already mentioned, our web service implementation is slightly outdated - i will try to update it during the next weeks. After that the test suite will be enlarged for this type of input.
>
> What we have planned to do next:
> a) there is a minor bug in the test suite, that may appear in the comparison if more than one format is involved.
> b) integration of two level test. we will show the user, if his implementation for a specific property has failed (red), follows the basic criteria (light green - only general attributes set) or is fully compliant with the spec (dark green - also specific attributes for a property are set).
> c) debug information for failed properties (e.g., what value was broken, what would have been expected).
> d) some properties can not be taken into account in the live-test due to changes in the underlying system - we will mark those yellow (e.g. rating in Youtube or Vimeo may differ from day to day).
> e) editorial editing in the surrounding page.
>
> Remarks would be fine.
>
> Cheers.
>
> [1] http://mawg.joanneum.at/web/demo3.html
> _____________________________
> Dipl. Inf. Florian Stegmaier
> Chair of Distributed Information Systems
> University of Passau
> Innstr. 43
> 94032 Passau
>
> Room 248 ITZ
>
> Tel.: +49 851 509 3063
> Fax: +49 851 509 3062
>
> stegmai@dimis.fim.uni-passau.de
> https://www.dimis.fim.uni-passau.de/iris/
> http://twitter.com/fstegmai
> _____________________________
>
>
Received on Monday, 24 October 2011 14:47:02 GMT

This archive was generated by hypermail 2.2.0+W3C-0.50 : Monday, 24 October 2011 14:47:03 GMT