- From: Shane McCarron <shane@spec-ops.io>
- Date: Fri, 19 Aug 2016 09:35:07 -0500
- To: "Cole, Timothy W" <t-cole3@illinois.edu>
- Cc: W3C Public Annotation List <public-annotation@w3.org>
- Message-ID: <CAJdbnOBMSvLe0Mexf9oAq4kN2_r1ZWpbP_T=Uew9MT1gODi+Eg@mail.gmail.com>
Sexy! I will get rid of the earlier draft test in that tree if you like. On Thu, Aug 18, 2016 at 10:09 PM, Cole, Timothy W <t-cole3@illinois.edu> wrote: > We have 3 'tests' up on Shane's test development site: > > 1. http://testdev.spec-ops.io:8000/annotation-model/ > annotations/annotationMusts-manual.html > > 2. http://testdev.spec-ops.io:8000/annotation-model/annotations/ > annotationOptionals-manual.html > > 3. http://testdev.spec-ops.io:8000/annotation-model/annotations/ > annotationAgentOptionals-manual.html > > You can also get to these tests (and 1 earlier draft test that is > superseded by test 1) by going to http://testdev.spec-ops.io: > 8000/tools/runner/index.html > putting */annotation-model/annotations* in the *Run tests under path box > *and clicking *start*. > > Either way you will need to paste in the json of an annotation you'd like > to 'test' once for each test. Please give it a try (feel free to use > annotations from the spec). Hopefully you will conclude that these latest > versions of the tests are ready for the production WPT site and to be seen > by implementers. > > A valid annotation will past all 14 assertions of Test 1 > (annotationMusts). Note, passing assertions 7-14 does not mean that the > json you pasted in has implemented these features, only that if it has, the > json is corrrect. > > Tests 2 (15 assertions) and 3 (16 assertions) report on what recommended > and optional features have been implemented (correctly). Most annotations > will fail most of these assertions; failure of an assertion means that the > feature associated with the assertion was not implemented at all (the > annotation is still valid) or was not implemented correctly. > > These tests only check keys that are direct children of the annotation or > that are associated with Agents (creators or generators) involved in the > Annotation itself. We are working on a second set of tests that will > report on implementation of body and target features. The definition > schemas are all written, working on finalizing the assertions and test > scripts themselves. > > Feedback on the functionality of this first set of annotation-level tests > will help inform finalizing the body and target level tests, which will be > similar in structure and design, but obviously testing things like > selectors and choice, etc. rather than @context and the like. > > Thanks, > > Tim Cole > > > > > > > > > > > > > > > -- Shane McCarron Projects Manager, Spec-Ops
Received on Friday, 19 August 2016 14:36:03 UTC