Re: CSVW Test Harness

On 30 November 2014 at 07:49, Ivan Herman <ivan@w3.org> wrote:
> As a former user of the RDFa test site: great:-)

+1 - thanks for putting this together, this is super-useful Gregg!

Before I vanish for a week I just wanted to re-iterate a point I tried
to also make at the F2F: such test suites can be useful as a tool for
achieving and documenting consensus within Working Groups, as well as
serving external audiences. And as we are now aiming to drive WG
meeting agendas from our open issues list (i.e.
https://github.com/w3c/csvw/labels/Requires%20telcon%20discussion/decision
) spec editors should think about whether questions that need
consideration by the WG can be couched in terms of specific, concrete
test cases. Such an approach helped us a great deal in the 2000-4 RDF
Core work, at least...

cheers,

Dan

> On the RDFa site a test implementation could be used by providing a web service of some sort, taking an HTML file and producing a turtle output. What will be the requirement this time?
>
> Ivan
>
>> On 29 Nov 2014, at 20:52 , Gregg Kellogg <gregg@greggkellogg.net> wrote:
>>
>> I've created an initial version of the CSVW test harness [1]. This is similar to the online test runner used for RDFa [2], but uses AngularJS for the web application, and is substantially simpler.
>>
>> Right now, the only configured processor is "Reflector", which simply loads the expected results and compares it with itself. However, it should work with an arbitrary processor. Note that the test manifest loaded is one Andy and I created some time ago, and the actual tests will change as we move forward.
>>
>> Tests and manifest are loaded from GitHub dynamically, but we will likely need to change this to run from the harness itself, so that we can control HTTP headers.
>>
>> For now, the repository is at [3]. It could simply be folded into the existing CSVW site on GitHub, and a new instance run from there.
>>
>> Note that both RDFa and JSON-LD groups used such a site for more than just running test suites, including general information, links to documents, and a playground for testing formats. We could do the same, but for right now, the site is limited to just the test harness.
>>
>> Also, it could use a better name! This is simply a randomly-generated name provided by heroku. A W3C subdomain could potentially point here, or we could do something else.
>>
>> The site is built using Ruby/Sinatra and AngularJS. It is pretty generic, and could be used for similar tests (such as the existing RDF test suites) with fairly minor modifications.
>>
>> Suggestions, comments, bug reports are welcome.
>>
>> Gregg Kellogg
>> gregg@greggkellogg.net
>>
>> [1] https://floating-sands-3222.herokuapp.com
>> [2] http://rdfa.info/test-suite/
>> [3] https://github.com/gkellogg/csvw-test
>
>
> ----
> Ivan Herman, W3C
> Digital Publishing Activity Lead
> Home: http://www.w3.org/People/Ivan/
> mobile: +31-641044153
> ORCID ID: http://orcid.org/0000-0003-0782-2704
>
>
>
>

Received on Sunday, 30 November 2014 14:58:25 UTC