W3C home > Mailing lists > Public > public-css-testsuite@w3.org > March 2013

Re: Shepherd API for number of tests

From: Peter Linss <peter.linss@hp.com>
Date: Wed, 27 Mar 2013 13:15:15 -0700
Cc: <public-css-testsuite@w3.org>
Message-Id: <42F392CC-BE5D-4838-8B5B-2685C78D24DE@hp.com>
To: Tobie Langel <tobie@w3.org>
Rebecca already gave the correct answer, but to be more specific: the api you were calling wasn't Shepherd, but the test harness. The test harness API was designed for it's spec annotations and requires an additional parameter 'x' used to identify the spec section (which it always expects to be present even for the overview data). 

So 
curl -H "Accept: application/json" http://test.csswg.org/harness/status/?s=CSS21_DEV&x=http%3A%2F%2Fwww.w3.org%2FTR%2Fcss21%2F
would have gotten you what you were looking for.

Note that the harness API includes test result information and only includes tests currently loaded into the harness (which gets re-built and imported each night).

The Shepherd API does not include result information but does include all tests in the repository (the data is live and has tests linked to all anchors in the spec where the harness currently only links tests to spec sections).

(FWIW, the Shepherd API is JSON only so doesn't need the accept headers like the harness API does.)

Peter

On Mar 27, 2013, at 12:16 PM, Tobie Langel wrote:

> Hi, 
> 
> I'm trying to get the number of test contained in the following test suites using the Shepherd API:
> 
> - CSS3 module: Multi-column layout
> - CSS Color Module Level 3
> - CSS Transforms
> - CSS Backgrounds and Borders Module Level 3
> - Cascading Style Sheets, level 2 (CSS2) Specification
> 
> 
> Unfortunately, I'm failing to get this information for Multi-column layout and CSS2.1.
> 
> I'm just curling into the them like so:
> 
> $ curl -H "Accept: application/json" http://test.csswg.org/harness/status/?s=CSS21_DEV
> $ curl -H "Accept: application/json" http://test.csswg.org/harness/status/?s=CSS3-MULTICOL_DEV
> 
> I'm getting JSON back, but the output only contains a single element in the sections property which sports zero test cases.
> 
> What am I doing wrong?
> 
> Thanks,
> 
> --tobie 
> 
> 
> 
Received on Wednesday, 27 March 2013 20:15:44 UTC

This archive was generated by hypermail 2.3.1 : Wednesday, 27 March 2013 20:15:46 UTC