W3C home > Mailing lists > Public > public-css-testsuite@w3.org > March 2013

Re: Shepherd API for number of tests

From: Tobie Langel <tobie@w3.org>
Date: Wed, 27 Mar 2013 21:01:34 +0100
To: Rebecca Hauck <rhauck@adobe.com>
Cc: "public-css-testsuite@w3.org" <public-css-testsuite@w3.org>
Message-ID: <8014CDA0AAA14B3F8D7203A1C00A4B19@w3.org>
Thanks for the info. 

I'm also working on such a script. Care to hop on to irc (e.g. irc.w3.org/#testing) so we avoid duplicating work?

Are there other tests suites than the dozen on test.csswg.org?

Do we have estimates of the coverage level of these test suites?

Thanks,

--tobie

On Wednesday, March 27, 2013 at 8:28 PM, Rebecca Hauck wrote:

> Hey Tobie,
> 
> I'm actually just about to send a pull request with this modification to
> Robin's script - just happen to be working on that right now :)
> 
> But to answer your question, you get the data like this:
> 
> To get everything:
> http://test.csswg.org/shepherd/api/coverage
> 
> 
> For just one spec:
> http://test.csswg.org/shepherd/api/coverage?spec=[spec-shortname]
> 
> Where spec-shortname are the "name" keys from the first query.
> 
> So here are the ones you're after:
> http://test.csswg.org/shepherd/api/coverage?spec=css3-multicol
> 
> http://test.csswg.org/shepherd/api/coverage?spec=css3-color
> 
> http://test.csswg.org/shepherd/api/coverage?spec=css3-transforms
> 
> http://test.csswg.org/shepherd/api/coverage?spec=css3-background
> 
> http://test.csswg.org/shepherd/api/coverage?spec=css21
> 
> 
> I'll send another note shortly when the script is ready.
> 
> Cheers,
> -Rebecca
> 
> 
> 
> On 3/27/13 12:16 PM, "Tobie Langel" <tobie@w3.org (mailto:tobie@w3.org)> wrote:
> 
> > Hi, 
> > 
> > I'm trying to get the number of test contained in the following test
> > suites using the Shepherd API:
> > 
> > - CSS3 module: Multi-column layout
> > - CSS Color Module Level 3
> > - CSS Transforms
> > - CSS Backgrounds and Borders Module Level 3
> > - Cascading Style Sheets, level 2 (CSS2) Specification
> > 
> > 
> > Unfortunately, I'm failing to get this information for Multi-column
> > layout and CSS2.1.
> > 
> > I'm just curling into the them like so:
> > 
> > $ curl -H "Accept: application/json"
> > http://test.csswg.org/harness/status/?s=CSS21_DEV
> > $ curl -H "Accept: application/json"
> > http://test.csswg.org/harness/status/?s=CSS3-MULTICOL_DEV
> > 
> > I'm getting JSON back, but the output only contains a single element in
> > the sections property which sports zero test cases.
> > 
> > What am I doing wrong?
> > 
> > Thanks,
> > 
> > --tobie 
Received on Wednesday, 27 March 2013 20:01:46 UTC

This archive was generated by hypermail 2.3.1 : Wednesday, 27 March 2013 20:01:53 UTC