W3C home > Mailing lists > Public > public-test-infra@w3.org > April to June 2014


From: Robin Berjon <robin@w3.org>
Date: Mon, 14 Apr 2014 17:56:13 +0200
Message-ID: <534C051D.2020607@w3.org>
To: public-test-infra <public-test-infra@w3.org>

you've likely seen the various reports I've been producing recently 
using the test data that we're starting to gather.

So far they've been using ad hoc scripts, but I naturally got tired of 
repeating myself so I packaged them all in a single easy-to-use source.

You can get it as follows:

     npm install -g wptreport

After that you can just use `wptreport` as a regular command line tool. 
It expects a directory with data files following the pattern 
^\w\w\d\d\.json$ (e.g. Ch30.json, Fx27.json) and will use the 
extension-less name as the name for that implementation in the report.

The hope is to make it easy to produce reports that look nice. Right now 
there are a few problems with the layout that make it painful to use on 
smaller screens/windows but I've logged the issues and will address them.

Currently it outputs three reports:

   • all.html which has all the results
   • less-than-2.html for all your process need
   • complete-fails.html which lists all tests that fail everywhere

I'm happy to add new reports if you have suggestions. I also intend to 
add some navigation so that it's easy to go from one to another.

You can file bugs, PRs, etc. on https://github.com/darobin/wptreport/.

$ wptreport -h
wptreport [--input /path/to/dir] [--output /path/to/dir] [--spec SpecName]

    Generate nice-looking reports of various types based on test run
    reports coming out of Web Platform Tests.

    --input, -i  <directory> that contains all the JSON. JSON files must
                 match the pattern \w{2}\d{d}\.json. Defaults to the
                 current directory.
    --output, -o <directory> where the generated reports are stored.
                 Defaults to the current directory.
    --spec, -s SpecName to use in titling the report.
    --help       Produces this message.
    --version    Produces the version number.

Robin Berjon - http://berjon.com/ - @robinberjon
Received on Monday, 14 April 2014 15:56:22 UTC

This archive was generated by hypermail 2.4.0 : Friday, 17 January 2020 17:34:10 UTC