- From: Just a bot via GitHub <sysbot+gh@w3.org>
- Date: Fri, 07 Jul 2017 10:05:54 +0000
- To: public-webrtc-testsuite@w3.org
wpt-pr-bot has just labeled a pull request from soareschen for https://github.com/w3c/web-platform-tests as "wg-webrtc": == Reorganize coverage report for set session description == This is another attempt for me to organize the coverage information for the test files. It has been very difficult to track what has been tested and not tested for webrtc-pc, especially for section 4.3.1.6. Set the RTCSessionSessionDescription. The section contains a large number of steps across multiple domains, making it impossible to test all logic in a single test files. Instead, the logic for 4.3.16. is tested across many test files that test particular methods. This creates problem when trying to relate the tests and the spec, because there is no central reference point for where are the tests for each step. The current manual approach has been to read the content for each step, guess which test file might cover that step, and go into the particular test file to search for the test. This can slow down productivity significantly when things need to be updated routinely. To solve this problem, I created a new coverage/ directory and have a text file that annotate whether a step has been covered, and which test file cover which step. This should make it easy to keep track of the tests. The coverage report is currently has adhoc annotation and cannot be parsed easily, but it gets the job done for now. In the future if this approach is working well, we can transition to a format that is both machine and human friendly so that aggregated coverage report can be generated automatically. See https://github.com/w3c/web-platform-tests/pull/6491
Received on Friday, 7 July 2017 10:06:00 UTC