TestGL - test material for CR vs for Recs

Issue: differentiate between test materials for CR and those for Recs.

As part of the TestGL, we need to ensure that we address or don't preclude 
the reality that test suites developed at the CR stage may be different 
than a test suite at the Rec stage.  The objectives for these test suites 
are often very different - for example: for CR the objective may be to 
'test the specification', whereas a test suite for a Rec is targeting 
implementations.  This was the case with XSL-FO.  The tests focused on 
specific behavior, not entire modules, sections, etc.   It tested for 
things outside the scope of the specification - since it wanted to see what 
implementers were doing so that the spec writers could determine if they 
wanted to refine the behavior, remove it, or make it broader.

Since we advocate having tests for CR exit, we need to consider 
this.  Thus, we need words in the Introduction and/or CPs to capture the 
idea that tests for CR may be different and may not need to do all the CPs 
in TestGL (e.g., maintenance of tests).

I don't know exactly how to capture this in terms of text for the TestGL.

lynne

Received on Wednesday, 11 December 2002 08:25:51 UTC