W3C home > Mailing lists > Public > www-qa@w3.org > May 2002

Re: Testable assertion tagging for W3C specifications

From: Charles McCathieNevile <charles@w3.org>
Date: Mon, 6 May 2002 17:29:48 -0400 (EDT)
To: Alex Rousskov <rousskov@measurement-factory.com>
cc: <spec-prod@w3.org>, <w3c-query-editors@w3.org>, <www-qa@w3.org>
Message-ID: <Pine.LNX.4.30.0205061729400.5803-100000@tux.w3.org>
Good point.

Chaals

On Mon, 6 May 2002, Alex Rousskov wrote:

  On Mon, 6 May 2002, Charles McCathieNevile wrote:

  > ... not being able to test whether a specification is being met
  > means that it is less a specification than a general description
  > of an idea.

  I do not think the above is true in general. For example, there are
  numerous working implementations of HTTP specs while many HTTP
  statements cannot be tested in a pragmatic way. The primary goal of a
  specification is to enable building [compliant] implementations. This
  goal is different from enabling [compliance] tests.

  It would be great if all specs were 100% testable, but I do not think
  it is possible in practice, regardless of the specs language. My
  belief is based on a simple fact that both black- and white-box
  testing techniques cannot achieve 100% coverage of a complex program
  implementing the specs.


  Testability should definitely be a priority, but it would be sad if we
  get fewer good specs by accepting rigid and expensive testability
  requirements. A poor solution is often worse than a simple
  acknowledgment of the problem.

  Alex.






-- 
Charles McCathieNevile    http://www.w3.org/People/Charles  phone: +61 409 134 136
W3C Web Accessibility Initiative     http://www.w3.org/WAI  fax: +33 4 92 38 78 22
Location: 21 Mitchell street FOOTSCRAY Vic 3011, Australia
(or W3C INRIA, Route des Lucioles, BP 93, 06902 Sophia Antipolis Cedex, France)
Received on Monday, 6 May 2002 17:29:49 UTC

This archive was generated by hypermail 2.4.0 : Friday, 17 January 2020 22:43:19 UTC