W3C home > Mailing lists > Public > public-webapps@w3.org > July to September 2011

Re: Test suites and RFC2119

From: Larry Masinter <masinter@adobe.com>
Date: Mon, 18 Jul 2011 00:58:22 -0700
To: "public-webapps@w3.org" <public-webapps@w3.org>
Message-ID: <C68CB012D9182D408CED7B884F441D4D05CB12A4B9@nambxv01a.corp.adobe.com>
It's best to view RFC 2119 in the context of IETF rules for interoperability:

Progression along standards track depends on there being multiple independent interoperable implementations of every feature.

While "feature" is not clearly defined, I believe that in a well-written specification, any normative language (MUST, MAY, SHOULD) is associated with a feature.

Two implementations "interoperate" and are "interoperable implementations of a feature" if they both implement the feature and "interoperate".
"interoperate" is interpreted slightly differently by the context, but if you think a web page is an implementation and a browser is an implementation, then they "interoperate" if the browser does what the author of the web page expected.

"MAY" features are not required to be implemented, but if they are implemented, they should operate as described in the spec and the interoperable implementations treat the feature as expected.

"MUST" features are required to be implemented.  A well-written spec only mandates "MUST" in cases where it is required for interoperability.

For test suites, it seems best to treat 'SHOULD' as if it were 'MUST but you can apply for a waiver'.

That is, test cases should test for SHOULD, but there are situations or contexts where interoperability is accomplished some other way... and that the way to test for "SHOULD" is to test as if it were "MUST", but let the implementor provide a convincing proof of why not following the normative language does not interfere with interoperability.


Larry
--
http://larry.masinter.net
Received on Monday, 18 July 2011 07:59:01 GMT

This archive was generated by hypermail 2.3.1 : Tuesday, 26 March 2013 18:49:46 GMT