[Bug 3756] Pre-canonicalize the testsuite

http://www.w3.org/Bugs/Public/show_bug.cgi?id=3756





------- Comment #9 from per@bothner.com  2006-09-22 05:54 -------
(In reply to comment #8)
> What I do is to first compare my test results with the published results as a
> simple string compare. Only if that fails do I try to canonicalize. If, as you
> suggest, most of the results are in canonical form already, this procedure
> efectively eliminates any performance impact of canonicalization.

That is certainly a practical work-around. But we're talking about a testsuite,
and running the testsuite should be as simple and regular as possible, to avoid
artifacts and errors in the testsuite and testing framework.  The more
complicated the comparison is, and the more different ways we try finding a
match between expected and actual output, then the greater the risk of errors
in the testing framework or otherwise missing actual bugs in the
implementation.

Received on Friday, 22 September 2006 05:55:01 UTC