[Bug 5122] [FT] Section 4 Tokenization constraint

http://www.w3.org/Bugs/Public/show_bug.cgi?id=5122


holstege@mathling.com changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |RESOLVED
         Resolution|                            |FIXED




------- Comment #1 from holstege@mathling.com  2007-10-11 21:40 -------
Agreed to at f2f meeting 11 Oct 2007:
Change text to:
The tokenizer SHOULD, when
tokenizing two equal items, identify the same tokens in each.
The cases where tokenization of two equal items does not
identity the same tokens in each is implementation-defined.

Received on Thursday, 11 October 2007 21:40:15 UTC