- From: Peter Moulder <peter.moulder@monash.edu>
- Date: Fri, 07 Jan 2011 20:44:43 +0000
- To: www-style@w3.org
The existing note implies that the behaviour of comment-like substrings within URI tokens is not "normal tokenization behavior". This creates confusion as to what "normal tokenization behavior" is. My understanding of the text outside of this note is that it is not normal tokenization behaviour to allow a token within another token, and that it is normal tokenization behaviour for ‘url(/*hello)’ to be parsed as a single URI token (by longest match rules), and that it is (in contrast) normal tokenization behaviour for ‘u(/*hello)’ to be parsed as a FUNCTION token followed by a BAD_COMMENT token. If that understanding is correct, then I suggest rewording to | Note that COMMENT tokens cannot occur within other tokens: | thus, "url(/*x*/pic.png)" denotes the URI "/*x*/pic.png", | not "pic.png". pjrm.
Received on Friday, 7 January 2011 20:45:14 UTC