Quote marks allowed unmatched in core grammar (CSS2)

The core grammar of CSS2 (at
<http://www.w3.org/TR/REC-CSS2-19980512/syndata.html#tokenization>) allows
unmatched quote marks as delimiters.

Consider the following one-rule stylesheet.

e{p:"}

Since there is no partner for the quote mark, it is impossible to parse as
a string.  Following are the tokens of the given style sheet according to
the core grammar.

IDENT: 'e';
{:     '{';
IDENT: 'p';
DELIM: ':';
DELIM: '"';
}:     '}';

I assume that the intent was not to allow such usage.  To prohibit such
usage, we should add token types for quote marks so that unmatched quote
marks do not return a 'DELIM' token.

--
Etan Wexler <mailto:ewexler@stickdog.com>