[css-syntax] tokenizer consume url


when trying to implement a tokenizer according to the CSS Sybtax CR 20 
February 2014, I encountered the following problem.

input: url("foo")

 From 4.3.1 we go to 4.3.3, consuming code points up to and including 
'(', then to 4.3.5

   4. If the next input code point is a U+0022 QUOTATION MARK (") or
      U+0027 APOSTROPHE (‘), then:
     1. Consume a string token with the current input code point as the
        ending code point.

Because the '"' has not yet been consumed, the current code point is 
still '('. But 4.3.4 should be called with '"' as ending code point instead.

So I propose to add 'consume it' after
   U+0022 QUOTATION MARK (") or U+0027 APOSTROPHE (‘)
in 4.3.5 step 4.

BTW, there is some strange markup:
<code class="css">), then: </code>
Johannes Koch
In te domine speravi; non confundar in aeternum.
                             (Te Deum, 4th cent.)

Received on Monday, 3 March 2014 20:00:48 UTC