- From: Guillaume via GitHub <sysbot+gh@w3.org>
- Date: Fri, 01 Nov 2024 10:36:44 +0000
- To: public-css-archive@w3.org
cdoublev has just labeled a pull request from cdoublev for https://github.com/w3c/csswg-drafts as "css-syntax-3": == [css-syntax-3] Remove duplicate token stream creations == [tokenize](https://drafts.csswg.org/css-syntax-3/#css-tokenize) maps a stream of code points into a stream of tokens: > To tokenize a stream of code points **into a stream of CSS tokens** `input`, repeatedly consume a token from `input` until an `<EOF-token>` is reached, pushing each of the returned tokens into a stream. But a stream of tokens is also created with its result: - in [normalize into a token stream](https://drafts.csswg.org/css-syntax-3/#normalize-into-a-token-stream): > 3. [...], [tokenize](https://drafts.csswg.org/css-syntax-3/#css-tokenize) the result, then create a new token stream with those tokens as its tokens, and return it. - in [consume the value of a unicode-range descriptor](https://drafts.csswg.org/css-syntax-3/#consume-the-value-of-a-unicode-range-descriptor): > 1. Let `tokens` be the result of [tokenizing](https://drafts.csswg.org/css-syntax-3/#css-tokenize) [...]. Let `input` be a new token stream from `tokens`. See https://github.com/w3c/csswg-drafts/pull/11129 -- Sent via github-notify-ml as configured in https://github.com/w3c/github-notify-ml-config
Received on Friday, 1 November 2024 10:36:44 UTC