[Bug 5718] Problem validating CSS files with UTF-8 characters

http://www.w3.org/Bugs/Public/show_bug.cgi?id=5718

           Summary: Problem validating CSS files with UTF-8 characters
           Product: CSSValidator
           Version: CSS Validator
          Platform: PC
        OS/Version: Windows XP
            Status: NEW
          Severity: normal
          Priority: P2
         Component: CSS 2.1
        AssignedTo: dave.null@w3.org
        ReportedBy: radu_coravu@sync.ro
         QAContact: www-validator-cvs@w3.org


As far as I can see in the specification CSS files can contain all possible
Unicode characters if the "@charset" declaration in them allows that.

There seem to be 2 problems in the CssParser.jj file.
First, in the options{} block you should set the "UNICODE_INPUT = true;"
property so that the parser can handle unicode chars if the reader was
correctly built.
Then, the NONASCII token should probably be declared as:  ~["\000"-"\177"]
This means anything but ASCII.

I will try to attach 2 test files. The XML is correctly displayed in Firefox
but the validator complains about the CSS file