Re: [whatwg/encoding] Amount of bytes to sniff for encoding detection (#102) from Anne van Kesteren on 2017-04-25 (public-webapps-github@w3.org from April 2017)

From: Anne van Kesteren <notifications@github.com>
Date: Tue, 25 Apr 2017 01:26:05 -0700
To: whatwg/encoding <encoding@noreply.github.com>
Cc: Subscribed <subscribed@noreply.github.com>
Message-ID: <whatwg/encoding/issues/102/296957573@github.com>

I think Firefox uses at 1024 bytes and I think that is what we should aim for anything where we need to resort to sniffing (it seems like that discussion isn't over yet either; when we need to sniff and for which encodings).

The more bytes you wait for the longer it takes for the user to see anything, especially on slower connections. (Although I guess you can still start decoding ASCII bytes in some generic decoder maybe as long as you don't get special ISO-2022-JP bytes wrong, since we should not sniff for UTF-16. (Or should we sniff for UTF-16? I believe WebKit does it, but only for the first couple of bytes so that would not matter here.))

-- 
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
https://github.com/whatwg/encoding/issues/102#issuecomment-296957573

Received on Tuesday, 25 April 2017 08:26:40 UTC