Client HTTP headers survey

Hi Dom,

I was wondering if you had thought of collecting the HTTP headers sent by clients automatically with the W3C test harness. [1]
It would be good to collect them in the future. It gives an interesting picture of what clients are expecting to receive. 

We (at Opera Developers Relations team) were wondering what was the diversity in these headers. We were also thinking that it could be interesting to have such a catalog for developers to test their Web site by faking different type of agents. 

* Automatic testing scenario
* Validators
* Debugging tools
* etc.

Opinions?

[1]: http://www.w3.org/2007/03/mth/harness

ps: below a list of few headers I collected myself to have a hunch on the diversity.

# SAFARI

accept: application/xml,application/xhtml+xml,text/html;q=0.9,text/plain;q=0.8,image/png,*/*;q=0.5
accept-encoding: gzip, deflate
accept-language: fr-fr
connection: keep-alive
host: 127.0.0.1:8080
user-agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10_6_6; fr-fr) AppleWebKit/533.19.4 (KHTML, like Gecko) Version/5.0.3 Safari/533.19.4



# FIREFOX

accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
accept-charset: UTF-8,*
accept-encoding: gzip, deflate
accept-language: fr,fr-fr;q=0.8,en;q=0.6,en-us;q=0.4,ja;q=0.2
connection: keep-alive
host: 127.0.0.1:8080
keep-alive: 115
user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:2.0b10) Gecko/20100101 Firefox/4.0b10


# OPERA 

accept: text/html, application/xml;q=0.9, application/xhtml+xml, image/png, image/jpeg, image/gif, image/x-xbitmap, */*;q=0.1
accept-charset: iso-8859-1, utf-8, utf-16, *;q=0.1
accept-encoding: deflate, gzip, x-gzip, identity, *;q=0
accept-language: fr,en;q=0.9,en-US;q=0.8,ja;q=0.7,pt;q=0.6,de;q=0.5,zh-CN;q=0.4,es;q=0.3,it;q=0.2,nl;q=0.1,sv;q=0.1,nb;q=0.1,da;q=0.1,fi;q=0.1,zh-TW;q=0.1,ko;q=0.1,pl;q=0.1,pt-PT;q=0.1,ru;q=0.1
cache-control: no-cache
connection: Keep-Alive, TE
host: 127.0.0.1:8080
pragma: no-cache
te: deflate, gzip, chunked, identity, trailers
user-agent: Opera/9.80 (Macintosh; Intel Mac OS X 10.6.6; U; fr) Presto/2.7.62 Version/11.01

# OPERA MOBILE EMULATOR

accept: text/html, application/xml;q=0.9, application/xhtml+xml, multipart/mixed, application/vnd.wap.multipart.mixed, image/png, image/jpeg, image/gif, image/x-xbitmap, */*;q=0.1
accept-charset: iso-8859-1, utf-8, utf-16, *;q=0.1
accept-encoding: deflate, gzip, x-gzip, identity, *;q=0
accept-language: en
connection: Keep-Alive
host: 127.0.0.1:8080
user-agent: Opera/9.80 (Macintosh; Intel Mac OS X; Opera Mobi/7457; U; fr) Presto/2.5.28 Version/10.1
x-ebo-ua: BID=1.3.0, BCReq=D38306041663E6745071FC814126DD41


# CURL

accept: */*
host: 127.0.0.1:8080
user-agent: curl/7.19.7 (universal-apple-darwin10.0) libcurl/7.19.7 OpenSSL/0.9.8l zlib/1.2.3


# NETNEWSWIRE PRO (webkit)

accept: application/xml,application/xhtml+xml,text/html;q=0.9,text/plain;q=0.8,image/png,*/*;q=0.5
accept-encoding: gzip, deflate
accept-language: fr-fr
connection: keep-alive
host: 127.0.0.1:8080
user-agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10_6_6; fr-fr) AppleWebKit/533.19.4 (KHTML, like Gecko) NetNewsWire/3.2.7


# BLUEGRIFFON (Authoring tool based on Mozilla)

accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
accept-charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
accept-encoding: gzip, deflate
accept-language: en-us,en;q=0.5
cache-control: no-cache
connection: keep-alive
host: 127.0.0.1:8080
keep-alive: 115
pragma: no-cache
user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:2.0b9pre) Gecko/20110111 BlueGriffon/0.9

# CAMINO

accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
accept-charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
accept-encoding: gzip,deflate
accept-language: fr,en-US;q=0.9,en;q=0.8,ja;q=0.7,pt;q=0.6,de;q=0.5,zh-Hans;q=0.4,es;q=0.3,it;q=0.2,nl;q=0.1
connection: keep-alive
host: 127.0.0.1:8080
keep-alive: 115
user-agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en; rv:1.9.2.5pre) Gecko/20100531 Camino/2.1a1pre (like Firefox/3.6.5pre)


# HTTP CLIENT (tool on the mac where you can specify everything)

connection: close
host: 127.0.0.1:8080
user-agent: HTTP%20Client/0.9.1 CFNetwork/454.11.5 Darwin/10.6.0 (i386) (MacBookPro7%2C1)


-- 
Karl Dubost - http://dev.opera.com/
Developer Relations & Tools, Opera Software

Received on Wednesday, 23 February 2011 16:46:28 UTC