> Indexing engines are downloading the whole page. They have to make summary > and extract links to other documents. Spiders are doing HEAD requests > to find out if the documents were recently changed or deleted. They don't > need language information. Spiders that are interested in docs in only one language need language information when a HEAD is done. From this they will decise if doing a GET. > Well, since text/html without charset parameter is Latin 1, anything before > META is Latin 1. Unless everything is what META says it is. :) No. Only one charset is allowed per doc. TomasReceived on Friday, 28 February 1997 05:12:55 GMT
This archive was generated by hypermail 2.2.0+W3C-0.50 : Tuesday, 2 June 2009 19:16:47 GMT