Re: Language label

> Indexing engines are downloading the whole page. They have to make summary
> and extract links to other documents. Spiders are doing HEAD requests
> to find out if the documents were recently changed or deleted. They don't
> need language information.

Spiders that are interested in docs in only one language need language
information when a HEAD is done.  From this they will decise if doing a
GET.

> Well, since text/html without charset parameter is Latin 1, anything before
> META is Latin 1. Unless everything is what META says it is. :)

No.  Only one charset is allowed per doc. 

Tomas

Received on Friday, 28 February 1997 05:12:55 UTC