Re: Language label

M.T. Carrasco Benitez wrote:
> > Indexing engines are downloading the whole page. They have to make summary
> > and extract links to other documents. Spiders are doing HEAD requests
> > to find out if the documents were recently changed or deleted. They don't
> > need language information.
> 
> Spiders that are interested in docs in only one language need language
> information when a HEAD is done.  From this they will decise if doing a
> GET.

Hmmm... This way they won't collect all the links they could.

> > Well, since text/html without charset parameter is Latin 1, anything before
> > META is Latin 1. Unless everything is what META says it is. :)
> 
> No.  Only one charset is allowed per doc. 

You are right here.

-- 
They work 24 hours a day and 256 days a year  --  root@fly.cc.fer.hr

dave@srce.hr
dave@fly.cc.fer.hr

Received on Friday, 28 February 1997 05:22:12 UTC