Re: Language label

> > Spiders that are interested in docs in only one language need language
> > information when a HEAD is done.  From this they will decise if doing a
> > GET.
> 
> Hmmm... This way they won't collect all the links they could.

You are right.  But this allow designers of spiders to different
strategies: the web will become larger and identifiying the most promising
set of docs is important.

Tomas