Re: checklink: improvement suggestions

David Dorward wrote:

> I believe that the syntax of robots.txt requires a URL relative to the root
> of the site that the robots.txt file appears on. Since the scheme is
> different, then the site is different, so the format can't support this
> (without introducing proprietary extensions, which I would avoid if at all
> possible).

Yes, the sitemaps.org invention of Sitemap: <URI> is already on the border.

Javascript URIs doing anything else than allowing to bookmark favlets are
ugly, there should be better ways to confuse address harvesters.  My trick
is to use use an ordinary http URL redirected to a mailto URL.

Frank

Received on Thursday, 17 May 2007 21:03:22 UTC