W3C home > Mailing lists > Public > www-html@w3.org > June 2005

Re: Question about web spiders...

From: Jasper Bryant-Greene <jasper@bryant-greene.name>
Date: Sun, 26 Jun 2005 12:56:56 +1200
Message-ID: <42BDFD58.20204@bryant-greene.name>
To: Peter Kupfer <peter.kupfer@sbcglobal.net>
CC: www-html@w3.org

Peter Kupfer wrote:
> [snip]
> Questions:
> 
> 1) Is there another way to accomplish what I am trying to accomplish?
> 2) Does the W3C plan to implement the <nofollow> tag or anything like it
> in the near future?
> 
> I want to be standards compliant, but I also want to be able to tell a
> spider where it can and can not go.

I'm not sure about your specific spider, but the commonly accepted way
to do what you describe is something like:

<a href="http://www.example.org/" rel="nofollow">Link</a>

That's perfectly standards compliant, and Googlebot obeys that, as well
as several other major spiders AFAIK.

As I said, I can't speak for your specific spider. You could ask them to
implement it if they don't, it wouldn't be hard if they already
implement <nofollow>.

Jasper
Received on Sunday, 26 June 2005 00:56:07 UTC

This archive was generated by hypermail 2.3.1 : Wednesday, 5 February 2014 07:19:03 UTC