W3C home > Mailing lists > Public > site-comments@w3.org > July 2012

Re: robots.txt on dvcs.w3.org and w3.org

From: Ian Jacobs <ij@w3.org>
Date: Wed, 11 Jul 2012 07:45:41 -0500
Cc: "site-comments@w3.org" <site-comments@w3.org>
Message-Id: <02F3ABFE-7209-4657-A641-C16362164837@w3.org>
To: "Simon Pieters" <simonp@opera.com>

On 11 Jul 2012, at 6:50 AM, Simon Pieters wrote:

> Hi,
> 
> http://dvcs.w3.org/robots.txt disallows all robots except W3C-checklink. http://www.w3.org/robots.txt disallows all robots for /Bugs/. This makes it hard to find specs on dvcs.w3.org and bugs on w3.org/Bugs/ with search engines. Can this be changed, please?
> 
Hi Simon,

I'll send to the Systems Team. Thanks!

Ian


> -- 
> Simon Pieters
> Opera Software
> 
> 

--
Ian Jacobs (ij@w3.org)    http://www.w3.org/People/Jacobs/
Tel:                                      +1 718 260 9447
Received on Wednesday, 11 July 2012 12:45:47 GMT

This archive was generated by hypermail 2.2.0+W3C-0.50 : Wednesday, 24 October 2012 16:21:34 GMT