Re: robots.txt on dvcs.w3.org and w3.org

On 11 Jul 2012, at 6:50 AM, Simon Pieters wrote:

> Hi,
> 
> http://dvcs.w3.org/robots.txt disallows all robots except W3C-checklink. http://www.w3.org/robots.txt disallows all robots for /Bugs/. This makes it hard to find specs on dvcs.w3.org and bugs on w3.org/Bugs/ with search engines. Can this be changed, please?
> 
Hi Simon,

I'll send to the Systems Team. Thanks!

Ian


> -- 
> Simon Pieters
> Opera Software
> 
> 

--
Ian Jacobs (ij@w3.org)    http://www.w3.org/People/Jacobs/
Tel:                                      +1 718 260 9447

Received on Wednesday, 11 July 2012 12:45:47 UTC