Re: Disabled stats

Hi, Renoir:

The robots.txt file is just pointing to the generated site maps. Isn't the
problem the server redirects?

Thanks.

J


----------------------------
julee@adobe.com
@adobejulee





-----Original Message-----
From: Renoir Boulanger <renoir@w3.org>
Date: Monday, August 19, 2013 10:09 AM
To: julee <jburdeki@adobe.com>
Cc: Ryan Lane <rlane32@gmail.com>, Patrick D'Souza <pdsouza@about.com>,
Doug Schepers <schepers@w3.org>, WebPlatform Public List
<public-webplatform@w3.org>, "public-wpd-analytics@w3.org"
<public-wpd-analytics@w3.org>
Subject: Re: Disabled stats

>Ok.
>
>I'll do the manual thing I'm doing.
>
>1.  Can I have the proper robots.txt config that should be at the root.
>
>I read from Ryan that this might help wit the load generated by crawlers
>because it is indexing unneeded and heavy database hits pages.
>
>2.  My current status is to finalize full import into git of the web
>application to have it run locally and then tweak and test them prior to
>make such big changes.
>
>Regards
>
>Renoir Boulanger | Developer operations engineer
>W3C | webplatform.org
>
>http://w3.org/people/#renoirb  ✪  https://renoirboulanger.com  ✪  @renoirb
>~

Received on Monday, 19 August 2013 17:13:56 UTC