- From: Renoir Boulanger <renoir@w3.org>
- Date: Mon, 19 Aug 2013 13:09:22 -0400
- To: Julee Burdekin <jburdeki@adobe.com>
- Cc: Ryan Lane <rlane32@gmail.com>, Patrick D'Souza <pdsouza@about.com>, Doug Schepers <schepers@w3.org>, WebPlatform Community <public-webplatform@w3.org>, public-wpd-analytics@w3.org
Ok. I'll do the manual thing I'm doing. 1. Can I have the proper robots.txt config that should be at the root. I read from Ryan that this might help wit the load generated by crawlers because it is indexing unneeded and heavy database hits pages. 2. My current status is to finalize full import into git of the web application to have it run locally and then tweak and test them prior to make such big changes. Regards Renoir Boulanger | Developer operations engineer W3C | webplatform.org http://w3.org/people/#renoirb ✪ https://renoirboulanger.com ✪ @renoirb ~
Received on Monday, 19 August 2013 17:09:33 UTC