W3C home > Mailing lists > Public > www-validator@w3.org > August 2015

Re: Suggestion/Enhancement request: Please add to FAQ: list of User-agents for robots.txt files

From: Andrew Avdeenko <rasprod@tyt.by>
Date: Sun, 02 Aug 2015 16:00:34 +0300
To: www-validator@w3.org
Message-ID: <op.x2qrq8zm278snb@microsof-c0ae01>
Is it possible to deny access to my website for W3C validators using  
robots.txt? If "yes", what user-agent(s) must be specified?
Received on Wednesday, 5 August 2015 21:40:28 UTC

This archive was generated by hypermail 2.3.1 : Tuesday, 1 March 2016 14:18:13 UTC