Re: Suggestion/Enhancement request: Please add to FAQ: list of User-agents for robots.txt files

• From: Andrew Avdeenko <rasprod@tyt.by>
• Date: Sun, 02 Aug 2015 16:00:34 +0300
• To: www-validator@w3.org
• Message-ID: <op.x2qrq8zm278snb@microsof-c0ae01>

Is it possible to deny access to my website for W3C validators using  
robots.txt? If "yes", what user-agent(s) must be specified?

Received on Wednesday, 5 August 2015 21:40:28 UTC