- From: Ville Skytta via cvs-syncmail <cvsmail@w3.org>
- Date: Sun, 07 Mar 2010 16:34:37 +0000
- To: www-validator-cvs@w3.org
Update of /sources/public/perl/modules/W3C/LinkChecker/docs
In directory hutz:/tmp/cvs-serv31031/docs
Modified Files:
checklink.html
Log Message:
Comment updates.
Index: checklink.html
===================================================================
RCS file: /sources/public/perl/modules/W3C/LinkChecker/docs/checklink.html,v
retrieving revision 1.58
retrieving revision 1.59
diff -u -d -r1.58 -r1.59
--- checklink.html 4 Feb 2010 19:15:47 -0000 1.58
+++ checklink.html 7 Mar 2010 16:34:35 -0000 1.59
@@ -245,7 +245,7 @@
<h2><a name="bot" id="bot">Robots exclusion</a></h2>
<p>
- As of version 4.0, the link checker honors
+ The link checker honors
<a href="http://www.robotstxt.org/wc/exclusion.html#robotstxt">robots exclusion rules</a>. To place rules specific to the W3C Link Checker in
<code>/robots.txt</code> files, sites can use the
<code>W3C-checklink</code> user agent string. For example, to allow
Received on Sunday, 7 March 2010 16:34:38 UTC