[Bug 2346] Allow link validator to check links to Link, and Markup, Validators

http://www.w3.org/Bugs/Public/show_bug.cgi?id=2346

           Summary: Allow link validator to check links to Link, and Markup,
                    Validators
           Product: LinkChecker
           Version: unspecified
          Platform: All
               URL: http://validator.w3.org/robots.txt
        OS/Version: Windows XP
            Status: NEW
          Keywords: Usability
          Severity: minor
          Priority: P2
         Component: checklink
        AssignedTo: ville.skytta@iki.fi
        ReportedBy: Otto.Stolz@uni-konstanz.de
         QAContact: www-validator-cvs@w3.org


The W3C link validator balks on any link to http://validator.w3.org/checklink,
or to http://validator.w3.org/check; quote:
  http://validator.w3.org/checklink?uri=...&hide_type=all&depth=&check=Check
    What to do: The link was not checked due to robots exclusion rules.
    Check the link manually.
    Response status code: (N/A)
    Response message: Forbidden by robots.txt
    Line: 425
http://validator.w3.org/check?url=...&outline=
    What to do: The link was not checked due to robots exclusion rules.
    Check the link manually.
    Response status code: (N/A)
    Response message: Forbidden by robots.txt
    Line: 413

Note that the HTML validator even recommends to include, in the
pages to be checked, a link to itself; yet, the link checker on
the very same domain does not check those recommendend links.

Please include in http://validator.w3.org/robots.txt the following code:
  User-Agent: W3C-checklink
  Disallow:

Received on Monday, 17 October 2005 13:21:06 UTC