Draft submission: Robots Exclusion Protocol

Hi HTTP WG,

As you may have seen, a group has gotten together with Martijn Koster to create an internet-draft which restates the Robots Exclusion Protocol using updated ABNF and prescriptions.  The current draft is (draft-koster-rep).  If you get a chance, we'd appreciate your confirming that it matches your understanding of current practice and that the specification is clear even for edge cases.  You can send mail to me to forward on to the author team or address it to the emails listed in the draft.  

Thanks for your help,
Gary Illyes
Google Switzerland

https://datatracker.ietf.org/doc/draft-koster-rep/ <https://datatracker.ietf.org/doc/draft-koster-rep/>