pereplexity and robots.txt

Vagner Diniz sent this article [1] to ac-forum [2]. The part of this 
article that is especially interesting to publishers (aside from the 
commentary about how browsers might be changing):

*"Many publishers have been upset with you for scraping their content. 
You’ve started cutting some of them checks. Do you feel like you’re in a 
good place with publishers now, or do you feel there’s still more work 
to be done?*

I’m sure there’s more work to be done, but it’s in a way better place 
than it was last time we spoke. We are scraping but respecting 
robots.txt. We only use third-party data providers for anything that 
doesn’t allow us to scrape."


[1] 
https://www.theverge.com/command-line-newsletter/656599/perplexitys-ceo-on-fighting-google-and-the-coming-ai-browser-war

[2] https://lists.w3.org/Archives/Member/w3c-ac-forum/2025AprJun/0032.html

-- 
Tzviya Siegman
Sustainability Lead
tzviya@w3.org

Received on Tuesday, 6 May 2025 12:19:11 UTC