Common Crawl for testing effect of COEP/etc. rollouts?

James Richards at Nominet just did a DNS-related study using computed 
metadata (WAT) from the Common Crawl datasets.

The WAT format contains both HTTP headers as well as a catalog of all 
links on the page.  I wonder if this dataset might be useful for 
estimating the effects of COEP and similar changes, perhaps in lieu of 
or in advance of origin trials and similar live mechanisms.

Info on the data format:
https://commoncrawl.org/the-data/get-started/#WAT-Format

The presentation that led me here:
https://indico.dns-oarc.net/event/40/contributions/886/attachments/842/1558/oarc-cc-presentation-james-richards.pdf

-- Sam

Received on Thursday, 2 December 2021 20:33:27 UTC