Re: W3ID Latency

On Sun, Jul 20, 2025 at 10:32 PM Michael Milton <milton.m@wehi.edu.au>
wrote:

> W3IDs are failing to resolve or loading very slowly. A good example is
> https://w3id.org/ro/crate/1.1/context and even
> https://w3id.org/WEHI-SODA-Hub/omerocrate/upload (which doesn’t have
> anything it’s supposed to resolve to) takes a long time to 404.
>
>
>
> Is there an issue with the proxy server?
>
>
>

It wasn't any URL in particular, it was bots getting out of control
scraping many URLs.  I got *lots* of monitoring alerts for the issue around
when this was opened.  I'm not sure what to do about it but throw more
money/resources at the problem?  While the request rates are higher, they
look like a totally reasonable rate for the system to handle.  We'll keep
an eye on it and have some thoughts on mitigations, but the issue has been
rare so far, so the "wait and it'll be fine" theory has worked.

-dave