Re: Disabled stats

Getting 503s now. J


From: Renoir Boulanger <<>>
Date: Monday, August 19, 2013 5:48 AM
To: Ryan Lane <<>>
Cc: Patrick D'Souza <<>>, Doug Schepers <<>>, WebPlatform Public List <<>>, "<>" <<>>
Subject: Re: Disabled stats

I just started my day and it appears that it was in a similar state and I just had to do the same 'flush hosts' again myself.

Let's see what is the cause.

I'll coordinate with Doug and Ryan about it.


On 2013-08-18, at 3:22 AM, Ryan Lane <<>> wrote:

I flushed hosts on the dbs. I'm in a connection in narita airport, so if it happens again I won't be around...

On Sun, Aug 18, 2013 at 12:42 PM, Patrick D'Souza <<>> wrote:
Hi, is returning a 503 No healthy backends error right now.

- Patrick

On 08/17/2013 03:10 PM, Doug Schepers wrote:
Hi, Folks–

As you know, Renoir, Ryan, and Garbee tracked down the source of some of the site's recent stability problems to Piwik, our analytics software. Renoir has been working on fixing this, and has a plan in place which he'll implement on Monday.

In the meantime, because Piwik caused intermittent 503s on Friday, Renoir disabled Piwik until Monday. It's no use tracking usage on a site if the site isn't up. :)

We apologize for the inconvenience, and hope that this stabilizes the site enough that you can use it without problems. We'll get the tracking back and stable ASAP.

Please do report if you still see any 503s or other errors.


-------- Original Message --------
Subject: Disabled stats
Resent-Date: Sat, 17 Aug 2013 15:06:41 +0000
Date: Sat, 17 Aug 2013 11:06:31 -0400
From: Renoir Boulanger <><>
Just a heads up.

I disabled piwik1..3 from fastly and modified piwik0 to serve a static file showing: 'temporarily disabled'.

Site and nodes are now all healthy and working again.

Lets work on that monday.

Renoir Boulanger | Developer operations engineer
W3C |<><>  ✪  @renoirb

Received on Monday, 19 August 2013 16:47:26 UTC