Re: [specref] Downtime post-mortem

In particular since most of us never sleep.

On Fri, Mar 4, 2016 at 7:53 AM, Tobie Langel <tobie@codespeaks.com> wrote:

> As another mitigation strategy for such issues, I've given access to the
> app to Dom, Shane and Marcos.
>
> We should pretty much have all timezones covered with these three.
>
> --tobie
>
> On Fri, 4 Mar 2016, at 12:59, Tobie Langel wrote:
> > Hi all,
> >
> > Sorry Specref was down for a number of hours overnight as I deployed a
> > buggy app refactor and failed to see that the app was crashing despite
> > checking the logs.
> >
> > Lessons learned:
> > - the app needs tests, not only the data,
> > - Papertrail logs don't differentiate enough failed and served requests,
> > so check the app too,
> > - Don't push code late a night.
> >
> > Apologies,
> >
> > --tobie
>
>


-- 
Shane McCarron
Projects Manager, Spec-Ops