Downtime - What went wrong ?

Well, there’s a first time for everything, and on Tuesday morning we had our first serious outage. So, what went wrong ? Well, to be absolutely honest, we’re not exactly sure, since an issue with the application server software pulled the rug out from under the feet of our monitoring and logging systems, and hence everything vanished in a puff of bad logic.

But we’ve learnt our lesson, and we’ve now got monitoring systems monitoring the systems which monitor the systems running the monitoring systems, so hopefully we’ve not only got it covered, but we should be able to come up with pre-emptive measures in the future.

We’re not going to promise it won’t happen again. We’re not insane. But hopefully it’s a lot less likely.

We’re very sorry for the loss of service, and especially for anybody who lost work in the Game Creator.

Related posts

Tags: