Members Login
Username 
 
Password 
    Remember Me  
 

Topic: Ref: The down time we experienced yesterday

Page 1 of 1  sorted by
Moderator
Status: Offline
Posts: 2408
Date:

Ref: The down time we experienced yesterday

Permalink  
 

The whole of Sparklit was down yesterday, their website and all connected to it - everything. Here is their response

 

 

Hi there,

 

Earlier today we experienced a complete outage that left us in a tough situation. Our network peering provider, PEER1, had a failure of equipment which isolated our servers, preventing any connections to the outside world. Due to the unique method of failure, the backup equipment did not kick in. As soon as we knew this was happening, we contacted PEER1 and had the issue resolved as fast as we could.

 

The equipment initially went down at 2:32am PST and we discovered it around7:30am PST, with everything coming back online around 9:55am PST. Although we do not host our own email the equipment failure disrupted it resulting in us not receiving any emails from you. It was only once people started reaching out to us through social media and other channels that we learned what was going on.

 

Although we had fallbacks in place, the lack of communication is where we really slipped. So, that’s why we’re sending out this email, and that’s why we’re going to make some changes moving forward:

 

1.    First, we’re going to establish a 24 hour emergency line for situations like this.

 

2.    Second, we’re also investigating an externally hosted status page.

 

3.    Third, we’re exploring additional monitoring services to let us know if anything is going wrong.

 

4.    Something only tangentially related, but we are in the middle of deploying worldwide ad servers using multiple providers. Once these are launched, if a similar situation to this ever comes up again, even if adbutler.com goes down, ad serving would continue unhindered. This is currently in beta.

 

PEER1 is currently talking to their vendor to find out why their backup equipment didn’t failover when the initial line failed. We are also talking to PEER1 to try and find out if there is a better method to avoid something like this from ever happening again.

 

If you have anymore questions, feel free to send them over to xxxx@sparklit.com.

 

As a whole, we wish to extend our apologies that this happened, and our thanks for your understanding. We’ve got some of the best customers in the biz, and we’re glad to work for you.

 

Thanks,

 

SparkLIT 



__________________

FA Licensed Coach & Referee

 

Reserve Team
Status: Offline
Posts: 176
Date:
Permalink  
 
What is point 2 about?

__________________
Moderator
Status: Offline
Posts: 2408
Date:
Permalink  
 
It appears that it will be a website page somewhere else (not on sparklit's name), that shows a service status and probably ongoing issues. The fact that it all went down and we could get no information other than FaceTube appeared to upset people. When things like that happen (its very rare mind), it would be nice to know what's going on. Although as it affected all and sundry there was no way to communicate that with you lot. At least with this - if I put that status page on here - if it does happen again you can go there and check.


__________________

FA Licensed Coach & Referee

 

Reserve Team
Status: Offline
Posts: 112
Date:
Permalink  
 
Translation...........the computer says no

__________________
Page 1 of 1  sorted by
Quick Reply

Please log in to post quick replies.