Monday, February 22, 2010

Site Outage Update

Here is the info I have on what's going on:

Feb 22, 9:00 a.m.

On Saturday, February 20th at approximately 2:20 p.m. MDT, the server your account is on experienced some hardware failure as a result of an annual fire system inspection at our Data Center (DC). An inadvertent release of Inergen was triggered in the DC environment. The release was triggered by an actuator that was not removed as required in the DC's pre-test checklist. As such, the entire DC was impacted at some level, however not all servers were affected. This error was not the result of a mistake by WestHost employees, our hardware or systems. The mistake was triggered by an error from a vendor. With that said, we take responsibility and are doing everything we can to restore all systems completely.
There were multiple servers impacted by this outage; some of the servers have had damaged hardware replaced while other servers need to be restored from backups. A large majority of the servers that were affected have since had all services restored and are back online. We still have a few remaining servers that are experiencing problems. We are doing everything we can to restore those remaining servers as quickly as possible.
We apologize for any inconvenience or frustration this outage has caused you. We are committed to providing you with the highest level of service possible. We will be providing more information on your server status throughout the day. Thank you for your patience while we strive to improve our services. Please contact us if we can be of assistance.

 Hopefully they'll get us back up in the next 24 hours

No comments:

Post a Comment