Over the last 24 hours the abaris server has been randomly dying. We have been doing upgrades and various checks to find the cause of the issue.

At 10:00 AM the hard drive became unresponsive. We are currently whipping the machine and will begin doing an OS Reload, cPanel Install and restore from backups. We will update this post with more details as we have them.

Current ETA is 24 hours.

There is a staff member on site who will be working on the issue until it is fixed.

We appreciate your patience and understanding.

Update 03/11/09 – 8:00 AM PST – We are currently working on copying the backup files to the new server and will commence restoring accounts shortly.

Update 03/11/09 – 10:00 AM PST – Accounts are being restored. So far 25% have been restored ETA update is 4-5 hours.

Update 03/11/09 – 4:00 PM PST – Accounts are still being restored. So far 80% have been restored revised ETA is 2-3 more hours.

Update 03/11/09 – 700 PM PST – 95% of the accounts are restored. If your account is missing then open a NEW ticket with support. If your account has been restored and it is missing something in it then please add it back. So if an email is missing then add it back for example. Backups are usually 99.9% accurate so be sure to check your account.

The server has become unresponsive at 6:01 and staff are investigating the server to determine the cause. We will update this post with more details as we have them.

There is a staff member on site who will be working on the issue until it is fixed.

We appreciate your patience and understanding.

UPDATE – 30/09/2009 11:30 AM – Server was rebooted and a a filesystem check was completed. The hard drive is responsive but we are not able to login. We are continuing to work on the server. If we can not get in the next several hours we will wipe the machine and pull from the most recent backups we have.

UPDATE – 1/10/2009 1:20 AM – Hard Drive was considered dead after several attempts to correct the issue. Hard Drive was formated and OS reinstalled. cPanel is currently beeing reinstalled on the server. We wil restore for the last backups we have stored after.

Once the planned maintenance by the data center was completed we noticed that there was a problem with the Apollo server. The server is currently being worked on and we will update this post with more details as we have them.

There is a staff member on site who will be working on the issue until it is fixed.

We appreciate your patience and understanding.

UPDATE 16/04/2009 2:30 AM : Hard Drive was found to be dead. New drive installed, Os reloaded and cPanel is at 10% install. Next step is to restore accounts from our backups. ETA 12 hours.

UPDATE 16/04/2009 10:25 AM: Backup restores are about 50% done. We are seeing some backups that were corrupted so restoring from older backups. If you have more recent files we suggest you update them through FTP. ETA 2 hours.

The data center in Vancouver with the Diddy, Apollo and Artemis server are located will be down for 6 – 8 hours while the Data Center performs maintenance. Starting April 14th 2009 at 10 PM the maintenance will begin and will run for approximately 6 -8 hours. During this time there will be various connection issues so please do not open a ticket with support.

This maintenance is required and there is no way to avoid it. We apologize for the inconvenience this may cause you and hope this will cause the least amount disturbance to your day.

Questions, comments or concerns?

At approximately 2:00 PM PST the data center in Vancouver with the Diddy, Apollo and Artemis server were down. The issue was for the entire data center and their staff were on site and working on a resolution immediately. Servers were back online at approximately 6:21 PM PST. We will update this post once more details of the issue are conveyed to us.

This is the email I got from the Data Center as to why…

As you may already know, there has been a major power outage in downtown Vancouver. At about 10:00AM this morning, a major transformer caught fire and exploded in an underground service area. A number of buildings, as well as traffic lights, are without power in the downtown area. Currently, sources are saying the power will be restored by 3:00PM. However, rumours indicate that this is not likely.

Serenity is currently operational. Temperature is also becoming a concern.

The servers went offline do to temperature issues. The power now being restored to the building means the servers are now back online as the AC is now working fully.

Questions, comments or concerns?

At aproximately 3:00 AM PST the datacenter in Vancouver with the Diddy, Apollo and Artemis server were down. The issue was for the entire data center and their staff were onsite and working on a resolution immediately. Servers were back online at approximately 5:00 AM PST. We will update this post once more details of the issue are conveyed to us.

Update: I received an email from the data center saying the issue was with the A/C and the building turning off the cold water. I am not sure how that would cause our servers to be unavailable so I have asked for more details.