PDA

View Full Version : Temp Oznetgamer forum home



PtP
26-07-2005, 07:10 PM
I have restored a backup of about 2 weeks ago onto another host and pointed the domain here, this backup is dated 12-07 so anyone registering after that date will not know, If you know of anyone this effects or it effects you please re register, once the original data is recovered I dont think I will bother using it I will just restore this as we will be posting here meanwhile and would lose that.

Below is an explanation emailed to me of what happened to the server that Oznetgamer is housed, I would I am looking at another 24-48 hours before oznetgamer will be back online.

------------------------
At approximately 1:00 PM EST on July 24, 2005 the Hummer server ("server farm") experienced a serious failure with one of the disk drives in the RAID array. We immediately began troubleshooting mechanisms and procedures to rectify the problem and replace the drive, when it became apparent that in fact 3 of the 9 drives in the RAID array had simultaneously become bad and were no longer accessible. With the RAID level 5 system we have in place, the system can operate successfully with up to 2 failed drives in place (using the hot spares, etc.) but when 3 drives go bad the RAID array goes offline.

In our nearly 10 year's experience with servers and high-availability clusters, we have NEVER seen multiple drives in an array fail so abruptly and at the same time. Without sufficient time and warning/notice from the system, we were unable to swap out replacements. Our on-site technicians even attempted swapping out several device components, including the RAID card (twice actually) the additional diagnostics performed with the alternate backup RAID cards in place do confirm that we have multiple bad drives in the system.

At this time, our drives are in transit to a industry-renowned data-recovery form just minutes away from the data center in order to receive their assistance recovering the data and integrity of the array by accessing the uncooperative drives and 'parity' data used by the RAID system off the drives so we can bring the array back online as soon as possible.
---------------------

Viss
26-07-2005, 07:53 PM
OOO bugga dat sux. Bet that data recovery is costing a pretty penny.

PtP
26-07-2005, 09:47 PM
Oh yeah, last one I did (which was years ago) was $1200 with vey little usefull data recovered.

onslaught
26-07-2005, 11:56 PM
:(

I can't see them getting much useful data off it either.

PtP
29-07-2005, 10:48 AM
I recived an update last night, a couple of quotes makes me wonder who the hell would want to be a webhost ;)


*Recovery* procedures are now underway as the final analysis proved quite successful- considering the complexity involved with the filesystem restructuring, the technicians in question have projected a 72 to 96 hour window for data 'assembly' and 'cloning' based on the filesystem mapping procedures that have been running non-stop since the week began.


Your patience is once again truly appreciated! Hopefully we'll have the data in our hands so we can finish off piecing this cluster solution back together again during the weekend or first thing next week. We will be in touch as often and as soon as possible.


And at this point we have been given nothing but reassurances that a complete (or very near) recovery should be considered likely.

And later he mentions the bill for this recovery will be in the tens of thousands of dollars OUCH ;)

Viss
29-07-2005, 10:57 AM
ewww thats gotta hurt the hip pocket :(