Server downtime
October 18, 2011
The SWGEmu Community Division
Server downtime - 10/18/11
EDIT - Further note: Login server appears to be having some issues. No ETA on it's revival; Liberator still remains up but can't be accessed.
LIBERATOR IS CURRENTLY UP -- The next 24 hours are a test to determine stability, so DO NOT get too comfortable just yet. We're not completely out of the woods.
Our server in Denver experienced another hardware failure, and because of it Liberator and TC: Nova have been offline for days now.
Update:
As you may or may not know, not one but two of our HDD's died, which really made things a lot more difficult. Our SSD is fine, Liberator code and Berkley database are fine too, but Devs are still trying to recover mysql with the all char info that was on the raid that crashed.
With these kind of problems it is almost impossible to give any kind of ETA, so please be patient a little while longer.
Update 2:
Code:[14:13] <%Vlada> You can recover Lib? [14:13] <@oru> yeah we are working on it [14:13] <@oru> there is only a slight chance though [14:13] <%Vlada> OK, how long? [14:13] <%Vlada> tonight, tomorrow, 2 days [14:14] <@oru> no idea [14:19] <@oru> it takes so long because we want to make sure we will have more attempts to fix it
Update 3:
Update 4:Code:[20:39] <@TheAnswer> i am cloning the data on the current HDD's [20:39] <@TheAnswer> to safely play with them [20:40] <@TheAnswer> to not lose whatever is left [20:40] <%Aceblade> excellent - do you think we could get Nova back online while you're attempting the recovery? [20:40] <@TheAnswer> no [20:40] <@TheAnswer> we dont have any OS there [20:40] <@TheAnswer> i am working from a liveCD [22:12] <@TheAnswer> we also bought 2 more HDD's [22:12] <@TheAnswer> for the cloning
Update 5:Code:[03:07] <@TheAnswer> we are still copying the files [03:07] <@TheAnswer> if its not done by tomorrow i will proceed without it [03:10] <%Vlada> What does "proceed without it" mean? Reinstall everything without mysql data, That's equal to wipe, right? [03:10] <@TheAnswer> yeah
Finally some good news, or devs were able to to recover pretty much all the mysql so none of the character data is lost. When we have the OS installed and running, TA will have to test the latest data, if its not consistent Liberator will be rolled back to October 14th.
Update 5⅔:
No problems so far, just that damn thing called real life. It always messes things up.
Talked to TA, turns out he had a hell of a day, he is going to try to test the mysql data now... if he doesn't fall asleep in the process.
Of course all this takes time, rough guesstimate... 24 hours or more.
Update 6:
Well folks it looks like its out of our hands, we cant do anything until our host replaces that damaged HDD.Code:[23:22] <%Vlada> Time for some news, good or bad. Even no news can pass as news right now. [23:23] <@TheAnswer> Last Updated: 23 hours ago [23:24] <@TheAnswer> that's the ticket i sent for replacing the bad HDD [23:24] <@TheAnswer> 23hours ago and still waiting [23:24] <%Vlada> host didn't replace it? [23:25] <@TheAnswer> not yet [23:25] <@TheAnswer> we needed it to recover the data [23:25] <%Vlada> lovely
Since we cant do anything until they do what needs to be done, we are back to no ETA.
Update 7:
Fingers crossed.Code:[23:31] <@TheAnswer> they just replied [23:31] <%Vlada> and? [23:32] <@TheAnswer> they reinstalled OS [23:32] <@TheAnswer> i can see all the drives now [23:32] <%Vlada> \o/ [23:32] <~Odwill> finally [23:32] <~Odwill> good news though [23:32] <%Vlada> Will we see Lib tonight? [23:32] <@TheAnswer> i hope so [23:32] <@TheAnswer> i am working on it
Please note: Global registration is down too. New members won't be able to register on our forums during this downtime.
We apologize for any inconvenience this might have caused you and we thank you for your patience.
~ The SWGEmu Community Division
Originally Posted by Ivojedi
