Page 1 of 65 1 2 3 4 5 11 51 ... LastLast
Results 1 to 15 of 970

Thread: Server downtime 10/18/11

  1. #1
    The Vlada Vlada's Avatar
    Join Date
    Feb 2007
    Location
    Elephant Graveyard
    Posts
    33,037

    Server downtime 10/18/11

    Server downtime

    October 18, 2011
    The SWGEmu Community Division



    Server downtime - 10/18/11

    EDIT - Further note: Login server appears to be having some issues. No ETA on it's revival; Liberator still remains up but can't be accessed.

    LIBERATOR IS CURRENTLY UP -- The next 24 hours are a test to determine stability, so DO NOT get too comfortable just yet. We're not completely out of the woods.


    Our server in Denver experienced another hardware failure, and because of it Liberator and TC: Nova have been offline for days now.


    Update:

    As you may or may not know, not one but two of our HDD's died, which really made things a lot more difficult. Our SSD is fine, Liberator code and Berkley database are fine too, but Devs are still trying to recover mysql with the all char info that was on the raid that crashed.

    With these kind of problems it is almost impossible to give any kind of ETA, so please be patient a little while longer.

    Update 2:

    Code:
    [14:13] <%Vlada> You can recover Lib?
    [14:13] <@oru> yeah we are working on it
    [14:13] <@oru> there is only a slight chance though
    [14:13] <%Vlada> OK, how long? 
    [14:13] <%Vlada> tonight, tomorrow, 2 days
    [14:14] <@oru> no idea
    [14:19] <@oru> it takes so long because we want to make sure we will have more attempts to fix it

    Update 3:

    Code:
    [20:39] <@TheAnswer> i am cloning the data on the current HDD's
    [20:39] <@TheAnswer> to safely play with them
    [20:40] <@TheAnswer> to not lose whatever is left
    [20:40] <%Aceblade> excellent - do you think we could get Nova back online while you're attempting the recovery?
    [20:40] <@TheAnswer> no
    [20:40] <@TheAnswer> we dont have any OS there
    [20:40] <@TheAnswer> i am working from a liveCD
    [22:12] <@TheAnswer>  we also bought 2 more HDD's
    [22:12] <@TheAnswer> for the cloning
    Update 4:

    Code:
    [03:07] <@TheAnswer> we are still copying the files
    [03:07] <@TheAnswer> if its not done by tomorrow i will proceed without it
    [03:10] <%Vlada> What does "proceed without it" mean? Reinstall  everything without mysql data, That's equal to wipe, right?
    [03:10] <@TheAnswer> yeah
    Update 5:

    Finally some good news, or devs were able to to recover pretty much all the mysql so none of the character data is lost. When we have the OS installed and running, TA will have to test the latest data, if its not consistent Liberator will be rolled back to October 14th.

    Update 5:

    No problems so far, just that damn thing called real life. It always messes things up.

    Talked to TA, turns out he had a hell of a day, he is going to try to test the mysql data now... if he doesn't fall asleep in the process.

    Of course all this takes time, rough guesstimate... 24 hours or more.



    Update 6:

    Code:
    [23:22] <%Vlada> Time for some news, good or bad. Even no news can pass as news right now.
    [23:23] <@TheAnswer> Last Updated:    23 hours ago
    [23:24] <@TheAnswer> that's the ticket i sent for replacing the bad HDD
    [23:24] <@TheAnswer> 23hours ago and still waiting
    [23:24] <%Vlada> host didn't replace it?
    [23:25] <@TheAnswer> not yet
    [23:25] <@TheAnswer> we needed it to recover the data
    [23:25] <%Vlada> lovely
    Well folks it looks like its out of our hands, we cant do anything until our host replaces that damaged HDD.

    Since we cant do anything until they do what needs to be done, we are back to no ETA.

    Update 7:

    Code:
    [23:31] <@TheAnswer> they just replied
    [23:31] <%Vlada> and?
    [23:32] <@TheAnswer> they reinstalled OS
    [23:32] <@TheAnswer> i can see all the drives now
    [23:32] <%Vlada> \o/
    [23:32] <~Odwill> finally
    [23:32] <~Odwill> good news though
    [23:32] <%Vlada> Will we see Lib tonight?
    [23:32] <@TheAnswer> i hope so
    [23:32] <@TheAnswer> i am working on it
    Fingers crossed.



    Please note: Global registration is down too. New members won't be able to register on our forums during this downtime.

    We apologize for any inconvenience this might have caused you and we thank you for your patience.




    ~ The SWGEmu Community Division
    Last edited by Vlada; 10-27-2011 at 07:05 AM.

    The Vlada


    vlada@swgemu.com | www.swgemu.com
    SWGEmu is a non-profit, open source project.
    Install SWGEmu | Report Bugs | How to Report a bug

  2. #2
    Senior Member Superjebus's Avatar
    Join Date
    Sep 2010
    Location
    Sydney, Australia
    Posts
    1,037
    Thanks for the update Vlada.
    <RYYK>
    Not a Commando
    Quote Originally Posted by Ivojedi View Post
    Considering that I wrote the code to make it that way, yes, I'm sure.

  3. #3
    Junior Member
    Join Date
    Aug 2011
    Posts
    50
    Why are there so many issues with hardware as of late ?

  4. #4
    Newbie kzanadylan's Avatar
    Join Date
    Jun 2011
    Location
    Belgium
    Posts
    37
    Thanks for update

  5. #5
    Junior Member
    Join Date
    Jun 2008
    Location
    Portland,Or
    Posts
    244
    LOL! ugh it would be down for so long

  6. #6
    Retired SWGEmu Staff MasterLFD's Avatar
    Join Date
    Aug 2011
    Posts
    478
    I have no idea the setup of the data center the lib/nova server are housed but speaking from experience from my company, we have a 4 hour SLA for replacement parts. Now if it were a hard drive failure, it could be quite a bit longer due to having to pull data from backup.
    Crushu
    Retired SWGEmu Staff
    Crushu@SWGEmu.com


    SWGEmu is a non-profit, open source community project.
    How to report bugs | Mantis (Bug Tracker) | Live Support
    Install SWGEmu | Fix SWGEmu | mIRC Guide | Submit a ticket

  7. #7
    Junior Member
    Join Date
    Jun 2008
    Location
    Portland,Or
    Posts
    244
    Lol oh well looks like I have to restaff talus again. I hit surge and prob hour later server went down. So hopefully no roll backs. Or ima be doing talus with my guild again.

  8. #8
    The Vlada Vlada's Avatar
    Join Date
    Feb 2007
    Location
    Elephant Graveyard
    Posts
    33,037
    Quote Originally Posted by MasterLFD View Post
    I have no idea the setup of the data center the lib/nova server are housed but speaking from experience from my company, we have a 4 hour SLA for replacement parts. Now if it were a hard drive failure, it could be quite a bit longer due to having to pull data from backup.

    It is a HDD failure, or failures we are not really sure atm.

    The Vlada


    vlada@swgemu.com | www.swgemu.com
    SWGEmu is a non-profit, open source project.
    Install SWGEmu | Report Bugs | How to Report a bug

  9. #9
    Junior Member
    Join Date
    Jun 2008
    Location
    Portland,Or
    Posts
    244
    Quote Originally Posted by Vlada View Post
    It is a HDD failure, or failures we are not really sure atm.
    So it's hard drive failure? Lol damn that blows

  10. #10
    do it can take longer server down time not just for 24 hours????

  11. #11
    probably one of the cages where the towers standing on fell and trashed the hdd, lol
    I cant understand why they dont use real server hall equippment.

    http://foretag.bahnhof.se/hosting/Galleri_Pionen// <--- now thats a real server hall.

    http://atlasobscura.com/place/pionen-data-center <--- here it is in english
    Last edited by Fellon; 10-18-2011 at 08:31 PM.

  12. #12
    The Vlada Vlada's Avatar
    Join Date
    Feb 2007
    Location
    Elephant Graveyard
    Posts
    33,037
    Quote Originally Posted by Light seeker View Post
    do it can take longer server down time not just for 24 hours????
    Yes it can take longer than 24 hours.

    The Vlada


    vlada@swgemu.com | www.swgemu.com
    SWGEmu is a non-profit, open source project.
    Install SWGEmu | Report Bugs | How to Report a bug

  13. #13
    SWGEmu Admin Lolindir's Avatar
    Join Date
    Jul 2011
    Location
    Norway
    Posts
    10,962
    hmm, its not too long ago that we had a HDD failure last... And it was a HDD failure before that too. Thin red line here...
    Lolindir
    SWGEmu Admin

    SWGEmu is a non-profit, open source community project.
    How to report bugs | Mantis (Bug Tracker) | Live Support
    Install SWGEmu | Fix SWGEmu | Submit a ticket

  14. #14
    The Vlada Vlada's Avatar
    Join Date
    Feb 2007
    Location
    Elephant Graveyard
    Posts
    33,037
    Quote Originally Posted by Lolindir View Post
    hmm, its not too long ago that we had a HDD failure last... And it was a HDD failure before that too. Thin red line here...
    No, no... We had a SSD failure.

    The Vlada


    vlada@swgemu.com | www.swgemu.com
    SWGEmu is a non-profit, open source project.
    Install SWGEmu | Report Bugs | How to Report a bug

  15. #15
    if its a constant problem with the provider is there a way to switch providers who are more reliable

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

     

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts