[Burnett]

[Marvin Hampton]

Thank you for the quick response and update to this.

[Duckie]

Thanks guys. Glad ya'll were on top of it. Sorry that this happened.

[brave soldier]

Thank you.

[Temar]

Took about 5 hours but I managed to restore most data
your inventory and money should be pretty recent snap shots
missing playtime has been calculated and added
rep point list has been passed onto staff to review and re-add

Membership purchases during last week have been fixed, ingame money etc from them would of already been restored with money/inv restoring
 
there is most likely going some slight discrepancies
anything substantially wrong that you would like to be checked post a thread here:
https://limelightgaming.net/forums/forum-203.html

[Burnett]

[Tom*]

Deadset burnett responded in 9 minutes to the initial report, anyway good job lads

[Mr.Sir]

Pretty damn quick response. Thanks!

[Burnett]

I think we can all appreciate the fact that Temar worked his ass off, writing multiple parsers/scripts to restore vital data such as player stats, logs, memberships, reps etc.
In addition a huge thank you to Doctor Internet who provided additional help in restoring the bans and blacklists.
There is still some data that we must manually restore, but your most vital data are back.

This incident will help us further navigate how we want to deal with BigData in the future.
Turns out having additional file-based logs (2nd class backups) are much more vital than I expected.

From here on now we must allocate more money into storage and enterprise backup solution, eg. replication/db syncs.


Edit:  Additional thanks to Bambo and the Mod/Admin team for dealing with the warnings and reps.

[Decay]

You guys are amazing!

[Zaidplays]

LL ON TOP NON-STOP

[Burnett]

Process completed.

Additional backup strategies have been put in place, 
including a physical first-class backup (Temar).

We'll try and allocate more resources to further maximize data reliability.

Thank you for your support.