Een vreemd berichtje op Surmunity (nadat ik merkte dat zowat al mijn websitejes eruit lagen):

This morning, around 3:00AM EST, SH110 became unresponsive and required a reboot. Upon reboot, the server failed to come up cleanly indicating that some system files were either corrupted or plain missing.

We’ve faced such scenarios (and seemingly much worse ones) before, so we decided to go ahead and just start piecing things together. Unfortunately there was more missing than what we expected, as at this point right now, the server still refuses to boot properly. We are still going to try to fix the server, but just in case, we have setup a new SH110 server and have begun a restore from backups on it.

A quick update: we ran into a slight hitch - we are not entirely sure what caused this, but the new server started acting up about an hour ago, which forced us to relocate the drives to yet another different server. The previous server would just crash intermittently, display odd disk/adapter related errors, so we thought the best solution here would be to just entirely switch the machines again.

And so on, and so on. Daardoor was het hele zootje dus zo’n 3 dagen offline. Maar alles is terug, so we’re back on track!

Filed under: Site related | | #