Maintenance down time, Never touch a running system? Options

[schnoog]

Hi folks,

6 and a half years ago I was asked to become admin of the Splatterladder.
During the last 6 years we had a total downtime of 51 hours, caused by several defects like broken hard disks (in total 9 were destroyed yet), a broken power supply or a runaway update.
A lot of work was necessary to patch an outdated operating system to keep it in a working and safe state.
But now the time has come to upgrade the operating system to ensure safety and continuity without compiling everything from source.

The SL codebase was written a long time ago, and I'm not able to guess how long it will take to bring all services back to life.
I'll do my very best to minimize the interruption(s).


Greetz
Schnoog

[macbeth]

Good luch Schnoogy
we all know u do and will your best for us

[{WeB}*DoG*]

Superb News Schnoog.... we look forward to the improvements and we will try our best to help in any useful way we can!!

[Wolf Enstein]

Good luch Schnoogy
we all know u do and will your best for us

Thanks for all your efforts, Schnoogmei$ter .

[$mart]

51h during 6years means a SLA of 99,9 % !!!

Impressive !!!

[schnoog]

Thank you all for the flowers :)

But I need to compliment our hoster. Beside the fact that round about 4k Euro flow to them during this time (approx. 1k through donations), the support was always the best.
Never had to wait to exchange any hardware for longer than 4 hours.

If you like some statistics:
SL has moved 3times during the last 6 years. (Hetzner -> Hetzner -> Server4You)
During those 6 years I was connected for 613 hours via SSH to the server, today the 2300th database backup was created (today: 28GB database backup).
Our backup-drive now has a capacity of 3TB which is filled up to 90%

[Wolf Enstein]

.....today the 2300th database backup was created (today: 28GB database backup).
Our backup-drive now has a capacity of 3TB which is filled up to 90%

Good grief .

[SL.Baldi]

.....today the 2300th database backup was created (today: 28GB database backup).
Our backup-drive now has a capacity of 3TB which is filled up to 90%

Good grief .

cool

[schnoog]

Hi folks,

.....several hours of frustration and crying
.....one complete rollback
.....another hour of pure fun
.....
...
..
.
but now the main work is done.
The server SL is running on is up to date, the operating system upgraded (tracking out time 1 hour)
Now the real debugging begins:
The new php version misses some functions used at SL.
Since I need to find all calls of those functions, this will be a "longer-term" work.

So if you find any page responding with an Error 500, please drop a note here in this thread

[Wolf Enstein]

.....several hours of frustration and crying.....but now the main work is done.

[sl.Proddi]

The SL codebase was written a long time ago

Perfect code i have to add

Looking forward Schnocki :)