Not having a good day today.
Woke up this morning with my lower back aching and feeling stiff.
Then when I switched on my laptop and got ready for work, I noticed two disks had died in one of my home servers (which runs my kubernetes master VM). It's a RAID10 array, and just my luck both of the dead disks were from the same mirror so it's basically screwed.

I tried dd'ing the failed disks to known working disks and hoping that I can bring the array back up that way, but that didn't work either.

Show thread

I have backups of everything, except my kubernetes master itself.

I mean, it's not too difficult to rebuild the master, but it would mean basically rebuilding the cluster as all the certificates etc will need to be changed and everything re-deployed.

Sign in to participate in the conversation

The social network of the future: No ads, no corporate surveillance, ethical design, and decentralization! Own your data with Mastodon!