While working on the SSH issue some hosts where stuck in a reboot process that resulted in an outage for about 60 minutes. The affected hosts where:
Looks like SSH logins are failing. We're investigating.
Fixed.
We rolled out an invalid SSHd config which means that every user is locked out of SSH. Since that includes us, we now have to fix the config manually while the hosts are powered off. This will unfortunately take a while.
As the dashboard (dashboard.uberspace.de) accesses some user information via SSH, this also means that the dashboard is not working at the moment.
There is a major outage at our FRA3 site. We're investigating.
Recovery is done, systems are up and running.
The power to the rack has been restored, we are now in process of bringing the systems up again.
One of our racks at FRA3 has lost power (electricity). We are in contact with the on-site technicians of the data centre provider to figure out how to restore power.
Mails to Microsoft accounts are rejected, we are not given a reason and our request to unblock our mailgates is not responded to. We change the mail gateways as far as we can, but unfortunately the block seems to take effect after a few hours on the gateway we changed.
Google Mail (googlemail.com; gmail.com) no longer accepts mails when the sender domain does not have valid SPF and/or DKIM set up. To set up SPF and/or DKIM for your domain hosted at Uberspace.de, please refer to our manual.