At 15:36 UTC on 19th May 2022, a configuration change was made during a database server upgrade. The configuration changes caused one database server endpoint to become overloaded and unresponsive. In response to this we fixed the configuration and restarted the database server endpoint. During the restart process several websites were down until their configuration was reloaded. By 17:10 UTC on the 19th May 2022 all sites were back up. 

We have identified several improvements to our configuration and update process to help us detect and prevent these issues in the future.