HTTPS certificate operations degraded
Incident Report for Pantheon Operations
Postmortem

On May 19, 2017, from 2:30am to 7:00am Pacific, we detected elevated error rates when attempting to connect to our certificate creation service. Throughout the incident certificate deployment to the Global CDN was successful, but delayed. We were seeing certificates take about 2 hours to deploy, whereas they typically are deployed in less than an hour. Certificates already deployed to Global CDN were unaffected and remained fully operational during the incident.

Posted May 23, 2017 - 17:08 PDT

Resolved
All clear. Our upstream provider reports issuing certificates is now fully operational, which our monitoring confirms.
Posted May 19, 2017 - 16:24 PDT
Monitoring
An upstream provider is experiencing issues, domains on Pantheon's HTTPS certificates may take longer than normal to add or remove.
Posted May 19, 2017 - 08:46 PDT
Identified
An upstream provider is having intermittent problems and they are working on fixing them.
Posted May 19, 2017 - 07:48 PDT
Monitoring
A fix has been implemented and we are monitoring the results.
Posted May 19, 2017 - 06:40 PDT
Identified
The issue has been identified and a fix is being implemented.
Posted May 19, 2017 - 05:51 PDT
Monitoring
A fix has been implemented and we are monitoring the results.
Posted May 19, 2017 - 04:38 PDT
Identified
An upstream provider is experiencing issues, domains cannot be added or removed from Pantheon's HTTPS certificates at this time.
Posted May 19, 2017 - 02:39 PDT