Pantheon Operations Status

Pantheon Operations

All Systems Operational

Customer Sites Operational

Dashboard Operational

Global CDN Operational

Spinup Operations Operational

Workflow Operations Operational

Support Tickets Operational

Support Chat Operational

Terminus Operations Operational

Site Certificate Provisioning Operational

Billing Operations Operational

Autopilot Operational

Git Operational

Operational

Degraded Performance

Partial Outage

Major Outage

Maintenance

Scheduled Maintenance

Planned Deprecation of Obsolete TLS Cipher Suites Jun 8, 2023 09:00-10:00 PDT

Scheduled - Obsolete cipher suites for TLS 1.2 will be removed on June 26th, 2023. In Pantheon's continual efforts to stay up to date with modern web security standards, we are planning on deprecating specific, obsolete ciphers. These cipher suites have been flagged by our InfoSec team as causing potential security risks that could impact the security of sites hosted on our platform.

Leading up to deprecation we will have a series of scheduled outages with the following timeline to see if you are affected:

June 8th, 2023 - Scheduled cipher suite removal for 1 hour (12 pm EDT)
June 22, 2023- Scheduled cipher suite removal for 24 hours (start at 12 pm EDT)
June 26th, 2023 - Cipher suites permanently removed (12 pm EDT)

The majority of modern browsers and platforms have removed support for these cipher suites as well. Even if any modern browsers or platforms support these weak ciphers, if the server (Pantheon Platform) does not support these, the TLS connections should be made on alternative strong cipher suites as part of the TLS connection process, and traffic will not be impacted. The majority of browser traffic is on TLS 1.3 and will not be affected. This will primarily affect incoming connections from out of date APIs or servers running out of date software.

The following obsolete TLS 1.2 ciphers will be removed:

TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA
TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256
TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA
TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384
TLS_RSA_WITH_AES_128_CBC_SHA
TLS_RSA_WITH_AES_128_GCM_SHA256
TLS_RSA_WITH_AES_256_CBC_SHA

Pantheon will be proactively identifying and communicating with affected customers. No action is required of you at this time, but if you have any questions/concerns, please feel free to reach out to your Account Team at Pantheon or to Pantheon Support via a ticket or chat.
May 11, 2023 - 09:48 PDT

System Metrics Month Week Day

Customer Site Availability

Fetching

Dashboard Response Time

Fetching

Past Incidents

May 31, 2023

No incidents reported today.

May 30, 2023

No incidents reported.

May 29, 2023

No incidents reported.

May 28, 2023

No incidents reported.

May 27, 2023

No incidents reported.

May 26, 2023

No incidents reported.

May 25, 2023

Intermittent Downtime for Some Customers

Resolved - This incident has been resolved. Thank you for your patience as we worked to resolve this issue.

If you are still experiencing issues, please contact support via helpdesk@pantheon.io or by opening a support chat.
May 25, 04:24 PDT

Monitoring - Our team has applied a fix and is currently monitoring the results.

If you are still experiencing issues and cannot open a support chat, please contact support via helpdesk@pantheon.io.
May 25, 02:04 PDT

Update - Our team is actively working on the measures already in place to expedite the recovery time for all affected sites.

Within the next 3 hours, or possibly even sooner, we will keep you updated on the progress.

Should you have any pressing concerns or require immediate assistance, please get in touch with our dedicated support team via helpdesk@pantheon.io or by initiating a support chat.
May 24, 22:39 PDT

Update - Our team is continuing the implemented measures to ensure a faster recovery time for all affected sites.

We will provide you with regular updates on the progress within the next 3 hours or sooner.

If you have any urgent concerns or require immediate assistance, please do not hesitate to reach out to our dedicated support team via helpdesk@pantheon.io or by initiating a support chat.
May 24, 19:42 PDT

Update - Our Engineering Team continues implementing measures to ensure a faster recovery time for all affected sites.

We will provide you with regular updates on the progress within the next 3 hours or sooner.

If you have any urgent concerns or require immediate assistance, please do not hesitate to reach out to our dedicated support team via helpdesk@pantheon.io or by initiating a support chat.
May 24, 16:34 PDT

Update - Our engineering team has made significant progress in resolving the issue and has identified a method that will expedite the restoration of service, ensuring a faster recovery time for all affected sites.

We understand the utmost importance of keeping you fully informed throughout this process. Our next status update will be provided within 3 hours. Rest assured that our team will continue to work diligently during this period to ensure the smooth operation of all customer sites.

Should you have any questions or concerns, our dedicated support team is here to assist you. You can reach out to us via the Dashboard Support tab by ticket or by opening a support chat. We are committed to addressing your inquiries promptly and providing the necessary assistance to minimize any disruption to your business operations.
May 24, 13:28 PDT

Update - Our team has identified the root cause of the issue and is diligently implementing a fix. However, it will take some time to ensure the solution reaches all customer sites. We understand the urgency of restoring normal service and are making every effort to expedite the process.

We will provide the next status update in three hours. During this time, our team will continue working to restore full functionality to all customer sites.

If you have any questions or concerns, our support team is available to assist you. Please reach out to us through the Dashboard Support tab by ticket or chat, and we will prioritize your inquiries.

We apologize for any disruption this has caused and appreciate your patience and understanding. We are committed to resolving this issue as quickly as possible.
May 24, 09:51 PDT

Identified - The issue has been identified and a fix is being implemented.
May 24, 08:43 PDT

Investigating - We regret to inform you that a recent update to our PHP application servers has caused intermittent downtime for a subset of our customers. We apologize for any inconvenience this may have caused and want to assure you that we are actively addressing the issue.

We have identified the root cause of the issue and are in the process of rolling back the update to restore service stability. Our team is working diligently to minimize any further impact.

If you have any questions or concerns, our support team is here to assist you. For urgent issues, please contact support via helpdesk@pantheon.io or by opening a support chat.
May 24, 08:23 PDT

May 24, 2023

May 23, 2023

Apache Solr service degradation

Postmortem - Read details
May 30, 14:17 PDT

Resolved - Issue with Solr search has been resolved for all affected users. We apologize for any inconvenience caused and appreciate your patience.
May 23, 11:18 PDT

Monitoring - The upgrade process has completed and Solr services are now restored.

We apologize for the unexpected interruption to services today, thank you for your patience with us as we worked to resolve this issue.

Please reach out to support by opening a ticket or chat if there are any remaining issues.
May 23, 10:47 PDT

Identified - We are investigating a partial outage for Apache Solr, affecting US region sites using Solr search. An upgrade is currently in progress and we expect to see improvement within 30 minutes and will update at that time.

For urgent issues, please contact support via helpdesk@pantheon.io or by opening a support chat.
May 23, 10:25 PDT

May 22, 2023

No incidents reported.

May 21, 2023

No incidents reported.

May 20, 2023

No incidents reported.

May 19, 2023

Degraded Performance

Postmortem - Read details
May 29, 22:33 PDT

Resolved - We are no longer experiencing issues with email delivery. This incident has been resolved.

Thank you for your patience as we worked to resolve this issue.

If you are still experiencing issues, please contact support via helpdesk@pantheon.io or by opening a support chat.
May 19, 13:48 PDT

Update - Our Engineering Team is continuing to monitor the issue as email delivery remains stable.

We will provide you with regular updates on the progress of our investigation. The next update will be posted within 4 hours or sooner, as we continue to gather more information.

If you have any urgent concerns or require immediate assistance, please do not hesitate to reach out to our dedicated support team via helpdesk@pantheon.io or by initiating a support chat.
May 19, 08:56 PDT

Monitoring - Our Engineering Team has deployed a fix for the issue, and we are seeing successful results. We are currently monitoring the platform to ensure that everything is running smoothly.

If you're experiencing any ongoing issues, please don't hesitate to reach out to our support team for assistance.
May 19, 03:06 PDT

Update - Our Engineering Team is continuing the implemented measures to further investigate and identify the root cause of the issue.

The next update will be shared within the next 4 hours or sooner, as we continue to gather more information.

If you have any urgent concerns or require immediate assistance, please do not hesitate to reach out to our dedicated support team via helpdesk@pantheon.io or by initiating a support chat.
May 18, 23:03 PDT

Update - Our Engineering Team has implemented additional measures to further investigate and pinpoint the cause of the issue.

We will provide you with regular updates on the progress of our investigation. The next update will be posted within 4 hours or sooner, as we continue to gather more information.

If you have any urgent concerns or require immediate assistance, please do not hesitate to reach out to our dedicated support team via helpdesk@pantheon.io or by initiating a support chat.
May 18, 18:30 PDT

Update - Our team is actively investigating the disruption in email sending and we understand the impact it may have on your operations. We apologize for any inconvenience caused and want to assure you that resolving this issue is our utmost priority and we are working diligently to rectify it as quickly as possible.

We will continue to provide timely updates on the progress of our investigation. The next update will be posted in 2 hours or sooner as we gather more information.

If you have any urgent concerns or require immediate assistance, please reach out to our dedicated support team via helpdesk@pantheon.io or by initiating a support chat.
May 18, 16:17 PDT

Update - Our Engineering Team continues to investigate the cause of the disruption in email sending. At this moment, we do not have any significant updates or specific information to report. Please rest assured that resolving this issue is our top priority, and we are working diligently to rectify it as quickly as possible.

For any urgent matters, please don't hesitate to contact our support team via helpdesk@pantheon.io or by initiating a support chat.

We appreciate your understanding and patience during this time.
May 18, 11:28 PDT

Update - As of now, there is no significant update or specific information to report. The current status remains unchanged, and there are no notable developments or events to share at this time.

We will provide another update in 2 hours or sooner as more information becomes available.

For urgent issues, please contact support via helpdesk@pantheon.io or by opening a support chat.
May 18, 08:41 PDT

Update - Pantheon Engineers are actively working on addressing the disruption in sending email. We know how important email functionality is for our customers, and we appreciate your patience while we continue working towards a fix.

We will continue to provide updates as more information becomes available.

For urgent issues, please contact support via helpdesk@pantheon.io or by opening a support chat.
May 18, 06:04 PDT

Investigating - We are currently investigating reports of issues with sending mail from customer sites.

For urgent issues, please contact support via helpdesk@pantheon.io or by opening a support chat.
May 17, 21:37 PDT

May 18, 2023

May 17, 2023