PostgreSQL database server instance unavailable

Question

My production database server instance quintess-backend in the West US region went down today at 7:59 AM GMT, it has been unavailable for 1 hour, this is critical.

I haven't been able to access it, restart it since the issue occurred, and my production services are down. As per the resource health events, this is not scheduled maintenance, I need urgent assistance with this.

Thanks

Answer 1

Hi Julien Vantyghem

The incident was caused by a power outage at the data center in the US West region, combined with a generator transfer failure, which led to a full site outage and impacted multiple compute and storage nodes. During recovery, firmware issues in certain SSD devices caused some nodes to enter unrecoverable states, which delayed restoration and resulted in limited data impact for specific workloads.

Power was restored and recovery was carried out through coordinated efforts across engineering teams, including infrastructure stabilization, node recovery, firmware remediation, and service healing. Most services have since been restored, and remaining components are under active monitoring to ensure stability.

Hope this helps, Please let us know if you have any questions and concerns.

Answer 2

Thank you for the follow-up Manoj, that's clear.