PostgreSQL Clusters are down

Incident Report for Fly.io

Resolved

This incident has been resolved.
Posted Oct 03, 2021 - 20:31 UTC

Update

All user Postgres clusters recovered, we're continuing to monitor Consul loads.
Posted Oct 03, 2021 - 19:17 UTC

Update

We are currently fixing clusters that have not recovered on their own.
Posted Oct 03, 2021 - 17:44 UTC

Update

We are continuing to monitor for any further issues.
Posted Oct 03, 2021 - 17:40 UTC

Monitoring

A fix has been implemented and we are monitoring the results.
Posted Oct 03, 2021 - 17:39 UTC

Identified

Deploying our global state store (Consul) has caused all PostgreSQL clusters to go down. We're working on resolving the issue.
Posted Oct 03, 2021 - 17:22 UTC