High error rates across multiple regions
Incident Report for Fly.io
Resolved
This incident has been resolved.
Posted May 27, 2020 - 15:19 CDT
Update
All services restored. We are monitoring to make sure customer apps recovered gracefully.
Posted May 27, 2020 - 15:18 CDT
Monitoring
We've restored backhaul between all regions, error rates are decreasing. We are restarting numerous services to flush out old backhaul configurations.
Posted May 27, 2020 - 15:16 CDT
Update
We are continuing to investigate this issue.
Posted May 27, 2020 - 15:13 CDT
Update
Backhaul between regions is unstable and causing multiple connection failures.
Posted May 27, 2020 - 15:11 CDT
Investigating
Our monitoring is reporting errors across multiple Fly regions, we're investigating.
Posted May 27, 2020 - 15:05 CDT
This incident affected: Regional Availability (AMS - Amsterdam, Netherlands, ATL - Atlanta, Georgia (US), DFW - Dallas, Texas (US), EWR - Secaucus, New Jersey (US), FRA - Frankfurt, Germany, HKG - Hong Kong, IAD - Ashburn, Virginia (US), LAX - Los Angeles, California (US), MRS - Marseille, France, NRT - Tokyo, Japan, ORD - Chicago, Illinois (US), SEA - Seattle, Washington (US), SIN - Singapore, SJC - Sunnyvale, California (US), SYD - Sydney, Australia, YYZ - Toronto, Canada).