This page is for updates about global incidents. It does not include updates about routine hardware failures or isolated infrastructure events that have limited impact. For a personalized view of all events that might affect your apps, please check the personalized status page in your Fly Organization's dashboard. For all internal incidents and other activities, please check Infra Log.
Resolved -
This incident has been resolved.
Oct 23, 02:22 UTC
Monitoring -
Our internal state is fully re-synchronized, and our metrics are returning to normal. We are continuing to monitor for potential ongoing issues.
Oct 23, 01:30 UTC
Update -
Restoration of our state propagation system is complete. The system is now processing updates to re-synchronize back to the latest state. Services and APIs should start to recover once this process is completed.
Oct 23, 00:07 UTC
Update -
Our state propagation system is significantly delayed. To speed up recovery, we will restore the system from the snapshot to clear the backlog. Your machine may be missing from fly m list and some other APIs, but all of your started machines will still be running. The state will re-synchronize back to latest once restoration is completed.
Oct 22, 23:08 UTC
Update -
We are continuing to work on a fix for this issue.
Oct 22, 22:27 UTC
Update -
Parts of our APIs should have resumed normal function. We are still applying a fix to the rest of the APIs.
Oct 22, 21:15 UTC
Update -
We are continuing to apply the fix to all hosts in the fleet. Some hosts continue to see elevated API errors at this time.
Oct 22, 20:28 UTC
Update -
We are currently in the process of rolling out a fix across our fleet.
Oct 22, 19:25 UTC
Update -
We are continuing to work on a fix for this issue. Apps with autostart/autostop configured might also see an increased number of request errors.
Oct 22, 18:19 UTC
Identified -
We have identified the cause of an increase in API errors across the platform and are working on a fix.
Oct 22, 18:06 UTC
Resolved -
This incident has been resolved.
Oct 19, 23:47 UTC
Monitoring -
The region is now back online and is being monitored before returning to full operation.
Oct 19, 22:33 UTC
Update -
Our upstream partner has replaced the faulty hardware and are completing the steps necessary to bring it online.
Oct 19, 20:59 UTC
Update -
We are working with our upstream providers to expedite the installation of replacement network hardware.
Oct 19, 07:52 UTC
Identified -
A piece of faulty networking equipment has been identified, we are in constant communication with our upstream to resolve this issue.
Oct 19, 05:08 UTC
Investigating -
We are working with our upstream providers to identify the root cause of a networking failure in DEN
Oct 19, 04:48 UTC
Resolved -
This incident has been resolved.
Oct 17, 17:18 UTC
Monitoring -
We have identified the issue and deployed a fix. We are seeing recovery in affected apps, with proxy error levels returning to normal. We are continuing to monitor for full recovery.
Oct 17, 16:04 UTC
Update -
We are continuing to investigate this issue.
Oct 17, 15:56 UTC
Investigating -
We are investigating increased proxy errors for apps communicating over Flycast internal networking
Oct 17, 15:55 UTC
Completed -
The scheduled maintenance has been completed.
Oct 15, 06:00 UTC
In progress -
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Oct 15, 04:00 UTC
Scheduled -
Our IAD datacenter will be performing scheduled network maintenance during this window. No outages are expected during this maintenance period.
Oct 10, 20:52 UTC