Apps V1 Instances are sometimes, wrongly, being stopped without user intervention

Incident Report for Fly.io

Resolved

Bigger servers in place, Nomad is running healthily.

Posted Mar 13, 2023 - 22:37 CDT

Update

We are provisioning far bigger servers to handle the increased workload our Nomad cluster has seen these past months.

Posted Mar 13, 2023 - 14:05 CDT

Update

Removing the server from the cluster seems to have helped with this issue temporarily.

Posted Mar 13, 2023 - 09:05 CDT

Identified

Our nomad cluster has consistency issues right now due to one of the servers at the limits of its resources. This seems to have an effect on apps V1.

Posted Mar 13, 2023 - 09:00 CDT