DevFly.io8 months ago
Corrosion
11 min read
On September 1, 2024, a Fly Machine update caused every edge proxy to deadlock, triggering Fly.io's worst outage. The root cause was a Rust concurrency footgun in an if let expression over an RWLock. Fly.io open sourced Corrosion, its state synchronization system, after the incident.
Level
Hype check
Tap to vote and see what everyone thinks.