I Wanna Go Fast - Load Balancing Dynamic Steering

In July 2018, Cloudflare introduced Dynamic Steering for Load Balancing, a feature that directs traffic to the fastest pool of origins based on a user's location. To build this feature, two key problems were addressed: deciding which origin pool was the fastest and distributing this decision across 151 global locations. The solution involved using Exponential Weighted Moving Average (EWMA) to calculate round trip time (RTT) from edge locations and propagating this data to every machine serving requests. This feature is available for Enterprise customers and those with the Geo Routing add-on for Load Balancing.