From the community: How my team uses Unleash Edge to handle high traffic loads
Blog post from Unleash
Nick Jiang describes how his team at Codeium tackled a scaling issue in their AI code assistant using Unleash Edge. The problem arose when a buggy release caused their Postgres instance to overload, as Unleash-generated metrics resulted in an excessive number of transactions per second. This was due to the unexpected usage of Server SDKs in their distributed system, which scaled with their users and directly impacted the Postgres database. After consulting the Unleash Community, they deployed Unleash Edge, which acts as a cached read-replica between the SDK instances and the main Unleash server. This solution effectively decreased the transaction load by over 100 times, despite introducing minor complexity and propagation latency. The team found the trade-offs acceptable, as they could adjust the refresh intervals to manage latency, and Jiang recommends Unleash Edge for its scalability benefits.