Company
Date Published
Author
Alan Shreve
Word count
1318
Language
English
Hacker News points
None

Summary

ngrok has introduced Endpoint Pools, which allow for load balancing between multiple endpoints sharing the same URL. This feature is available on all non-legacy paid plans and can be tried out on the free tier. When two or more endpoints share a URL, ngrok groups them into an Endpoint Pool, where traffic to the URL of the Endpoint pool is balanced equally among the constituent endpoints via random distribution. Endpoints are automatically added to the pool they come online and removed from the pool as they go offline. The feature supports cloud and agent endpoints, including those started via different mechanisms, and can balance traffic across multiple networks, regions, and clouds. It also allows for resizing pools with zero configuration and derisks gateway-level traffic management changes by allowing each endpoint in a pool to define its own Traffic Policy. Geo-aware global balancing is also available, prioritizing endpoints closest to the point of origin. Custom load balancing strategies are coming soon, and endpoint pools work with various ngrok tools, including the CLI, SDKs, K8s Operator, and can balance internal endpoints as well.