Company
Date Published
Author
GitHub Engineering
Word count
1445
Language
English
Hacker News points
None

Summary

GitHub developed a new load balancer, called GLB (GitHub Load Balancer), to address the limitations of its existing monolithic, vertically scaled load balancing system, which could not meet the demands of its growing infrastructure. The new system runs on commodity hardware, scales horizontally, and is designed to handle high availability, connection draining, and support for multiple services per load balancer host. It employs a L4/L7 split design, using Equal-Cost Multi-Path (ECMP) routing for efficient traffic distribution across multiple servers, and incorporates a stateless director tier using Rendezvous hashing for consistent time lookups. This approach allows for graceful removal of nodes without disrupting user connections and aims to ensure seamless operations even in the event of node failure or maintenance. The GLB's design is optimized for resilience against DDoS attacks and provides tools for future attack mitigation, with plans to release its components as open-source software.