Company
Date Published
Author
Anton Ovchinnikov
Word count
1986
Language
English
Hacker News points
None

Summary

Sentry has built a distributed ingestion infrastructure, known as Points of Presence (PoPs), to improve scalability and efficiency. The previous single-region setup resulted in high latency for users worldwide, with end-to-end latency ranging from 150 ms to over 1 second. To solve this issue, Sentry developed a system that uses Relay, Kubernetes, Google HTTPS Load Balancer, Nginx, and Envoy proxy to minimize request latency and processing on the payload. The rollout was phased, starting with a few organizations sending traffic through PoPs, followed by enabling round-robin DNS, temporarily enabling all customer traffic, and finally completing the rollout in July 2021. Despite challenges, the new infrastructure has significantly reduced average response times, with most European locations now boasting sub-100 ms response times, and remote locations (Asia, Australia) within 100-200 ms. The system is now fully operational, and users are encouraged to update their SDK configurations to utilize the full power of PoPs.