Segment is a customer data infrastructure that collects data from sources and routes it to destinations as quickly and reliably as possible. To provide real-time insights into the performance and reliability of their data pipelines, Segment developed a metrics pipeline and API. The pipeline measures, aggregates, and stores data about outbound events delivered every day, providing users with a global view of the real-time status of hundreds of partner APIs. With this data, users can quickly visualize if a Destination is having service problems, set up alerts, and investigate errors in just a few clicks, resulting in confidence in using Segment for customer data infrastructure. The pipeline also delivers data at scale, utilizing Kafka, AWS Aurora MySQL, and a REST API service to process and expose the data as timeseries data. The integration with Datadog allows users to visualize and alert on delivery metrics and errors, providing deeper insights into their data pipelines and enabling them to build custom dashboards and alerts to track real-time health.