Monitor your customer data infrastructure with Segment and Datadog

Segment, a customer data infrastructure company, has developed a metrics pipeline and API to provide users with real-time insights into the performance and reliability of their data pipelines. The metrics pipeline collects data for every Source-Destination pair, allowing users to track the unique delivery status of their data to Destinations. This information is exposed in the Segment Config API and can be monitored via a new Datadog integration. The architecture supporting this metrics pipeline includes Kafka for processing and collecting metrics, AWS Aurora MySQL for aggregating metrics, and a REST API service for exposing it as timeseries data. With these tools, users can visualize and analyze their data pipelines to gain deeper insights into their performance and reliability.