Home / Companies / Datadog / Blog / Post Details
Content Deep Dive

Track and improve the performance of streaming data pipelines with Datadog Data Streams Monitoring

Blog post from Datadog

Post Details
Company
Date Published
Author
Nicholas Thomson, Jane Wang, Jonathan Morin
Word Count
1,695
Language
English
Hacker News Points
-
Summary

Datadog Data Streams Monitoring (DSM) is a tool that helps track and improve the performance of streaming data pipelines and event-driven applications using Kafka and RabbitMQ. It provides deep visibility into services, queues, and infrastructure across the entire pipeline, enabling users to monitor latency, pinpoint bottlenecks, identify issues such as blocked messages or offline consumers, and enhance existing troubleshooting workflows. DSM automatically maps the architecture of streaming data pipelines and visualizes interdependencies, service ownership, and key health metrics across services and infrastructure. This helps users monitor end-to-end latency, alert on bottlenecks, identify and remediate floods of backed-up messages, and improve overall pipeline performance.