Company
Date Published
Author
Thomas Billicsich, Christoph Enzinger
Word count
1170
Language
American English
Hacker News points
None

Summary

Dynatrace has enhanced its OpenPipeline, a real-time stream processing engine, to improve scalability, manageability, and ease of use, enabling comprehensive data integration for observability, security, and business analytics. OpenPipeline's upgrades include support for processing petabyte-scale data and large log files up to 10 MB, ensuring efficient handling of diverse telemetry data such as logs, metrics, and traces. It offers unified data ingestion, breaking down silos by standardizing data from various sources and formats through customizable processing rules. Recent developments also allow for specialized handling of spans and Real User Monitoring (RUM) data, with ongoing enhancements for event processing. OpenPipeline simplifies pipeline management with ready-made processor bundles for popular technologies, facilitating quick onboarding of new data streams. It also provides real-time visibility and alerting for pipeline performance, with AI-powered dynamic baselining for anomaly detection. The transition for existing customers is made seamless with a side-by-side approach, ensuring uninterrupted operations while adopting OpenPipeline for new data sources.