Datadog and ClickHouse partner to bring full-fidelity data to modern observability
Blog post from ClickHouse
Observability teams are increasingly handling vast amounts of data due to the rise of AI applications and distributed systems, prompting organizations like OpenAI and Shopify to use ClickHouse for scalable and cost-effective data storage and analysis. A new partnership between ClickHouse and Datadog addresses the historical tradeoff between data retention and accessibility by enabling organizations to route logs directly to ClickHouse through Datadog Observability Pipelines, allowing for enriched, filtered, and transformed log data to be stored efficiently. This collaboration allows teams to utilize Datadog's familiar interface and investigative tools while benefiting from ClickHouse's scalable storage, facilitating historical data analysis and maintaining full-fidelity data without workflow disruption. With federated log search capabilities, teams can search ClickHouse logs directly from Datadog's Log Explorer, eliminating the need for data duplication and enabling seamless integration between the two platforms. This partnership empowers organizations to store and access significantly more telemetry data with enhanced control over data location, retention period, and accessibility, all while preserving performance and usability.