Home / Companies / Datadog / Blog / Post Details
Content Deep Dive

Reduce CDN log costs with searchable archives

Blog post from Datadog

Post Details
Company
Date Published
Author
Rufina Mariam
Word Count
1,672
Company Posts That Month
57
Language
English
Hacker News Points
-
Summary

Engineering teams managing high-volume log sources like CDN edges and streaming platforms face challenges in balancing log retention costs with accessibility for investigations. Datadog's Observability Pipelines and Archive Search offer a solution by allowing teams to route raw logs to low-cost object storage while sending high-signal events to Datadog for monitoring. This approach reduces indexing costs and maintains accessibility for historical investigations without the need to switch analytics tools. Observability Pipelines come with prebuilt parsing logic, enabling the normalization and routing of logs across different CDN providers, while Archive Search facilitates querying of archived logs directly within Datadog, streamlining the investigation process. By integrating these tools, teams can maintain a seamless workflow, leveraging existing identities and access controls for both real-time monitoring and historical data analysis, ultimately enhancing their ability to act on insights efficiently.

Trends Found in this Post
Trend Post Mentions Total Month Mentions Posts Companies MoM
Observability 19 3,430 674 183 +0%
Real-time 8 5,457 1,338 238 -5%