Reduce CDN log costs with searchable archives
Blog post from Datadog
Engineering teams managing high-volume log sources like CDN edges and streaming platforms face challenges in balancing log retention costs with accessibility for investigations. Datadog's Observability Pipelines and Archive Search offer a solution by allowing teams to route raw logs to low-cost object storage while sending high-signal events to Datadog for monitoring. This approach reduces indexing costs and maintains accessibility for historical investigations without the need to switch analytics tools. Observability Pipelines come with prebuilt parsing logic, enabling the normalization and routing of logs across different CDN providers, while Archive Search facilitates querying of archived logs directly within Datadog, streamlining the investigation process. By integrating these tools, teams can maintain a seamless workflow, leveraging existing identities and access controls for both real-time monitoring and historical data analysis, ultimately enhancing their ability to act on insights efficiently.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| Observability | 19 | 3,430 | 674 | 183 | +0% |
| Real-time | 8 | 5,457 | 1,338 | 238 | -5% |