Introducing Bifrost: A new loading path for petabyte-scale OpenTelemetry

Bifrost is a new data-loading path for Axiom's machine data platform, designed to significantly reduce the cost of loading OpenTelemetry data at petabyte scale by leveraging Axiom's expertise in encoding, compression, and batching closer to the data source. Unlike the conventional centralized pipeline that processes every byte after data arrival, Bifrost prepares query-ready columnar batches near the data source, allowing for immediate streaming into object storage and subsequent querying without additional processing. This approach eliminates the need for ingest compute, thus reducing costs associated with data reshaping and bandwidth, and it supports keeping more OpenTelemetry data by minimizing the need for data sampling. Bifrost remains aligned with Axiom's managed platform, ensuring that data retains the same storage, retention, and query capabilities as the existing pipeline, with loading costs starting significantly lower than the standard path. Currently in private preview, Bifrost is aimed at users managing large-scale OpenTelemetry workloads, promising considerable savings and efficiency in handling massive data volumes.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.