Filter, reshape, and redact logs before export with Transformers

Cloudflare Logpush Transformers enable customers to use SQL queries within the Logpush export pipeline to filter logs, redact sensitive information, and restructure records before they are delivered to SIEMs, analytics platforms, or storage destinations, reducing the need for separate processing services and potentially lowering downstream costs. Available across all self-serve and enterprise plans, Transformers operate on compatible NDJSON Logpush datasets and can be created, previewed, versioned, and attached to jobs through Transformer Studio or the API. To support high-volume processing, Cloudflare embeds Apache DataFusion, a Rust-based SQL engine built on Apache Arrow, directly in its Go-based Bufstream delivery service rather than using remote Workers, avoiding an added network dependency. Log batches are converted from Cap’n Proto records into typed Arrow batches, passed through a controlled Go-Rust interface for SQL execution, then converted back to compressed NDJSON for delivery. Queries are prepared and cached for reuse, while failed transformations fail closed to prevent untransformed data from reaching destinations, with retries, error reporting, automatic disabling of persistently failing jobs, and health metrics available for monitoring.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.