Just landed: streaming ingestion on Cloudflare with Arroyo and Pipelines

The Cloudflare team is launching the open beta of Pipelines, a streaming ingestion product that allows users to ingest high volumes of structured, real-time data and load it into object storage service R2. The product enables scalable, fault-tolerant, and efficient data processing, with features such as automatic scaling, durable objects, and read-write replication for reliability. Arroyo, a cloud-native distributed stream processing engine, is being integrated with Pipelines to enable real-time data transformations and SQL-like querying capabilities. The service offers free tier plans and introduces pricing based on the volume of data ingested and delivered into Pipelines, with costs starting at $0.02 per additional GB beyond the first 50GB per month.