On-demand compute for scheduled Copy Pipes

Tinybird Scheduled Copy Pipes can use temporary dedicated ClickHouse compute by adding `ON_DEMAND_COMPUTE true` to their datafiles, isolating resource-intensive scheduled transformations from a workspace’s primary compute resources. Copy Pipes periodically run queries and write results to target Data Sources, supporting append mode for incremental rollups and replace mode for current-state snapshots, with common uses including CDC deduplication, event aggregation, and snapshot creation. The setting applies only to scheduled runs, while manually triggered runs require the `--on-demand-compute` CLI flag in either Forward or Classic, and users must update their CLI to support the syntax. Positioned as a batch-oriented complement to incremental Materialized Views, Copy Pipes can build broader historical views that may be combined with recent data in a lambda architecture. On-demand compute is available on paid plans, uses a default 64-core instance, and is billed by compute time in region-dependent credits; because provisioning adds startup overhead, it is intended for larger or overlapping jobs whose resource demands justify dedicated capacity rather than for every scheduled query.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.