Lightweight deletes for Tinybird Data Sources now in Beta

Tinybird has introduced a new lightweight delete functionality for ClickHouse, improving upon its previous data deletion method that required costly and time-consuming mutations. The new endpoint, POST /v1/datasources/{name}/delete, utilizes a feature in ClickHouse that materializes a hidden _row_exists mask, allowing for faster deletion acknowledgment and reduced resource consumption by reusing unchanged column files instead of rewriting affected parts. This ensures that deleted rows are filtered out during query read time, with the physical removal occurring later during background merges. The system supports both synchronous and asynchronous modes, providing flexibility for different use cases such as GDPR compliance, error removal, and partition-scoped cleanups. Users can implement this new functionality via the Tinybird CLI or API, with detailed instructions available in their Data Sources API reference, allowing for efficient data management without incurring the extensive costs associated with traditional methods.

No tracked trend matches for this post yet.