We added the Backup Database engine to ClickHouse ®

ClickHouse® has introduced a new Database engine called Backup in its latest version 25.2, designed to streamline the process of working with databases in read-only mode directly from backups without performance issues. This engine supports both incremental and non-incremental backups, allowing users to attach tables and databases instantly to ClickHouse® and work with them as usual tables. The Backup engine addresses challenges encountered during client upgrades to new ClickHouse® versions, where performance issues and edge cases often require testing with real production data. The implementation includes components like BackupDisk and DatabaseBackup, which handle path translation and adapt the backup interface to the disk interface, ensuring seamless integration and operation. The engine is user-friendly, compatible with various backup engines like S3, Azure, File, or Disk, and can work with complex use cases such as validating upgrades, building time machine functionality, sharing datasets, and running ad-hoc queries. The future development plans for this engine include potential write capabilities and enhancements for multi-machine setups, with Tinybird planning to leverage this functionality for their upcoming "self-managed Tinybird" service.