Redefine tables within object storage connectors like Iceberg and Delta Lake without any downtime
Blog post from Starburst
Trino 431 introduces a significant advancement in data operations with the CREATE [OR REPLACE] TABLE statement, enhancing the management of tables in object storage connectors like Iceberg and Delta Lake by allowing atomic table replacements without downtime. This feature supports seamless transitions, ensuring continuous data availability and historical data retention for audits and rollbacks, making it particularly beneficial in scenarios involving concurrent queries. The statement's integration with dbt, specifically through the dbt-trino adapter, allows for the safe replacement of tables 'in place' without the downtime associated with previous methods such as 'rename' or 'drop', thus maintaining table history and reliability during updates. This advancement is particularly advantageous for business intelligence tools and ETL processes, as it ensures that tables remain accessible and consistent throughout updates, which are executed atomically, enhancing overall data performance and reliability.