Build and run scalable transformation pipelines using dbt Cloud and Starburst
Blog post from Starburst
The partnership between dbt Labs and Starburst offers a streamlined approach to managing data transformations by integrating Starburst as a native connection option in dbt Cloud, allowing data teams to efficiently build, test, and document data pipelines across multiple sources. Starburst, a data lake analytics platform, enhances data discoverability and governance, addressing common challenges such as poor documentation and outdated pipelines. The integration enables data teams to benefit from features like version control and generated documentation, facilitating the creation of production-grade pipelines. Starburst Galaxy's ability to federate queries from dbt Cloud to multiple data sources simplifies the process of building pipelines from a central location, accommodating both relational and NoSQL databases. With this collaboration, users can rapidly set up data transformation projects by creating a dbt Cloud project, selecting Starburst as the data platform, and leveraging SQL to connect diverse data sources efficiently.