Company
Date Published
Author
Brenner Heintz, Coral Trivedi
Word count
666
Language
English
Hacker News points
None

Summary

We're excited to announce that Fivetran now offers a new data lake destination in Beta: Delta Lake on Azure Data Lake Storage (ADLS). This new destination allows customers to unify all their data in one place, the "lakehouse", with minimal effort and cost. Fivetran automates the process of extracting, cleansing, conforming, and converting data to Delta Lake format, before loading it into ADLS, making advanced analytics and AI on the data faster. The new destination is a big deal because it simplifies the process of landing data from multiple sources into ADLS, reduces headaches with change data capture, and provides native integration with Databricks Unity Catalog and Microsoft Purview for governance and lineage tracking. With Fivetran's platform being completely no-code, changes to source data are reliably synced, and a single connector can be set up in under 10 minutes. The new destination also features less expensive ingestion using Fivetran compute, instead of Databricks compute, making it more cost-effective for customers. Ultimately, Fivetran aims to support data ingestion from all sources onto any cloud, in any analytics format.