Announcing Snowplow Lake Loader
Blog post from Snowplow
Snowplow has expanded its data collection capabilities on Microsoft Azure by introducing additional data destinations, including Databricks, Azure Synapse Analytics, Azure Fabric, and OneLake, supported by the new Snowplow Lake Loader. Unlike traditional loaders, the Lake Loader streams data to a data lake using Open Table Formats like Delta, which allows for cost-effective storage and efficient queries from compatible data warehouses. This new approach ensures well-structured data by automatically managing schema changes and supports various cloud platforms and open table formats, such as AWS, GCP, Delta, Apache Iceberg, and Apache Hudi. The Lake Loader is currently in early stages, being tested with major customers, and future developments include expanding cloud and destination support, with additional Quick Start guides and a compatible release for Snowplow's BDP Enterprise offering on Azure.