Home / Companies / Snowplow / Blog / Post Details
Content Deep Dive

Announcing Snowplow Lake Loader

Blog post from Snowplow

Post Details
Company
Date Published
Author
Rob Edwards
Word Count
488
Language
English
Hacker News Points
-
Summary

Snowplow has expanded its data collection capabilities on Microsoft Azure by introducing additional data destinations, including Databricks, Azure Synapse Analytics, Azure Fabric, and OneLake, supported by the new Snowplow Lake Loader. Unlike traditional loaders, the Lake Loader streams data to a data lake using Open Table Formats like Delta, which allows for cost-effective storage and efficient queries from compatible data warehouses. This new approach ensures well-structured data by automatically managing schema changes and supports various cloud platforms and open table formats, such as AWS, GCP, Delta, Apache Iceberg, and Apache Hudi. The Lake Loader is currently in early stages, being tested with major customers, and future developments include expanding cloud and destination support, with additional Quick Start guides and a compatible release for Snowplow's BDP Enterprise offering on Azure.