Company
Date Published
Author
Carlo Scalisi
Word count
1579
Language
English
Hacker News points
None

Summary

The text discusses the adoption of dbt, an open-source ETL tool, by N26, a tech company. The data analytics team at N26 found that dbt allowed them to set up complex production-grade data pipelines using SQL SELECT statements, freeing up time for data engineers to focus on administrative tasks. Before adopting dbt, the team used a light ETL microservice that was cumbersome to use and had several bottlenecks in tooling and data governance. The introduction of dbt revolutionized how the team works, allowing them to easily add business logic to raw data sources without taking precious time from the DWH team. The team now has over 800 data models running daily or weekly, with well-organized projects and a containerized application on a Kubernetes cluster. Despite some challenges, dbt has had a significant impact on the team's productivity and scope, and the company plans to continue using it as they expand their business.