Less doubt, more data - How to set up a lightning-fast data development cycle
Blog post from Lightdash
Lightdash aims to enhance the data development experience by integrating automation and testing strategies into data workflows, drawn from software engineering practices, to address common issues faced by data teams such as frequent application switching and error-prone processes. The company has introduced new features, leveraging its CLI and GitHub Actions, to streamline tasks such as schema file generation, project setup, and testing, which can be cumbersome and time-consuming. These improvements allow for the creation of preview environments that automatically sync with dbt changes, facilitating error detection and ensuring that the latest data is always accessible across the team. By automating repetitive tasks and simplifying testing, Lightdash seeks to make data development more efficient and enjoyable, ultimately pushing for productivity gains that could lead to a reduced workweek. The community is encouraged to provide feedback and engage with ongoing discussions to further refine these enhancements.