April 2024 Summaries

Data Insights update introduces an unused tables tab and CSV export functionality to simplify data hygiene projects. The new feature provides a reference list for completely unused tables and tables with writes but no reads, helping users identify which tables to clean up for optimization. Additionally, users can now export these tables to CSVs, making it easier to share findings with broader teams or expand their scope of analysis.

Metaplane introduces a new feature, monitor recommendations, which simplifies setting up data observability across various components of a data stack. The tool identifies critical assets and common sources of data quality issues to recommend where to add monitors and what types to use. Examples include freshness and row count for landing zones, uniqueness and nullness for JOINs, and cardinality for group by statements. Users can further fine-tune these recommendations based on their specific needs. This feature, combined with powerful machine learning monitors, makes getting started with Metaplane a seamless experience.

Metaplane has added dbt exposures to its lineage graphs, allowing users to determine the impact of data quality incidents. This feature is particularly useful for understanding what's affected by data issues and identifying stakeholders who should be alerted when changes are merged. Integrating dbt with Metaplane also unlocks job duration monitoring, pull requests related to incidents, and data CI/CD features. To get started, users can connect their dbt account through an API key or the command line interface.