January 2024 Summaries

Metaplane has introduced a new integration with Jira, a popular project management tool, to streamline incident management workflows. The integration allows users to create Jira issues directly from any given Metaplane incident and access the associated ticket in Jira directly from Metaplane. This complements existing workflows in Jira, enabling teams to handle data quality incidents faster and build trust in their data.

Metaplane introduces its latest feature, Incident Resolution Metrics, which simplifies reporting on data quality efforts to the executive team. Users can now view metrics related to data quality incidents and their resolution directly on the dashboard, making it easier to track progress towards goals. This feature helps customers achieve data quality-related OKRs and provides an overview of current issues impacting important datasets.

Metaplane introduces its latest feature, monitor ownership, to streamline incident resolution workflows. This new functionality allows users to assign an owner for each failing monitor directly on the page, improving communication and understanding of incident responsibilities. Monitor owners can set up notifications in their preferred communication tools like Slack or Microsoft Teams. There are three ways to define a monitor owner: from the dropdown monitor page UI, bulk actions menu on the Monitoring page, or importing from dbt projects. This feature aims to enhance resolution times and improve data quality management.

The text emphasizes the importance of focusing on data quality rather than model complexity in machine learning (ML). It argues that a "garbage in, garbage out" approach applies to ML as well, and improving data quality can lead to better outcomes even with simpler models. The author criticizes the industry's obsession with complex models and highlights how this tendency often overlooks fundamental data quality issues. They propose a shift towards data-centric ML, which prioritizes data cleansing, pre-processing, balancing, and augmentation over hyperparameter selection and architectural changes. The text also discusses the importance of monitoring data quality and improving it continually.

Metaplane has integrated with reverse ETL provider Census, becoming the first Data Observability tool to do so. This integration allows users to take their data beyond business intelligence dashboards and directly into the business tools they use every day. With this latest integration, identifying downstream impact now also means understanding which Census Destinations are affected by any incident in your warehouse. Metaplane's end-to-end integrations with the rest of a user's data stack ensure that users will always be the first to know about any data outages and who they affect.

Tracking numeric distribution metrics in Snowflake can help businesses uncover hidden patterns, predict upcoming trends, and make data-driven decisions. The four key metrics to monitor are minimum, maximum, mean, and standard deviation. By tracking these metrics, businesses can identify issues before they become major problems, understand their overall performance, and maintain business stability and predictability. Using SQL queries in Snowflake, businesses can calculate these metrics for specific time frames or partitions of data, providing valuable insights into sales trends and performance.