December 2023 Summaries

Metaplane is pleased to be part of Snowflake's Horizon Partner Ecosystem, further strengthening its partnership with Snowflake. Metaplane offers the first native application for Data Observability and has undergone Snowflake technical validation before achieving a Premier Partner designation. The company ensures data trustworthiness by preventing and detecting data issues in businesses like Bose, ClickUp, and Klaviyo. It leverages partnership with Snowflake to alert users of any data anomalies using ACCOUNT_USAGE and INFORMATION_SCHEMA features. Metaplane is committed to supporting the latest releases from Snowflake Data Cloud, including updates for Dynamic Tables. Current Snowflake users can set up a free Metaplane account or schedule a personalized implementation workshop.

Metaplane has integrated with Hightouch, a tool that enables data syncs between your warehouse and go-to-market teams' tools. This integration allows users to monitor the impact of data outages on all their data products, including dashboards, datasets used for product suggestions, and data syncs powered by reverse ETL tools into applications and databases. Metaplane provides end-to-end lineage graphs and column-level lineage to help users understand and manage data issues across their entire data pipeline. This integration helps companies build trust and activate their data with confidence.

During the holidays, a data engineer is on call and discovers an issue with the nullness spiking in their DAILY_TRANSACTION_LOG table. They find a helpful note from a teammate Jessica in the monitor's timeline that guides them to fix the problem. The platform now allows users to add notes to monitors, improving communication and context within teams.

Metaplane has expanded its support for Snowflake by adding one of their latest table types, Dynamic Tables. This integration allows users to apply machine learning-based data quality monitors to automatically detect errors in all table and view types within Snowflake. With this update, users can proactively alert stakeholders about issues with dynamic tables and trace the root cause using column level lineage.

Metaplane now supports Azure and AWS PrivateLink, adding to its existing options for Direct Connection, SSH, and Reverse SSH. The company prioritizes data privacy and security by conducting annual pentests, SOC 2 Type 2 audits, following industry best practices, and encrypting data in transit. With the addition of PrivateLink support, Metaplane can establish a direct, private network connection to Snowflake instances without exposing data to the public internet. This feature is particularly useful for teams that prefer not to maintain IP whitelists or have servers in a DMZ. Current customers' data remains secure, and those interested in setting up PrivateLink support can refer to AWS PrivateLink and Azure Private Link documentation.

Metaplane introduces the Audit History feature, which consolidates workflows within the platform. This new feature provides a timeline of information to help users understand why and what guardrails were set up for specific objects in the past. It shows who set up the monitor, when configurations were last changed, and related incidents from the past. The Audit History also includes notes contributed by multiple teammates, providing valuable context on incident resolution and prevention strategies.

Maintaining data integrity involves various considerations and processes that differ depending on the organization. Data integrity is a term used to describe data quality, which can be broken down into intrinsic and extrinsic dimensions. Factors affecting data accuracy include data entry and collection, data storage and management, backups and recovery, security measures for data integrity, and regular monitoring and auditing. To ensure data integrity, it's essential to outline what data quality means to stakeholders, be aware of historical causes of data integrity issues, understand how tools and processes behave, and use continuous monitoring to scan the data. Metaplane is a data observability tool that helps maintain trust in business data by catching data quality issues when they happen and preventing incidents before they occur.

Implementing data observability software requires careful planning and consideration of various factors. Some common mistakes to avoid include lack of clear objectives, neglecting data quality issues, overlooking scalability requirements, ignoring user training and adoption, and neglecting continuous monitoring and optimization. To ensure a successful implementation, it is essential to outline capabilities, integrate the entire data stack, create clear objectives with a focus on critical objects, review rollout, and continue to succeed and scale.