October 2023 Summaries

Metaplane now allows users to add custom names to any monitor, providing additional context for team members. This feature is useful when a standard monitor has been modified or tailored to specific needs. To change the name, simply hover over the existing one and click it. This update aims to enhance the monitoring experience in Metaplane.

Metaplane, a data observability platform, has introduced more visibility into alert destinations on its monitor page. Alerts are crucial for identifying data quality issues within the system. The platform supports various alert destinations such as Slack, MS Teams, email, and PagerDuty, with custom routing logic at the individual monitor level. However, managing multiple alert destinations and custom routing settings could be challenging. With this update, users can now easily view which alert destinations a monitor is being sent to directly from the monitor page, making Metaplane's alerts more user-friendly.

Metaplane now allows users to set time zones at both account and monitor levels, ensuring monitors run according to the desired schedule regardless of daylight savings or other changes. This feature provides more customization options for monitoring data issues at specific times in different time zones. By default, UTC is still used for evaluating crontabs if no time zone is specified.

Metaplane has introduced two upgrades for its custom SQL monitor feature, allowing users to choose the machine learning model they want to use when making predictions and displaying results in integers, decimals, percents or units of time. The new updates aim to make custom SQL monitors more flexible and easier to use, enabling users to apply out-of-the-box models for specific monitoring scenarios and adjust the format of displayed values.

Metaplane has introduced custom dashboards that allow users to monitor the data health of different segments of their data stack. The new feature is built using tags, which can be automatically pulled from dbt models or added manually in Metaplane. Every tag will have its own dashboard, accessible through the main dashboard's "All dashboards" menu. Users can create custom dashboards by adding tables or monitors they wish to monitor. This feature aims to provide a more personalized and actionable data health monitoring experience for different teams within an organization.

Metaplane has introduced tags at the monitor level, allowing users to organize their data stack further and route alerts more granularly. This feature enables users to tag specific monitors with existing or new tags, providing more control over alert routing. Users can now send only the relevant monitors to individual alert destinations such as Slack, MS Teams, email, or Pagerduty, keeping channels well-organized and relevant.

Migrating from an old warehouse or lake to a new one requires careful planning and execution. Key considerations include identifying the necessary data, setting up replication processes without disrupting ongoing updates, and ensuring data integrity during migration. A typical warehouse migration process can take anywhere from a few months to two years. Tools like Fivetran can support this process by simplifying object selection, setup, and automated replication. Database replication pointers include using log-based replication when possible and implementing change management strategies. Data quality safeguards involve monitoring for freshness, volume changes, and numeric distributions to ensure data integrity during migration.