Home / Companies / Dagster / Blog / Post Details
Content Deep Dive

Announcing Dagster 0.14.0: Table Schema API + Pandera Integration

Blog post from Dagster

Post Details
Company
Date Published
Author
Sean Mackesey
Word Count
1,231
Language
English
Hacker News Points
-
Summary

The text discusses the challenges of managing data assets in modern data platforms, particularly the lack of metadata and the need for a more integrated approach to code and data. It introduces the concept of bridging the code-data gap by carving out a place in an orchestrator's data model for richly annotated assets. The text also explores the introduction of new features in Dagster 0.14.0, including an API for attaching metadata to assets, a Table Schema API for expressing tabular schemas as metadata, and an integration with Pandera, a library that implements data validation for Pandas-like dataframes. These features aim to improve observability, integrity, and maintenance of data quality in the field of data engineering.