Dagster + Atlan: Real-Time Asset Observability in Your Data Catalog

The integration between Dagster Cloud and Atlan streamlines the synchronization of data pipeline events and asset materializations by enabling real-time streaming of asset events directly into Atlan's data catalog. This integration reduces the need for users to switch contexts when managing data pipelines in Dagster and cataloging assets in Atlan by creating a live connection that automatically syncs asset materializations, failures, run statuses, and lineage relationships, along with rich event metadata. It operates through a dedicated event consumer that monitors the Dagster Cloud event log and forwards relevant events to Atlan, enriching the Atlan catalog with operational metadata and ensuring it reflects the actual state of the data pipelines. The integration is available for all customers of Dagster Cloud and Atlan, and feedback for further improvements is encouraged.