/plushcap/analysis/airbyte/orchestrate-your-airbyte-elt-jobs-with-dagster

Orchestrate your Airbyte ELT Jobs with Dagster

What's this blog post about?

In 2021, Airbyte has been focusing on expanding its number of connectors and integrations within the data stack to enable any data teams to fully leverage its ELT features. Since its inception 18 months ago, Airbyte has been used by more than 12,000 companies to sync data and now counts over 170 connectors. The company's vision is to commoditize data integration, including the full integration of Airbyte with the data stack. Airbyte recently announced its partnership and integration with Dagster, an open-source orchestration platform for the development, production, and observation of data assets maintained by Elementl. This partnership closes the loop with the integration of popular open-source orchestration platforms: Airflow, Prefect, and now Dagster. Both Airbyte and Dagster are passionate about helping data engineers, analysts, and scientists have better control over their data flows. The integration enables organizations using Airbyte to leverage Dagster's orchestration platform to trigger Airbyte syncing jobs. This partnership is another step in providing better control and visibility for data teams. Given Airbyte's ambition to address the long tail of connectors with a goal of reaching 500+ connectors by the end of 2022, Dagster users will be able to benefit from this growing list of high-quality maintenance-free connectors, thus saving more and more engineering time.

Company
Airbyte

Date published
Feb. 10, 2022

Author(s)
John Lafleur

Word count
450

Hacker News points
None found.

Language
English


By Matt Makai. 2021-2024.