July 2022 Summaries

Elementl, the company behind Dagster Cloud, has successfully completed a Service Organization Control (SOC 2) Type I audit, which verifies that they follow data security best practices. This achievement provides customers with confidence in Elementl's ability to manage their customer data securely. The SOC 2 report is generated by a third-party auditor who inspects the company's security policies and confirms that they meet the trust services criteria set by the American Institute of CPAs (AICPA). By passing Type I, this confirms that Elementl has established policies and procedures to meet the SOC 2 security standards. The company aims to create a great experience for its customers in Dagster while prioritizing data security, and has already started its SOC 2 Type II audit. Customers can request a copy of the report by contacting Elementl's sales team.

The Dagster team has announced two significant developments: the release of Dagster 1.0, marking a new era for the project, and the general availability of Dagster Cloud, which offers a rock-solid platform for users to deploy and maintain their workflows with confidence. The Dagster community played a crucial role in shaping this product, and the team is grateful for their trust and feedback. Users can now sign up for Dagster Cloud, which includes revolutionary new capabilities, and join the Dagster Slack community to stay updated on the latest news and developments. Additionally, the team has released guides and tutorials on AI reference architectures and LLM routing with Not Diamond, further expanding the capabilities of the platform.

The text discusses the concept of "Roman roads" in data engineering, which refers to building reusable and modular data pipelines that can be leveraged to build new data products. The idea is inspired by the Roman Empire's extensive network of roads, which facilitated travel and trade across vast territories. In data engineering, these "roads" are represented by reusable entities such as data assets and operations, which can be used to transform and process data in a modular and efficient manner. The text introduces Dagster, a platform that models these components and enables the reuse of code throughout the data pipeline, allowing for incremental changes and faster development. By building Roman roads with Dagster, data teams can create a foundation for their future data products while minimizing the need to start from scratch.