September 2025 Summaries

Prefect offers a versatile architecture designed to meet diverse security and compliance needs across different sectors, including financial, healthcare, and government organizations. Its unique hybrid architecture consists of two components: Prefect Cloud for orchestration and a user-managed execution environment, ensuring that sensitive data and proprietary code remain within users' infrastructure. For enhanced security, Prefect supports AWS PrivateLink, enabling communication over private networks without internet exposure. Additionally, the Customer-Managed Prefect option allows organizations to deploy the entire Prefect Cloud within their infrastructure, providing complete control and compliance with frameworks like FedRAMP. This architecture is ideal for entities with stringent security requirements, as it allows for flexible deployment configurations without compromising on data security or compliance.

Prefect underscores its ongoing commitment to the open-source community by contributing $30,000 this year to support the developers behind various open-source projects, aligning with the Open Source Pledge initiative. The company is particularly focused on enhancing the data ecosystem by investing in data-related tools, recognizing the modern data stack's reliance on numerous open-source projects. Prefect adopts a unique funding strategy by allocating more resources to smaller, emerging projects that have significant potential but less visibility. This approach aims to support transformative early-stage tools, diversity in the ecosystem, and the next generation of essential infrastructure. Among the projects supported are UpdateCLI, SQLAlchemy, HTTPX, Uvicorn, Starlette, pytest, Jinja, pre-commit, PyO3, websockets, and cyclopts, each contributing significantly to the Python ecosystem. Prefect's initiative is not just about financial aid but also about strengthening the foundational tools, enabling maintainers to devote more time to their projects, and fostering innovation to build a sustainable open-source community. The company actively encourages other organizations to join in supporting open source through various means, emphasizing the importance of a collaborative effort in sustaining the ecosystem.

Climate Policy Radar is an NGO dedicated to making global climate laws and policies accessible by transforming vast amounts of government documents into structured, searchable data, serving an annual user base of 350,000, including academics, policymakers, and journalists. They partnered with institutions like the Grantham Institute and UNFCCC to curate a comprehensive dataset for understanding global climate policy. The organization faced orchestration challenges using AWS Step Functions, prompting a shift to Prefect, which provided greater flexibility, scalability, and ease of use for their data scientists and engineers. Prefect enabled the creation of complex workflows, including a document processing pipeline and an AI-powered knowledge graph system, while allowing contributions from various teams without complex setup. This transition empowered data scientists to operate independently, facilitated large-scale research collaborations, and prepared Climate Policy Radar for future challenges like integrating 50,000 climate litigation documents in partnership with Columbia University's Sabin Center. Prefect's implementation streamlined their operations, allowing the organization to focus on core business logic and expand their AI capabilities, demonstrating how an effective orchestration platform can aid in addressing global climate challenges.

In the summer of 2022, Prefect faced a pivotal decision about enterprise authentication for its SaaS product, Prefect Cloud, ultimately choosing WorkOS as their partner for authentication and single sign-on (SSO) solutions. This decision, repeated for their later innovation FastMCP Cloud in 2025, was driven by the need to avoid the complexities of enterprise authentication, which includes supporting various identity providers like Okta and Azure AD, ensuring compliance with security standards, and managing user provisioning. By partnering with WorkOS, Prefect streamlined enterprise onboarding, reduced engineering involvement in SSO setup, and increased team velocity, allowing engineers to focus on enhancing their core product rather than authentication intricacies. The integration of WorkOS not only simplified internal processes but also saved significant developer time, which could be reinvested into improving data orchestration features like workflow observability and Kubernetes support. This strategic choice reflects Prefect's philosophy of building what differentiates them while outsourcing non-core functions, thus enhancing the overall value delivered to their enterprise customers.