Building an ML Platform for the Agent Era with Prefect

Ramp, a fast-paced financial technology company, has revolutionized its machine learning platform to accommodate a broader mix of users, including product managers and salespeople, by adopting Prefect as its orchestration tool. This change was driven by the need for a flexible and AI-native framework that could keep up with Ramp's rapid development pace and the increasing capabilities of language models and coding agents. The migration from Metaflow to Prefect was completed in a single quarter, with the number of deployed workflows growing significantly as users embraced the new system. Prefect's Python-based, decorator-style orchestration allows users to deploy workflows with minimal refactoring and provides runtime customization through an intuitive UI. This transition has enabled Ramp to democratize the building of workflows, allowing non-technical contributors to leverage machine learning models for real business value, while the centralized platform team maintains control over core code and infrastructure. The new setup also includes automated debugging flows and templated workflows to streamline deployment and maintenance, all of which have significantly increased the number of commits in Ramp's ML platform repository, showcasing the platform's scalability and adaptability.