Making AI Agents Stateful and Fault-tolerant on Google Cloud Run

Serverless platforms like Google Cloud Run provide a fast and maintenance-free deployment option, but their stateless nature poses challenges for agentic AI applications, which require statefulness for executing multi-step workflows. These workflows often involve tasks such as writing to databases or calling external services, and interruptions can lead to inconsistent states, especially during long-running or bursty operations like customer support during peak times. Cloud Run's limitations, including its hour-long timeouts and lack of in-memory state persistence, make it unsuitable for stateful AI agents without additional tools. DBOS, an open-source library, addresses these challenges by storing workflow states in a Postgres database, enabling durable and observable workflows that can automatically resume after failures and scale with fine-tuned concurrency controls. Dosu, a team focused on AI-native knowledge infrastructure, successfully implemented DBOS to run tens of thousands of agentic workflows per hour on Cloud Run, overcoming scalability and reliability issues while maintaining lightweight serverless operations. Their integration included switching to instance-based billing, creating a dedicated Cloud SQL Postgres instance, and building custom Grafana monitoring dashboards, resulting in a resilient and scalable solution for their AI applications.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.