June 2026 Summaries

Advancements in AI have led to the development of agents that execute long-running workflows, necessitating robust solutions to ensure durability and observability. Restate and Arize Phoenix provide a comprehensive approach to address these needs by enabling agents to recover from failures without losing progress and offering detailed traceability of workflow steps. Restate ensures durable execution, allowing agents to resume tasks after interruptions like crashes or retries, while Phoenix offers a structured view of each agent's behavior, capturing details like LLM calls, tool invocations, and evaluation results. This integration allows developers to build resilient agents by tracing every step, evaluating outputs, and iterating on improvements, with the added benefit of assessing agent quality through asynchronous evaluations. The tools are open-source and designed to be easily integrated into existing workflows, supporting languages like TypeScript and providing serverless deployment options for enhanced flexibility and reliability.

Agent frameworks often claim to provide "durable execution" and "resiliency" through checkpointing, but this often falls short of the requirements for deploying long-running agents in production environments. These agents, which can be costly and fragile, typically rely on models that incur charges per invocation and require human approval for certain actions, making them susceptible to interruptions like process restarts and connection issues. Current checkpointing solutions, which save the agent's state periodically to a database, only address part of the problem by allowing recovery from the last saved state, often necessitating re-execution of completed steps and not effectively handling parallel tasks. Instead, a more robust solution involves a durable orchestrator that tracks execution at a granular level, ensuring that completed steps are not repeated and that processes can fast-forward to the exact point of failure. Such systems should also handle complex retry policies, version-aware execution, and ensure high availability through distributed systems engineering. Restate is presented as an open-source orchestrator that offers these capabilities, integrating with existing agent SDKs to enhance durability and reliability, thereby supporting not only AI agents but also business-critical workflows in various industries.