Let Them Cook: Lessons from 6 Weeks of Multi-Agent Orchestration

Agent Relay is an open-source communication layer that facilitates seamless interaction among various CLI tools, enabling effective multi-agent orchestration. This technology allows agents to coordinate tasks autonomously, with humans stepping back to oversee the process, although planning and review phases remain crucial for success. The system's flexibility lets users assign specific roles to agents, such as Lead, Backend, and Reviewer, to mimic human team structures and improve efficiency. Despite the impressive speed improvements and enhanced task execution that result from using Agent Relay, challenges like agent laziness and potential overwhelm of Lead agents can arise. The use of shadow agents, continuity concepts, and trajectory storage can mitigate these issues by ensuring quality control and preserving context for ongoing and future tasks. The human role evolves into coordinating and meticulously planning, with a strong emphasis on cross-review strategies to maintain high standards.