Tackling Agent Reliability: Rethinking the Todo Tool at Ona

Thomas Schubart discusses the overhaul of the ToDo tool at Ona, an initiative aimed at enhancing agent reliability by consolidating seven separate tools into one, thus simplifying decision-making and improving system architecture. The primary change involved shifting from an edge-triggered system, where the state was deduced from discrete events, to a level-triggered system, where the full state is always presented, reducing complexity and potential for errors. Schubart also emphasizes the importance of creating runtime guardrails, such as invisible system messages and interruption handling, to keep agents aligned with their tasks, and introduces mechanisms for ensuring task summaries are consistently generated and results are not prematurely hidden. The improvements made focus on reducing complexity for agents, making state explicit, designing for potential instruction drift, and ensuring that users receive clear and timely information, thereby reinforcing principles that enhance the functionality and reliability of AI-driven tools.