Agent Engineering: A New Discipline

Agent engineering is an emerging discipline that focuses on refining non-deterministic language model systems into reliable production experiences, responding to the unpredictability inherent in agents that can handle complex tasks across multiple steps. Unlike traditional software development, where inputs and outputs are largely known, agent engineering must contend with the vast and unpredictable range of user inputs in natural language, necessitating a continuous cycle of building, testing, observing, refining, and repeating. Successful companies like Clay, Vanta, LinkedIn, and Cloudflare are pioneering this approach, integrating product thinking, engineering, and data science to create systems that adapt and reason in real-time. This new engineering standard involves a shift from exhaustive pre-launch testing to using production as a primary learning environment, where each iteration provides insights into user interactions and system reliability. The rise of agent engineering is driven by the increasing capability of language models to perform sophisticated workflows, demanding a new approach to ensure these systems are trustworthy and effective in real-world applications.