Red Teaming Agentic Capabilities in NVIDIA NeMo Agent Toolkit

Lakera has integrated red teaming capabilities into the NVIDIA NeMo Agent Toolkit to enhance the evaluation of agentic systems' safety and security at the workflow level. This addition aims to identify vulnerabilities that may not be apparent through model-level checks alone by focusing on potential failure points such as user prompts, tool calls, and multi-agent handoffs. The red teaming process involves injecting adversarial conditions into the system to test its resilience, producing structured findings and normalized risk scores that highlight how risks propagate through an agent's workflow. The toolkit provides an open-source example, the Retail Agent, which demonstrates how systematic red teaming can be incorporated into development processes to improve system-level safety and security. By evaluating agents across multiple workflow boundaries and using normalized scoring, developers can identify, mitigate, and track vulnerabilities effectively, ensuring more robust AI systems ready for real-world conditions.