August 2026 Summaries

Red team campaigns identify risks at specific points in time, but changes to various components can cause previously resolved vulnerabilities to reappear, necessitating a permanent record for each risk. Tools like Garak and PyRIT facilitate the discovery of adversarial behaviors, with Garak focusing on broad vulnerability scans and PyRIT enabling custom multi-turn attacks. These tools are part of a larger framework that includes Braintrust, which serves as a repository for confirmed risks and supports ongoing evaluations. Braintrust stores detailed records of each confirmed risk, including adversarial inputs, expected safe behaviors, and metadata, allowing for structured regression testing and continuous evaluation through CI/CD processes. Production logs can contribute new cases, and Braintrust helps maintain a versioned dataset, ensuring that confirmed risks are continuously tested and managed throughout the development and release process.

LLM provider lock-in involves dependencies that complicate switching providers, which can stem from code, behavioral, and data coupling. Code coupling, related to provider-specific SDKs and code changes, can be mitigated by gateways like the Braintrust AI Gateway, which standardizes request formats across multiple providers. Behavioral coupling arises from prompts tailored to specific models, leading to different outputs with a new model, necessitating thorough evaluation to ensure quality requirements are met. Data coupling involves reliance on provider-specific logs and evaluation history, which may hinder migration unless data is exportable and reusable with new providers. Solutions like Braintrust store data separately from model configurations, allowing cross-provider evaluation without rebuilding test cases. When switching providers, it's crucial to validate the candidate model through experiments and evaluations to ensure it meets the application's quality standards, using tools like Braintrust and OpenRouter to streamline the process and reduce engineering effort.

Explainability in AI systems varies between model-level and application-level, especially in Large Language Model (LLM) applications, where understanding the entire AI application's behavior is crucial. Application-level explainability involves tracing the execution path, encompassing factors like context retrieval, tool selection, and memory, to identify errors, with tools like Arize Phoenix and Braintrust facilitating this through trace-based evaluations. In contrast, model-level explainability for tabular and vision models focuses on feature attribution methods like SHAP and LIME, which estimate how inputs influence predictions. Token-level attribution in LLMs falls short as it measures influence within a single model call, missing errors originating in earlier application steps. Braintrust emerges as a powerful tool for LLM explainability, linking trace steps with evaluation scores to create a feedback loop for ongoing improvement, while Arize Phoenix offers an open-source alternative. For classical machine learning models, feature attribution remains central, with tools like SHAP, LIME, Fiddler AI, and Captum offering various capabilities for different model types and deployment needs. The choice of explainability tool depends on the specific requirements of understanding either feature contributions or application traces.

Choosing the right LLM red teaming tool depends on the specific lifecycle improvements a team needs, whether it's generating attacks, evaluating immediate responses, or managing ongoing evaluation and release processes. Tools like Garak, Braintrust, Promptfoo, PyRIT, DeepTeam, and Mindgard each offer unique strengths, such as flexible open-source scanning, comprehensive known-risk evaluation, configuration-first workflows, custom multi-turn campaigns, ecosystem integration, and managed security services. Garak excels in attack discovery with its broad probe library, while Braintrust focuses on maintaining confirmed attacks as versioned evaluations. Promptfoo offers a command-line tool that covers both scanning and evaluation, and PyRIT provides adaptive attack strategies for complex scenarios. DeepTeam integrates with DeepEval for seamless adoption within existing ecosystems, and Mindgard offers a managed platform for automated AI security testing. Teams can benefit from combining tools to leverage their strengths across different stages of the security testing process, ensuring comprehensive coverage and maintaining a cohesive evaluation workflow.

AI agent memory tools enhance the capability of language models by providing persistent recall across sessions, thereby allowing agents to remember preferences, project details, and decisions beyond the active context window. These tools store extracted facts in a separate memory layer and retrieve relevant information when new requests rely on previous context. Several tools, such as Mem0, Zep, Letta, Supermemory, Cognee, and Sentra, offer various approaches to managing memory, including semantic retrieval, temporal knowledge graphs, and agent-managed memory blocks. Each tool has distinct features tailored to specific use cases, such as personalization, support workflows, or organizational knowledge sharing. Integrating these tools can transform how agents handle long-term memory, but the effectiveness of memory enhancements should be evaluated through comparison tests that assess continuity, error reduction, and task completion across sessions.