Automate pattern discovery with Topics, now generally available
Blog post from Braintrust
AI observability is enhanced by Braintrust's new tool, Topics, which is designed to continuously analyze and classify production traces into actionable insights, aiding in the identification of unexpected patterns or failure modes that are difficult to detect manually. By utilizing embedding-based clustering and LLM-assisted labeling, Topics provides dynamic, human-readable classifications that feed into existing evaluation and scoring systems, allowing organizations to act on new findings effectively. These classifications, covering tasks, issues, and sentiment, allow teams to monitor user interactions and system behaviors in real-time, ensuring timely responses to emerging trends or problems. The tool supports custom dimensions, enabling businesses to tailor the analysis to specific needs such as customer segments or compliance categories, and offers integration with CI workflows to automate the process from detection to code deployment. Topics is available across all Braintrust plans, providing a scalable solution for AI teams to discover and address hidden patterns in their data efficiently.