New in Arize AX: first-class sessions, Agent-as-a-Judge, and vision evals

Arize AX updates released between August 6 and September 18 center on making sessions, representing complete conversations across traces and spans, a first-class workflow object that users can annotate, filter, send to review queues, preview in evaluators, and query through Alyx. Alyx can now access and link to issues previously identified by Signal, avoiding repeated trace investigations, while the Agent-as-a-Judge evaluator is now available on all plans. The release also adds support for new Claude, OpenAI, Gemini, and Bedrock-hosted Mistral models; a beta Python SDK method for listing project traces; and broader media rendering and image-aware LLM judging for vision evaluations. Dataset creation from traces now retains every matching record and runs faster, alongside additions including traceable remote evaluator runs, editable managed-agent prompts, expanded charting requests through Alyx, OTLP project routing, CLI experiment creation, and various API, dashboard, SDK, and reliability improvements. The standalone Managed Agents page has been retired, with provider setup moved to the Integrations table and provider picker.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.