AX-Ray, Finding Causal-Leakage Defects in Two General-Purpose Public Models

VIDRAFT’s AX-Ray, powered by FINAL-Bench Diagnostics, is presented as a deployment-focused AI safety evaluation framework that supplements conventional capability benchmarks by examining causal correctness, serving consistency, robustness, security, data integrity, compliance, and agentic risks. The project reports reproducible causal-leakage findings in Zyphra/Zamba2-1.2B and nvidia/Nemotron-H-8B-Base-8K, describing such leakage—where future tokens affect representations or outputs at earlier positions—as a structural, deployment-blocking defect that ordinary answer-based benchmarks may miss. AX-Ray organizes its assessment across MODEL-SCAN, AX-SCAN, and AGENT-SCAN, with 117 public diagnostic records covering topics from cache behavior, hallucination, long-context robustness, jailbreaks, privacy, quantization, and internal model structure to serving infrastructure, cybersecurity, regulation, and autonomous-agent controls. It distinguishes confirmed model-level leakage from API or serving anomalies, citing an FP8 vLLM audit of Solar-Open2-250B as an unresolved prompt-logprob issue pending white-box testing rather than proof of leakage. The framework maps technical findings to governance contexts in several regions while limiting disclosure of proprietary probes and sensitive exploit details, arguing that trustworthy deployment requires safety diagnostics alongside performance scores.

No tracked trend matches for this post yet.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.