Getting the Source Right, Not Just the Fact: Source-Aware Verification for MCP Agents

ProvenanceGuard is a post-generation verification system for Model Context Protocol-based LLM agents that addresses cross-source conflation, where a statement may be factually supported somewhere in an agent’s collected tool outputs but incorrectly attributed to a different source. Unlike conventional faithfulness checkers that pool evidence, it preserves source identities through claim decomposition, source routing, entailment checking, attribution verification, and an allow-or-block decision, with optional source-grounded repair or safe fallback responses. Evaluated on 281 medical-agent traces and 361 expert-reviewed claims, the system reportedly caught 138 of 139 claims that should have been blocked, although it also held 67 supported claims for review, reflecting a deliberately conservative policy. It achieved a 0.802 block-decision F1 score against several source-blind baselines and selected the correct identifiable source about 86% of the time, while a more difficult similar-source test reduced exact source identification to 50.3%. The approach has also been adapted for NVIDIA’s NVFlow finance agent and is intended for settings where accurate provenance, sensitive data handling, and auditable claim-to-source links are important.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.