Don’t Take Our Word for It: CData Labs at Foundations 2026
Blog post from CData
CData promotes its Foundations 2026 event on November 5, where it will examine how AI models perform on live enterprise data rather than relying solely on public leaderboards. The company argues that benchmark rankings can be distorted by training-data leakage and broad average scores that do not reflect business-specific, agentic tasks or access to enterprise systems. Its open CData Labs program publishes reproducible benchmark harnesses, runners, and raw results for testing models and MCP implementations through CData Connect AI, focusing on accuracy, token efficiency, and behavior under different gateway configurations. Previously published results reported 98.5% accuracy for Connect AI on enterprise questions, compared with 65% to 75% for other MCP implementations, and found that configured context and guardrails reduced token use from 183,000 to 4,500 tokens for one query. A forthcoming session led by Jerod Johnson and Amit Naik will discuss tests of 22 models across live CRM, warehouse, and ITSM data, including costs, write-task safety, token sources, routing, and criteria for selecting models once accuracy and safety are standardized.
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.