Home / Companies / Vectara / Blog / Post Details
Content Deep Dive

Learning to Measure AI Search with Vectara

Blog post from Vectara

Post Details
Company
Date Published
Author
Charlie Hull & Matthias Krueger
Word Count
1,441
Company Posts That Month
8
Language
English
Hacker News Points
-
Post removed?
No
Summary

We evaluated the performance of Vectara's new AI-powered search engine, Boomerang, against a popular question/answering model, USE-QA. We tested Boomerang on five datasets for different applications, including e-commerce search and scientific search, and found that it provided superior performance in four of the five datasets. The evaluation also highlighted areas where cross-language information retrieval could be improved. We suggested integrating Quepid with Vectara to test and tune its engine further, which is now live on www.quepid.com. Additionally, we provided feedback on available features and suggested upgrades, such as an "upsert" capability and more useful metadata filters. The Vectara team is using our results to improve Boomerang, demonstrating their commitment to testing and evaluation.

Trends Found in this Post
Trend Post Mentions Total Month Mentions Posts Companies MoM
RAG 2 802 110 43 +64%
Vector Search 1 1,771 223 96 +12%
Use This Data

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.