Home / Companies / Perplexity / Blog / Post Details
Content Deep Dive

Evaluating Deep Research performance in the wild with the DRACO benchmark

Blog post from Perplexity

Post Details
Company
Date Published
Author
Perplexity Research
Word Count
1,001
Company Posts That Month
7
Language
English
Hacker News Points
-
Post removed?
No
Summary

Perplexity has released DRACO, an open-source benchmark for evaluating deep research agents on authentic, production-derived research tasks rather than narrow synthetic questions. Built from millions of user requests and refined through privacy filtering, contextualization, difficulty screening, and expert review, DRACO contains 100 tasks across ten domains, each assessed with detailed rubrics covering factual accuracy, analytical breadth and depth, presentation, and primary-source citation. The benchmark uses weighted binary criteria, including penalties for hallucinations and unsupported claims, and employs LLM judges whose relative system rankings were validated across multiple models. In Perplexity’s evaluation of four research systems with browser and code-execution tools, its Deep Research product achieved the highest pass rates in every domain, particularly Law and Academic research, led in accuracy, analysis, and citation quality, and recorded the lowest latency. Perplexity says DRACO, its rubrics, judge prompt, and dataset are publicly available, while future versions are intended to support more languages, multi-turn interactions, and additional domains.

Trends Found in this Post
Trend Post Mentions Total Month Mentions Posts Companies MoM
LLM 5 6,226 1,022 249 +27%
Use This Data

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.