Home / Companies / Hugging Face / Blog / Post Details
Content Deep Dive

OpenRouter Leaderboard: 425 Models by Price, Measured Speed and Korean Quality

Blog post from Hugging Face

Post Details
Company
Date Published
Author
ginigen-ai
Word Count
1,360
Company Posts That Month
39
Language
-
Hacker News Points
-
Post removed?
No
Summary

GiniGEN AI has launched a daily refreshed OpenRouter leaderboard covering 425 models across pricing, providers, context length, measured response speed, and Korean-language quality, with data available in English, Korean, and Chinese through an open API. The project evaluates 330 models on seven Korean-specific axes, including register, honorifics, institutional knowledge, terminology, format compliance, summary accuracy, and freedom from translation-like phrasing, finding that only small shares achieve top marks for honorifics or knowledge of Korean institutions while roughly one-third fail overall. It argues that model quality, value, and speed are usually led by different models, making single-column rankings insufficient, and notes that release date, model size, and English benchmarks do not reliably predict Korean performance. Speed tests for 329 models use controlled API calls to measure first-token latency and throughput alongside OpenRouter’s aggregate traffic metrics, while grading controls include blinded judges, fixed known-answer tests, and programmatic character checks. The leaderboard also identifies provider locations and data-center information for enterprise procurement, supports comparison and filtering by use case, and invites feedback on its grading methodology.

Trends Found in this Post
Trend Post Mentions Total Month Mentions Posts Companies MoM
LLM 3 747 162 79 -85%
Real-time 1 649 155 80 -85%
Use This Data

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.