OpenRouter Leaderboard: 425 Models by Price, Measured Speed and Korean Quality
Blog post from Hugging Face
GiniGEN AI has launched a daily refreshed OpenRouter leaderboard covering 425 models across pricing, providers, context length, measured response speed, and Korean-language quality, with data available in English, Korean, and Chinese through an open API. The project evaluates 330 models on seven Korean-specific axes, including register, honorifics, institutional knowledge, terminology, format compliance, summary accuracy, and freedom from translation-like phrasing, finding that only small shares achieve top marks for honorifics or knowledge of Korean institutions while roughly one-third fail overall. It argues that model quality, value, and speed are usually led by different models, making single-column rankings insufficient, and notes that release date, model size, and English benchmarks do not reliably predict Korean performance. Speed tests for 329 models use controlled API calls to measure first-token latency and throughput alongside OpenRouter’s aggregate traffic metrics, while grading controls include blinded judges, fixed known-answer tests, and programmatic character checks. The leaderboard also identifies provider locations and data-center information for enterprise procurement, supports comparison and filtering by use case, and invites feedback on its grading methodology.
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.