Arabic TTS Arena: Ranking Voice Models the Way Chess Ranks Grandmasters
Blog post from HuggingFace
The Arabic TTS Arena is an innovative, community-driven platform designed to rank Arabic text-to-speech models using the Elo rating system, similar to chess grandmaster rankings, based on human preferences rather than predetermined benchmarks. This open platform allows users to input Arabic text, listen to anonymized outputs from two randomly selected models, and vote for the better one, thus contributing to a dynamic leaderboard. The process highlights the need for Arabic TTS models to focus on individual voice identities and natural language instructions over general dialect labels and emotion tags, aiming to improve the synthesis of voice identity, text content, and delivery style. The arena, hosted on Hugging Face Spaces, encourages contributions from developers and companies to enhance the diversity and quality of Arabic speech synthesis, fostering a more flexible and realistic evaluation method that adapts as models evolve.