AI Energy Score v2: Refreshed Leaderboard, now with Reasoning 🧠

AI Energy Score v2 introduces a refreshed leaderboard that now includes reasoning as a newly benchmarked task for AI models, emphasizing the growing importance of measuring energy efficiency in AI development. The project aims to standardize energy benchmarks, providing a unified framework for comparing the energy use of AI models across various tasks and modalities. The recent update highlights the significant energy costs associated with reasoning models, which use substantially more energy than their non-reasoning counterparts, and underscores the importance of selecting efficient models for specific tasks. Despite mixed results regarding the energy efficiency of newer models, the project underscores the need for standardized benchmarks to guide sustainable AI development. Notably, Salesforce has integrated the AI Energy Score into its processes, showcasing the practical adoption of these benchmarks. Looking ahead, the project plans to include more complex modalities and tasks, with an emphasis on transparency and collaboration to mitigate AI's environmental impact.