Replicate Intelligence #6

Replicate's weekly bulletin, authored by deepfates, provides insights into the latest developments in open-source AI models, tools, and research, highlighting new language models like Google's Gemma2, which are notable for their overtraining on tokens and use of alternating global/local attention layers. Huggingface has updated its leaderboard for language models, featuring harder evaluations to test high-quality skills, with Qwen 72b leading the rankings. The bulletin also discusses optimization techniques for AI inference used by Character.AI, which handles 20,000 inference queries per second using hybrid attention and stateful caching. Additionally, it offers guidance on obtaining optimal results from Stable Diffusion 3, focusing on selecting the right version, crafting quality prompts, and configuring appropriate settings.