If it Wanted to, it Would: The Bitter Lesson for LLM Users

The text explores the evolving relationship between human interaction and artificial intelligence (AI), emphasizing the importance of aligning with AI's natural capabilities rather than imposing rigid constraints. It revisits Rich Sutton's "bitter lesson," which highlights that scalable AI progress emerges from algorithms that learn through exploration rather than predefined knowledge frameworks. This principle is extended by Boris Cherny, who advises designing for future AI capabilities to leverage increasing computational power. The text suggests that users should allow AI to explore ideas broadly to unlock its full potential, rather than over-constraining it with specific instructions, and highlights examples where AI has surpassed human-designed algorithms through self-guided learning. It concludes by advocating for a forward-thinking approach in AI development, where systems are designed to evolve and improve alongside advancing AI models, focusing on exploration to drive discovery and innovation.