What Is Autoresearch? The Open Source Project Running ML Experiments as you Sleep

Andrej Karpathy’s open-source autoresearch project automates much of the machine-learning experimentation cycle by allowing an AI agent to repeatedly modify a single training file, run fixed five-minute language-model experiments, evaluate validation bits per byte, and retain or discard changes based on results. The repository separates fixed data preparation utilities from the editable model and training code, while a Markdown instruction file lets users guide the agent’s research direction over time. By standardizing experiment duration, the system makes results comparable on a given hardware setup and targets the best model achievable within a specific compute budget, enabling roughly 100 experiments during an overnight run. The project has gained thousands of forks and community support for varied hardware, including Macs, Windows systems, AMD GPUs, and CPU-only configurations. The accompanying Lightning Studios promotion presents on-demand NVIDIA GPU infrastructure and collaboration features as a way for individuals and enterprise teams to run autoresearch without managing hardware, emphasizing that the tool aims to reduce delays in human review cycles rather than replace researchers.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.