How Arena Collaborated with E2B to Build LLM Web Development Evals

UC Berkeley’s Arena research team created WebDev Arena, a free open-source platform where large language models compete to build web applications and users vote on their results, producing a public leaderboard. Evaluating such models requires secure, fast, simultaneous execution of potentially complex generated code, while preventing interference or system access between competing models. To address these requirements, Arena integrated E2B in November 2024, using isolated virtual-machine sandboxes that start in roughly 150 milliseconds and support diverse frameworks, dependencies, and models including Claude, GPT-4, Gemini, DeepSeek, and Qwen. The implementation supports configurable sandbox creation, dynamic package installation, real-time dependency logs, and separate modes for code interpretation and web-app deployment. Arena reported that more than 50,000 users launched over 230,000 sandboxes, while WebDev Arena has completed over 50,000 model comparisons, with Claude 3.5 Sonnet leading the leaderboard ahead of DeepSeek-R1; future plans include adding models and expanding into broader software-engineering and general-purpose coding evaluations.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.