OpenRA-RL: An Open Platform for AI Agents in Real-Time Strategy Games

OpenRA-RL is an open-source platform designed to facilitate the interaction of large language models (LLMs) with the real-time strategy game Red Alert, leveraging a modified OpenRA engine and a Python wrapper to provide an environment compatible with various training frameworks like TRL, torchforge, and Unsloth. Unlike traditional AI approaches that rely on bespoke architectures and imitation learning, this platform allows LLMs to engage with the game using high-level semantic actions through tool calls, addressing the need for asynchronous interaction and tolerance for variable inference latency. The platform supports 64 concurrent sessions in a single .NET process, significantly reducing memory and latency overheads, and employs an innovative architecture to ensure agents can operate with long inference times without disrupting game flow. OpenRA-RL enables researchers to explore the strategic capabilities of LLMs in a real-time strategy context by providing a structured, multi-dimensional reward system that highlights specific areas for improvement, such as economy management and combat. The platform's design as an OpenEnv environment ensures broad interoperability, allowing seamless integration into existing reinforcement learning ecosystems and encouraging community-driven advancements in AI agent development for complex, long-horizon tasks.