A Deep Neural Network that turns Any Image into a Playable Game! All on consumer GPUs, NOT DATACENTER

Abhishek Sensharma introduces a deep neural network model called Supercut, developed at lucidml, which can transform any image into a playable game in real-time on consumer GPUs, specifically using an RTX 5090 machine. The model, based on the 420M image DiT model from lucidml, incorporates temporal mixing modules and is trained with video and gameplay data to simulate interactive worlds without relying on images from its training dataset. The project operates under a modest compute budget compared to frontier labs, and the current version represents only a fraction of its potential, with an upcoming 800M model expected to enhance motion quality and diversity. The video accompanying the project showcases real play sessions and highlights the innovative use of consumer-level hardware for complex neural network tasks, marking a significant step in generative gaming and world modeling.