How We Built Paint.wtf, an AI Game with 150,000+ Submissions that Judges Your Art

Paint.wtf is an online game created by Roboflow and Booste, blending AI technology with user creativity, where players submit digital drawings based on quirky prompts like "Draw a giraffe in the arctic." Leveraging OpenAI's CLIP model, the game evaluates submissions by comparing the user-generated image with the AI's interpretation of the text prompt, using cosine similarity to assign scores. Initially, a set of prompts was manually created, after which GPT-2, a generative text model, was used to expand the list, ensuring a mix of creativity and humor. The game became an internet sensation, amassing over 150,000 submissions and attracting attention on platforms like Hackers News and Reddit. To address challenges such as potential misuse through typography attacks, a text penalty was implemented, and content moderation was enforced using CLIP's ability to identify inappropriate content. Paint.wtf serves as both a playful interaction with AI and a demonstration of CLIP's capabilities and limitations in interpreting digital illustrations.