Run Stable Diffusion 3 on your Apple Silicon Mac

Stable Diffusion 3 (SD3) is the latest iteration of the open-source artificial intelligence model that converts text into images, and it can be run locally on Apple Silicon Macs. Users can start by cloning the SD3 repository and setting up a Python virtual environment to install necessary packages, allowing them to generate images with various customizable settings, such as seed, prompt, image dimensions, and inference steps. An alternative method using DiffusionKit, a command-line interface tool, simplifies the process by eliminating the need for manual environment setup and repository cloning, while offering memory-efficient options like running the model in float16. Speed comparisons show that generating a 512x512 image with 28 steps on an M3 Max MacBook Pro takes approximately 14.14 seconds using the Torch MPS backend and 16.73 seconds with DiffusionKit. The blog encourages experimentation with different settings to create varied images and invites users to share their creations within the community.