Home / Companies / RunPod / Blog / Post Details
Content Deep Dive

Using OpenPose to Annotate Poses Within Stable Diffusion

Blog post from RunPod

Post Details
Company
Date Published
Author
Brendan McKeag
Word Count
567
Language
English
Hacker News Points
-
Summary

Describing complex poses in text prompts for Stable Diffusion can be challenging, but OpenPose offers a solution by providing a way to annotate poses that the system can understand. To set it up in a new Runpod instance, users need to install the "3D Openpose" plugin from the Extensions tab, ensuring that ControlNet is also installed. Once set up, a 3D OpenPose tab is available, offering an editor to control the subject's pose, though it can be finicky with limb movement. For simpler edits, online 3D posers like posemy.art might be preferable, with pre-made poses that can be imported. Users can upload an image of the desired pose, which the editor will extrapolate to generate a result; optimal results are achieved with poses at a 3/4th angle. After setting parameters like Control Model number and enabling ControlNet, Stable Diffusion uses the level of zoom in the pose, with the default weight ensuring accurate pose adherence. Adjustments to weight can balance between matching the input and avoiding artifacts, and the system allows for creative experimentation with detailed prompts and community support available on Discord for further guidance.