Instructions to use InstantX/SD3-Controlnet-Pose with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use InstantX/SD3-Controlnet-Pose with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("InstantX/SD3-Controlnet-Pose", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Compatibility with DW Pose
#5
by spandit - opened
This works nicely with Openpose, including hands and face. But generates garbage for DWPose.
Following are reference images, with openpose detection and dwpose detection for each.
As you can see the DW Pose has much more details. Would love if this worked with DW Pose images.





