A Blender addon for using Stable Diffusion to render texture bakes for objects.
It will retain your existing UV coords and bake the result to them.
Supports both Automatic1111 and ComfyUI backends
Limitations: The intermediate object has its uv's projected from the view. So even though the result will be mapped 'around' the object, it won't render what isn't seen. Only one object at a time (for now)
Example video: https://youtu.be/_VmOCM1rY7g
Why use this method?
- Control. This is probably even quicker than sketching in a 2D program
- Post processing. Use your textured objects as part of a scene, animate them, light them, put them in a stew.
Is this cheating?
Maybe. And if so, it's a good thing. Some inspiration:
Ian Hubert on World Building in Blender: https://youtu.be/whPWKecazgM
Steps:
-
Download the 'sd_render' folder and install it as an addon.
-
Add a material to your object
-
Unwrap the UV map.
-
Set up a viewer node and render depth. Save result
-
Adjust the camera to maximize rendered area and for optimal projection (No longer needs to align with viewport)
-
Select object and hit "Render" in the "Stable Diffusion Render" panel in the "Render" tab
Switching backend: This happens in the addon preferences
After switching, you need to restart for the configuration properties to update