How to try demo with my own dataset? about disco HOT 4 CLOSED

Hi @wnzhyee , it's a bit weird. Could you please check if it is because the rgb format? The color should affect the results as the pose info is injected through the image. It would be better if you could keep the pose color consistent to the demo.

from disco.

@Wangt-CN I changed the rgb format and result is correct, thanks a lot!

from disco.

Hi @wnzhyee ,

1. Could you please check if there is the .json output for the openpose pre-process? Then you may refer to this code for achieving the pose image (https://github.com/Wangt-CN/DisCo/blob/main/dataset/tiktok_controlnet_t2i_imagevar_combine_mask.py#L218).
2. Yes, you need to crop and resize.

BTW, current model may get inferior results if the person is too small (issue from the original SD). And we will update a new model soon if you wanna to perform body change for the full human body.

from disco.

thanks for your reply! I'm still a little confused about the pose image generation. Now i try the demo image 00035.png with pose image, and i draw the skeleton with coco2openpose and draw_bodypose from tiktok_controlnet_t2i_imagevar_combine_mask.py, but the skeleton colors are not exactly same. Is this ok for pose encoder if the color order changed?

MINE(create with demo_data/bg/images/00035.png):

（demo_data/pose_img/0144.png）

from disco.