How to get the face texture? about 3dmm-fitting-pytorch HOT 7 CLOSED

Please have a look at this line:

from 3dmm-fitting-pytorch.

@sunshinewhy those are some sample images. It has nothing to do with model training. All the code does is "given an image or a video, the code is trying to find a set of parameters to describe the reconstructed image or the video."

from 3dmm-fitting-pytorch.

Please have a look at this line:

3DMM-Fitting-Pytorch/fit_single_img.py

Line 118 in 8ca87fc

rendered_img = pred_dict['rendered_img']

I guess this is what you are looking for. It is basically the output from the renderer of Pytorch3D, which is a 4 channel image (the forth channel is a mask). So simply convert it into a uint8 array and save it to an image type.

Yes, you are right. You provide some images in data folder, and I want to know if I replace these images, should I retrain the model?

from 3dmm-fitting-pytorch.

@sunshinewhy those are some sample images. It has nothing to do with model training. All the code does is "given an image or a video, the code is trying to find a set of parameters to describe the reconstructed image or the video."

Nice, thanks a lot!

from 3dmm-fitting-pytorch.

I use one RTX3080 GPU to render the image, each image cost about 35s (including 4s no-rigid render and 33s rigid render), I want to reduce the time. I find you provide the hyperparameters in the file, could you tell me how to set them, I will be grateful.

from 3dmm-fitting-pytorch.

@sunshinewhy In the current version, I only use Adam as the optimizer to iteratively update variables, which might not be a fast way. To speed things up, one could replace the optimization method with some faster ones. I have not dug into it yet.

from 3dmm-fitting-pytorch.

@ascust Okay, I reset the hyperparameters, it will save the time, but the results not good, maybe I should try other methods.

from 3dmm-fitting-pytorch.