The test result is wrong about ganimation HOT 13 CLOSED

It seems that your batch size is kind of too large, basically you'll expect to get results with better quality when training with a smaller batch size in the generative model.
Or it can be possibly caused by some error in extracting the AU feature, which is a very important condition in this network architecture.

I train this model with CelebA and the batch size is set to 25. some of my testing results are listed as follows,




Here, I try to change expression of the left most person to the right most one's. I interpolate it continuously by using the method mentioned in Section 6.2 of the original paper.

But, please note that the above shown results are cherry picked by me. There are also lots of failure results, even more than good results. Also I list some of them as follows,

I'm not sure it is because of my training data set or whatever. Or the quality of generated images are inherently unstable, just as lots of other GAN based model have shown.

from ganimation.

GANs are still unstable, but you can can still improve your results by training longer/more data/better data. Also, you may be able to further improve the results playing with the hyperparameters.

from ganimation.

@chenyvehtung Hi, Yuedong Chen. Can you package your data set , the processed AU, as well as the code and send me a copy ? I compare what went wrong.

from ganimation.

@albertpumarola Hi, albertpumarola. Can you send me a copy for your data set and processed AU ,I feel my processed AU is error.

from ganimation.

@shliang0603 I have the same issue, did you overcome it? as a result I just get similar images...

from ganimation.

@chenyvehtung What kind of image are you using in your training? I use the aligned one and find their size is fixed at 178 × 218，so in order to change them to 128*128, I add a centercrop and resize(128) into the transform in dataloader, but the training result is not good as expected. Could you tell me how to preprocess the dataset? Thanks.

from ganimation.

@chenyvehtung hello, the output images of openface is *.bmp on my cumputer. Did you get the *.bmp images too? That makes me "An ignorant face"........

from ganimation.

@shliang0603 How do you visualize it?There are no web link tutorials？thank

from ganimation.

@yangzhikai
3. should be visualized by test.py; 5 should be visualized by tensorboard, under the image tab. There are plenty of tutorials on tensorboard you can look up.

Others seems to be visualized by custom code. It can be done with pytorch and some plotting library like matplotlib.

from ganimation.

@donydchen Hello, I use the same dataset as you,but the results seem to be bad. The output is almost the same as the input. I don't know what went wrong.
Have you modified the parameters of the network? If so, would you like to share your params? Thaks a lot!

from ganimation.

@donydchen Hello, I use the same dataset as you,but the results seem to be bad. The output is almost the same as the input. I don't know what went wrong.
Have you modified the parameters of the network? If so, would you like to share your params? Thaks a lot!

Sorry for the late reply. Actually I don't use the codes provided by this project. Instead, I replicate GANimation from scratch using the information illustrated in the original paper.
You can checkout https://github.com/donydchen/ganimation_replicate if you are interested.
I also provide my preprocessed CelebA dataset and pretrained model. Hope it help.

from ganimation.

@shliang0603 Have you solved this issue? I encountered the same issue with the implementation by @donydchen.

from ganimation.

@joyyang1997 Me too. Have you fixed that? I have tested the pretrained model provided by @donydchen, and it was pretty good. However, when I retrain the model with the provided codes, the results are bad. Any suggestions?

from ganimation.