Giter Club home page Giter Club logo

Comments (3)

ygtxr1997 avatar ygtxr1997 commented on July 27, 2024 2
  1. The existing images under ./infer_images are not used for training our model. Our method doesn't need regularization images (although using regularization images like DreamBooth may generate better results?). Therefore, the 00_start_align.sh doesn't include any regularization images.
  2. It seems that you are using the following training setting in ./config/stable-diffusion/aigc_id.yaml:
data:
  params:
    train:
      target: ldm.data.face_id.FaceIdDatasetStyleGAN3

rather than:

... ...
      target: ldm.data.face_id.FaceIdDatasetOneShot

The FaceIdDatasetStyleGAN3 requires using StyleGAN3 generated faces and a pikle file listing the absolute path of each image, which is not provided yet.
We'll make this setting work, release the complete files, and modify the code and documentation ASAP!

from celebbasis.

mjdi avatar mjdi commented on July 27, 2024

Nvm, I got it working yay!!! No need to worry about the .pickle file for /infer_images or stylegan3 now! ^_^

I don't know exactly which of these changes I made fixed the issue, and I'm too laxy to check, but I guess these show what I did to get it to work. I had the right target in the .yaml file actually, and since FaceIdDatasetOneShot inherits from FaceIdDatasetStyleGAN3
face_id py_-CelebBasis-_Visual_Studio_Code_11_50_38
I still needed to adjust the latter child class.

I guess there is only one id because I'm just training myself?
wsl@MJDFW_~reposCelebBasis_12_21_02

But In the paper it's possible to train multiple people and have them appear separate/distinct in a generated photo (which most other AIGC methods can't do btw! so that's awesome)
Inserting_Anybody_in_Diffusion_Models_via_Celeb_Ba_12_26_39

Then, the other change I had to make was here I think? maybe not if the defaults are overwritten anyway, I'm not sure
face_id py_-CelebBasis-_Visual_Studio_Code_12_19_30

I just added some print statements so I could better understand the logical flow of the _load_from_pickle() method
face_id py_-CelebBasis-_Visual_Studio_Code_12_20_49

and here you can see the print statements in the output
wsl@MJDFW_~reposCelebBasis_12_19_00

from celebbasis.

ygtxr1997 avatar ygtxr1997 commented on July 27, 2024
  1. We add an example using StyleGAN3 synthetic faces, 71da8d9.
  2. If there is only one id, the specific ids should be [0] instead of [1]. In specific ids, 1 means the second ID, 12156a1.

from celebbasis.

Related Issues (19)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.