Giter Club home page Giter Club logo

Comments (8)

comfyanonymous avatar comfyanonymous commented on May 24, 2024

Can I see your workflow?

from comfyui.

AbyszOne avatar AbyszOne commented on May 24, 2024

Can I see your workflow?

I copied it verbatim from img2img example, with only yaml and euler A changes. I checked few times, but there is nothing different. https://comfyanonymous.github.io/ComfyUI_examples/img2img/
I got the cuda error and then fixed it as is explained. Not much less. Thats my first try. This is denoising 0.1:
ComfyUI_00007_

from comfyui.

comfyanonymous avatar comfyanonymous commented on May 24, 2024

I got your workflow from the images you posted. The issue is that your ProtoGen_X3.4 does not contain any CLIP model weights.

Use another checkpoint or you can download the SD1.5 CLIP model weights from here: https://huggingface.co/runwayml/stable-diffusion-v1-5/blob/main/text_encoder/model.safetensors

Put them in the models/clip folder and use the CLIPLoader node to load them and connect it to your CLIPTextEncode nodes. Then it should work.

from comfyui.

AbyszOne avatar AbyszOne commented on May 24, 2024

Thank you. I'll try it later. My interest is to be able to experiment with multiple controlnets, that fulfill specific functions. As well as the possibility of using multiple img2img. I don't know if it's possible, but your gui seems flexible enough to try. When there is a native batch I will surely experiment with it.

from comfyui.

comfyanonymous avatar comfyanonymous commented on May 24, 2024

Yes you can use multiple controlnets and run as many img2img passes as you want with different settings/models.

from comfyui.

AbyszOne avatar AbyszOne commented on May 24, 2024

It got better with your advice.
Regarding multiple simultaneous img2img, I have not found the mechanics. My interest is to achieve the same thing as controlnet + img2img, where one influences the other during the same inference. Maybe it would be useful to know how to achieve that first, since it's a process that actually works in the gui.

from comfyui.

comfyanonymous avatar comfyanonymous commented on May 24, 2024

Take the controlnet example here: https://comfyanonymous.github.io/ComfyUI_examples/controlnet/

And instead of feeding the sampler an EmptyLatentImage feed it an image like in this example: https://comfyanonymous.github.io/ComfyUI_examples/img2img/

Is this what you want to do?

from comfyui.

AbyszOne avatar AbyszOne commented on May 24, 2024

I think that's the mechanics. I confirm it later. Now I was trying a way of "almost" double img2img, and got an image of what I wanted while respecting the light and color composition of the other. i`ll keep trying.

from comfyui.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.