Comments (3)
I think this is because it's loading the actual transformer/unet when it reaches the ksampler. When it first looks like it's loading the checkpoint, it's probably just loading the t5 or clips for the prompt, depending on what model you're working with. Once it reaches the ksampler, if you have your task manager open, you'll see that your disk usage will indicate it's loading something.
I noticed this messing around with flux. Probably makes memory management much easier for bigger models, like ones that use t5 which takes up a lot of memory. That way, it can load the text encoders, do the encoding and then offload the models or purge them to make room for the model. I think there was also a PR that allows encoders to load directly to the vram now too, saving a potential copy step as well.
from comfyui.
Should be fixed now.
from comfyui.
I can confirm that this has been fixed in the latest commits, as I can no longer reproduce the issue.
got prompt
loaded completely 5201.311734390259 4897.0483474731445
100%|██████████████████████████████████████████████████████████████████████████████████| 30/30 [00:16<00:00, 1.77it/s]
Prompt executed in 20.28 seconds
got prompt
loaded completely 5201.273587417602 4897.0483474731445
100%|██████████████████████████████████████████████████████████████████████████████████| 30/30 [00:17<00:00, 1.76it/s]
Prompt executed in 20.22 seconds
got prompt
loaded completely 5229.418118667602 4897.0483474731445
100%|██████████████████████████████████████████████████████████████████████████████████| 30/30 [00:17<00:00, 1.75it/s]
Prompt executed in 20.32 seconds
With a bonus that the total execution time is now 3-4 seconds faster. Thanks for all your incredible work.
from comfyui.
Related Issues (20)
- Please provide an alternative to the old version of the search function. The new version of the front-end search function is very uncomfortable. HOT 1
- On ComfyUI Revision: 2546 [bfc214f4] the spell checker not function HOT 4
- After the latest updates, Flux UNET does not unload, when switching fp8/fp16 modes. HOT 2
- name 'calc_cond_batch_original_tiled_diffusion_157b0460' is not defined HOT 2
- Major issue with UI for mobile/touchscreen devices HOT 1
- History-list is missing HOT 4
- Menu moves offscreen when switching apps HOT 1
- animatediff Promotion for Float8 Types is not supported, attempted to promote Float and Float8_e5m2
- Crash on image generation HOT 2
- Flux LoKr - lora keys not loaded HOT 2
- Installing requirements FAILED
- ControlNet Issue HOT 1
- Can multi workflows share same lora or basemodel in comfyui workflows? HOT 1
- High Memory Usage When Loading Flux Model in ComfyUI HOT 32
- Flux Xlabs ControlNet does not work in Flux UNET
- After switching and executing multiple workflows through the API, LoRA becomes ineffective. All models are version 1.5.
- empty tab at launch with newest commit HOT 1
- GGUF, bnb_NF4 merges HOT 1
- Adding FLUX.1-dev-gguf files in the model manager HOT 1
- Flux crashed mac terminal 16G memory M2.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from comfyui.