Comments (4)
Can you try the latest and see if I fixed it?
from comfyui.
It works, only on the first generation. The first image goes off without a hitch, but every subsequent generation produces an error.
salt@saltPC /mnt/2TBDa/SDSoftware/comfyfork/ComfyUI$] > python main.py --lowvram
Set vram state to: LOW VRAM
Using sub quadratic optimization for cross attention, if you have memory or speed issues try using: --use-split-cross-attention
No module 'xformers'. Proceeding without it.
Starting server
To see the GUI go to: http://127.0.0.1:8188
got prompt
making attention of type 'vanilla' with 512 in_channels
Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
making attention of type 'vanilla' with 512 in_channels
Loading model from /mnt/2TBDa/SDSoftware/comfyfork/ComfyUI/models/checkpoints/SDModels/AbyssOrangeMix2_hard.safetensors
LatentDiffusion: Running in eps-prediction mode
DiffusionWrapper has 859.52 M params.
100%|███████████████████████████████████████████████████████████████████████████| 1/1 [00:02<00:00, 2.20s/it]
got prompt
deleted 3
deleted 8
deleted 9
0%| | 0/1 [00:00<?, ?it/s]
Traceback (most recent call last):
File "/mnt/2TBDa/SDSoftware/comfyfork/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 152, in _get_attention_scores_no_kv_chunking
attn_probs = attn_scores.softmax(dim=-1)
RuntimeError: CUDA out of memory. Tried to allocate 512.00 MiB (GPU 0; 2.94 GiB total capacity; 1.38 GiB already allocated; 496.56 MiB free; 1.89 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/mnt/2TBDa/SDSoftware/comfyfork/ComfyUI/main.py", line 178, in execute
executed += recursive_execute(prompt, self.outputs, x, extra_data)
File "/mnt/2TBDa/SDSoftware/comfyfork/ComfyUI/main.py", line 71, in recursive_execute
executed += recursive_execute(prompt, outputs, input_unique_id, extra_data)
File "/mnt/2TBDa/SDSoftware/comfyfork/ComfyUI/main.py", line 71, in recursive_execute
executed += recursive_execute(prompt, outputs, input_unique_id, extra_data)
File "/mnt/2TBDa/SDSoftware/comfyfork/ComfyUI/main.py", line 76, in recursive_execute
outputs[unique_id] = getattr(obj, obj.FUNCTION)(**input_data_all)
File "/mnt/2TBDa/SDSoftware/comfyfork/ComfyUI/nodes.py", line 426, in sample
return common_ksampler(self.device, model, seed, steps, cfg, sampler_name, scheduler, positive, negative, latent_image, denoise=denoise)
File "/mnt/2TBDa/SDSoftware/comfyfork/ComfyUI/nodes.py", line 396, in common_ksampler
samples = sampler.sample(noise, positive_copy, negative_copy, cfg=cfg, latent_image=latent_image, start_step=start_step, last_step=last_step, force_full_denoise=force_full_denoise)
File "/mnt/2TBDa/SDSoftware/comfyfork/ComfyUI/comfy/samplers.py", line 282, in sample
samples = getattr(k_diffusion_sampling, self.sampler)(self.model_k, noise, sigmas, extra_args={"cond":positive, "uncond":negative, "cond_scale": cfg})
File "/home/salt/.local/lib/python3.10/site-packages/torch/autograd/grad_mode.py", line 27, in decorate_context
return func(*args, **kwargs)
File "/mnt/2TBDa/SDSoftware/comfyfork/ComfyUI/comfy/k_diffusion/sampling.py", line 128, in sample_euler
denoised = model(x, sigma_hat * s_in, **extra_args)
File "/home/salt/.local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
return forward_call(*input, **kwargs)
File "/mnt/2TBDa/SDSoftware/comfyfork/ComfyUI/comfy/samplers.py", line 144, in forward
cond, uncond = calc_cond_uncond_batch(cond, uncond, x, sigma, max_total_area)
File "/mnt/2TBDa/SDSoftware/comfyfork/ComfyUI/comfy/samplers.py", line 123, in calc_cond_uncond_batch
output = self.inner_model(input_x, sigma_, cond=c).chunk(batch_chunks)
File "/home/salt/.local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
return forward_call(*input, **kwargs)
File "/mnt/2TBDa/SDSoftware/comfyfork/ComfyUI/comfy/k_diffusion/external.py", line 114, in forward
eps = self.get_eps(input * c_in, self.sigma_to_t(sigma), **kwargs)
File "/mnt/2TBDa/SDSoftware/comfyfork/ComfyUI/comfy/k_diffusion/external.py", line 140, in get_eps
return self.inner_model.apply_model(*args, **kwargs)
File "/mnt/2TBDa/SDSoftware/comfyfork/ComfyUI/comfy/ldm/models/diffusion/ddpm.py", line 862, in apply_model
x_recon = self.model(x_noisy, t, **cond)
File "/home/salt/.local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
return forward_call(*input, **kwargs)
File "/mnt/2TBDa/SDSoftware/comfyfork/ComfyUI/comfy/ldm/models/diffusion/ddpm.py", line 1334, in forward
out = self.diffusion_model(x, t, context=cc)
File "/home/salt/.local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
return forward_call(*input, **kwargs)
File "/mnt/2TBDa/SDSoftware/comfyfork/ComfyUI/comfy/ldm/modules/diffusionmodules/openaimodel.py", line 781, in forward
h = module(h, emb, context)
File "/home/salt/.local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
return forward_call(*input, **kwargs)
File "/home/salt/.local/lib/python3.10/site-packages/accelerate/hooks.py", line 158, in new_forward
output = old_forward(*args, **kwargs)
File "/mnt/2TBDa/SDSoftware/comfyfork/ComfyUI/comfy/ldm/modules/diffusionmodules/openaimodel.py", line 84, in forward
x = layer(x, context)
File "/home/salt/.local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
return forward_call(*input, **kwargs)
File "/home/salt/.local/lib/python3.10/site-packages/accelerate/hooks.py", line 158, in new_forward
output = old_forward(*args, **kwargs)
File "/mnt/2TBDa/SDSoftware/comfyfork/ComfyUI/comfy/ldm/modules/attention.py", line 539, in forward
x = block(x, context=context[i])
File "/home/salt/.local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
return forward_call(*input, **kwargs)
File "/home/salt/.local/lib/python3.10/site-packages/accelerate/hooks.py", line 158, in new_forward
output = old_forward(*args, **kwargs)
File "/mnt/2TBDa/SDSoftware/comfyfork/ComfyUI/comfy/ldm/modules/attention.py", line 474, in forward
return checkpoint(self._forward, (x, context), self.parameters(), self.checkpoint)
File "/mnt/2TBDa/SDSoftware/comfyfork/ComfyUI/comfy/ldm/modules/diffusionmodules/util.py", line 114, in checkpoint
return CheckpointFunction.apply(func, len(inputs), *args)
File "/mnt/2TBDa/SDSoftware/comfyfork/ComfyUI/comfy/ldm/modules/diffusionmodules/util.py", line 129, in forward
output_tensors = ctx.run_function(*ctx.input_tensors)
File "/mnt/2TBDa/SDSoftware/comfyfork/ComfyUI/comfy/ldm/modules/attention.py", line 477, in _forward
x = self.attn1(self.norm1(x), context=context if self.disable_self_attn else None) + x
File "/home/salt/.local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
return forward_call(*input, **kwargs)
File "/home/salt/.local/lib/python3.10/site-packages/accelerate/hooks.py", line 158, in new_forward
output = old_forward(*args, **kwargs)
File "/mnt/2TBDa/SDSoftware/comfyfork/ComfyUI/comfy/ldm/modules/attention.py", line 220, in forward
hidden_states = efficient_dot_product_attention(
File "/mnt/2TBDa/SDSoftware/comfyfork/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 227, in efficient_dot_product_attention
return compute_query_chunk_attn(
File "/mnt/2TBDa/SDSoftware/comfyfork/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 154, in _get_attention_scores_no_kv_chunking
except torch.cuda.OutOfMemoryError:
AttributeError: module 'torch.cuda' has no attribute 'OutOfMemoryError'```
from comfyui.
Can you try it now?
from comfyui.
It works perfectly now, thank you!
from comfyui.
Related Issues (20)
- After the last update black images after few steps on Mac mini M2 pro with Sonoma 14.5 HOT 18
- Crash with image previews in KSampler nodes HOT 7
- Images generated with square brackets ("[]") in prompt can't be reproduced anymore HOT 12
- "--preview-method taesd" cmd line arg does not appear to work properly HOT 2
- 快捷键的更多方式
- Only 1 release since over a year old? HOT 2
- raise ClientConnectorError(req.connection_key, exc) from exc aiohttp.client_exceptions.ClientConnectorError: Cannot connect to host raw.githubusercontent.com:443 ssl:default [getaddrinfo failed] HOT 3
- Primitive Node is next to useless
- Hello, how can I submit a workflow via the API interface and obtain the actual link and ID of the workflow?
- Websocket connection will be created over and over again! HOT 1
- NotADirectoryError: [WinError 267] The directory name is invalid HOT 1
- The text box component cannot be loaded HOT 1
- Inaccessible Group Node
- Parallel Execution of Independent Nodes HOT 2
- Cannot handle this data type: (1, 1, 3), <f4 HOT 3
- python crashes in Ksampler after MacOS 14.5 update HOT 18
- After updating to the latest version, an issue occurred where the environment crashes as soon as an image is displayed HOT 2
- When using the prompt randomizing feature of ComfyUI, the cursor will automatically and constantly jump to the end of the prompt. HOT 2
- Quick Search Palette not working HOT 1
- requirements.txt HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from comfyui.