Comments (7)
@hlky I know you probably resolved this already- when compiling for any batch size other than 1 in your AITemplate repo it does this:
what was the fix for this? is this the reason there is only BS1 on the HF repo with the precompiled modules?
from ait.
UPDATE, changed the compile code a little- I'm currently compiling for BS 1 16 res 64 2048. will update here if this will work on the refiner too.
from ait.
from ait.
Sorry, I am no longer active, my account is pending deletion. All I can tell you is that profilers, and batch size >1 modules, compile without issue on my machine, and your screenshot does not provide any useful information. You do not need to make any changes, and would suggest that you do not make changes unless you know what you are doing.
the compile_sdxl.py
file couldn't do batch size>1. I did manage to use it for bs 1 though. I think I might have figured out how to fix it. NVM, it got closer to finishing the compile process. didn't F*ing work. idk man
from ait.
from ait.
@hlky is the UNet2DConditionModel.dll
the module? that's the only component it was able to compile
from ait.
figured it out, I compiled modules for xl and xlr in sm80, res64-2048, bs1-4. also sent them to FizzleDorf. might be added to the repo with the precompiled modules. couldn't get the node to see the modules when bs>1, but worked on test.. so I'll close this because I resolved it.
from ait.
Related Issues (20)
- Compilation fails after fb84060 HOT 2
- ""log_vml_cpu" not implemented for 'Half'" when using AITemplate on certain models
- module 'comfy.sd' has no attribute 'ModelPatcher' HOT 1
- Unable to compile modules after update HOT 2
- issue: compatibility patch required HOT 2
- Error Running Workflows HOT 3
- [Bug] ddim, uni_pc, uni_pc_bh2
- [Bug] Conditioning Combine node error
- [Bug] ControlNet issues
- [Bug] LoRA issues
- [Bug] Batch size > 1
- [Bug] LoRAs handled incorrectly
- Issues with Inpainting pipeline
- FreeU support?
- Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! HOT 9
- After the last update, an error occurred. HOT 1
- Missing Nodes after updating HOT 3
- AITemplate -v?
- AITemplate if-else
- Cannot import HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ait.