Comments (1)
I don't see why you couldn't use non square images for training with controlnet, it's the same as for the unet. I suggest you use the same aspect ratios and sizes than the original SDXL training.
The training scripts in diffusers
are minimal examples, that's why they don't have different bucket resolutions or aspect ratios, it's just to keep the code simple.
Also make sure you need this, I really don't see the need to use the whole images or what does it mean that they lose integrity, the model just needs to understand the features in the image and not the whole composition for most use cases.
from diffusers.
Related Issues (20)
- I feel confused about this TODO issue. how to pass timesteps as tensors? HOT 1
- Multi-controlnet formatting issue HOT 1
- CLIP Training Example Bug - Overfitting HOT 1
- with XL ,When the image is enlarged for viewing,The drawn image will appear as red dots in most cases HOT 8
- deepfloyd stage 2 crashes with tensor size mismatch when input image size is not divisible by 8 HOT 2
- examples/community/lpw_stable_diffusion_xl.py Not correctly decoded HOT 1
- Severe difference with A1111 HOT 5
- Index 11 is out of bounds for dimension 0 with size 11 on concurrent pipeline calls HOT 1
- RuntimeError: Input type (c10::Half) and bias type (float) should be the same HOT 2
- Multi-vector Token already in tokenizer vocabulary. Please choose a different token name HOT 2
- FlashFace implementation in diffusers
- Support Residual Classifier-Free Guidance (RCFG) ?
- diffusers soft inpainting support HOT 5
- MotionMaster: Training-free Camera Motion Transfer For Video Generation
- Error when using blockwise scales with sd_xl_offset_example-lora_1.0.safetensors HOT 3
- diffusers0.19.3 HOT 1
- Support out_dim argument for Attention block
- pokemon-blip-captions dataset HOT 7
- lpw_stable_diffusion pipeline not working when "from_single_file" is used HOT 7
- stable diffusion adapter pipeline for t2i adapter missing `from_single_file` HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from diffusers.