scale_parameter=False relative_step=False warmup_init=False it not working !! training LoRA about kohya_ss HOT 4 CLOSED

You're using adamw8bit, that argument is only for adafactor, switch your optimizer to adafactor.

from kohya_ss.

adafactor

i did adfactor and chaged the LR to adfactor as well still not working

from kohya_ss.

I just tried it on my system and it did work. I have published the test config and dataset used in the test folder... load the following config and see if it work on your system.

Use the dev branch to test:

git pull
git checkout dev

Open this config file: ./test/config/locon-Adafactor.json

from kohya_ss.

I just tried it on my system and it did work. I have published the test config and dataset used in the test folder... load the following config and see if it work on your system.

Use the dev branch to test:

git pull
git checkout dev

Open this config file: ./test/config/locon-Adafactor.json

Yes , Thanks it worked !

from kohya_ss.