Run i-Code-v3 on CPU, Solve GPU VRAM problem! about i-code HOT 2 OPEN

Thanks! We will work on adding fp16 support on CPU.
Currerntly the model can run on fp16 GPU but can't on fp16 CPU?

from i-code.

Thanks! We will work on adding fp16 support on CPU. Currerntly the model can run on fp16 GPU but can't on fp16 CPU?

The code worked well on fp16 GPU (RTX 3090).

For the CPU the code does not work. because in the files that I mensioned before, "model_module_infer.py", "ddim.py", and "diffusion_unet.py", the variables set to GPU by ".cuda()" command.
To fix it I suggested to change it to ".to(device)" and define device variable by either checking 'cuda' if it is available (if not "CPU") or by user decision to run on cpu/cuda.

I already made those changes locally and code worked on my CPU without problem in normal mode (fp32).
But when I switch to fp16 and run on CPU, the code does not work.

from i-code.