Error when attempting to generate images about comfyui-ait HOT 8 OPEN

Having the same issue:

File "D:\stable_diffusion\ComfyUI_windows_portable\ComfyUI\custom_nodes\aitemplate\compiler\model.py", line 196, in _wrapped_func
raise RuntimeError(f"Error in function: {method.name}")
RuntimeError: Error in function: AITemplateModelContainerSetManyConstants

from comfyui-ait.

I am assuming you are using 1.x modules. Sdxl works fine but some work needs to be done to get compatability with 1.x modules. Yesterday I can confirm sdxl modules are working as I was testing them with lcm lora (it works with lcm btw!) Just in case, let me know if you can inference with an xl module. Thanks in advance.

from comfyui-ait.

I am assuming you are using 1.x modules. Sdxl works fine but some work needs to be done to get compatability with 1.x modules. Yesterday I can confirm sdxl modules are working as I was testing them with lcm lora (it works with lcm btw!) Just in case, let me know if you can inference with an xl module. Thanks in advance.

I've used the SDXL modules (plus I also tried the ones I made.)

from comfyui-ait.

I only have SDXL 1.0 models

from comfyui-ait.

Thanks for the input guys. I'm looking into it.

from comfyui-ait.

Having the same issue:
ERROR:root:Traceback (most recent call last):
File "/app/ComfyUI/execution.py", line 153, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
File "/app/ComfyUI/execution.py", line 83, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
File "/app/ComfyUI/execution.py", line 76, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
File "/app/ComfyUI/nodes.py", line 1237, in sample
return common_ksampler(model, seed, steps, cfg, sampler_name, scheduler, positive, negative, latent_image, denoise=denoise)
File "/app/ComfyUI/nodes.py", line 1207, in common_ksampler
samples = comfy.sample.sample(model, noise, steps, cfg, sampler_name, scheduler, positive, negative, latent_image,
File "/app/ComfyUI/comfy/sample.py", line 100, in sample
samples = sampler.sample(noise, positive_copy, negative_copy, cfg=cfg, latent_image=latent_image, start_step=start_step, last_step=last_step, force_full_denoise=force_full_denoise, denoise_mask=noise_mask, sigmas=sigmas, callback=callback, disable_pbar=disable_pbar, seed=seed)
File "/app/ComfyUI/comfy/samplers.py", line 692, in sample
return sample(self.model, noise, positive, negative, cfg, self.device, sampler(), sigmas, self.model_options, latent_image=latent_image, denoise_mask=denoise_mask, callback=callback, disable_pbar=disable_pbar, seed=seed)
File "/app/ComfyUI/comfy/samplers.py", line 598, in sample
samples = sampler.sample(model_wrap, sigmas, extra_args, callback, noise, latent_image, denoise_mask, disable_pbar)
File "/app/ComfyUI/comfy/samplers.py", line 558, in sample
samples = getattr(k_diffusion_sampling, "sample_{}".format(sampler_name))(model_k, noise, sigmas, extra_args=extra_args, callback=k_callback, disable=disable_pbar, **extra_options)
File "/opt/conda/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "/app/ComfyUI/comfy/k_diffusion/sampling.py", line 137, in sample_euler
denoised = model(x, sigma_hat * s_in, **extra_args)
File "/opt/conda/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
File "/opt/conda/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1527, in _call_impl
return forward_call(*args, **kwargs)
File "/app/ComfyUI/comfy/samplers.py", line 275, in forward
out = self.inner_model(x, sigma, cond=cond, uncond=uncond, cond_scale=cond_scale, model_options=model_options, seed=seed)
File "/opt/conda/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
File "/opt/conda/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1527, in call_impl
return forward_call(*args, **kwargs)
File "/app/ComfyUI/comfy/samplers.py", line 265, in forward
return self.apply_model(*args, **kwargs)
File "/app/ComfyUI/comfy/samplers.py", line 262, in apply_model
out = sampling_function(self.inner_model, x, timestep, uncond, cond, cond_scale, model_options=model_options, seed=seed)
File "/app/ComfyUI/comfy/samplers.py", line 250, in sampling_function
cond, uncond = calc_cond_uncond_batch(model, cond, uncond, x, timestep, model_options)
File "/app/ComfyUI/comfy/samplers.py", line 226, in calc_cond_uncond_batch
output = model_options['model_function_wrapper'](model.apply_model, {"input": input_x, "timestep": timestep, "c": c, "cond_or_uncond": cond_or_uncond}).chunk(batch_chunks)
File "/app/ComfyUI/custom_nodes/ComfyUI-AIT/ait_load.py", line 69, in call
self.ait_model.set_weights(sd)
File "/app/ComfyUI/custom_nodes/ComfyUI-AIT/ait_load.py", line 43, in set_weights
self.exe_module.set_many_constants_with_tensors(constants)
File "/opt/conda/lib/python3.10/site-packages/aitemplate/compiler/model.py", line 861, in set_many_constants_with_tensors
self.set_many_constants(ait_tensors)
File "/opt/conda/lib/python3.10/site-packages/aitemplate/compiler/model.py", line 812, in set_many_constants
self.DLL.AITemplateModelContainerSetManyConstants(
File "/opt/conda/lib/python3.10/site-packages/aitemplate/compiler/model.py", line 196, in _wrapped_func
raise RuntimeError(f"Error in function: {method.name}")
RuntimeError: Error in function: AITemplateModelContainerSetManyConstants

from comfyui-ait.

I have the same error. I want to use sd1.5 and tried v1_unet_64_1024.so, v1_vae_64_1024.so and v1_vae_encode_64_1024.so, but I get:

model_interface.cu:122: Error: Called SetConstant on time_embed_0_weight but can't find in either bound or unbound constant set

from comfyui-ait.

I am getting the same error with both SD15 and SDXL

from comfyui-ait.