Giter Club home page Giter Club logo

comfyui_wav2lip's Introduction

ComfyUI_wav2lip

Wav2Lip Node for ComfyUI

The Wav2Lip node is a custom node for ComfyUI that allows you to perform lip-syncing on videos using the Wav2Lip model. It takes an input video and an audio file and generates a lip-synced output video.

wav2lip 2

Features

  • Lip-syncing of videos using the Wav2Lip model
  • Support for various face detection models
  • Audio path upload for input audio file

Inputs

  • images: Input video frames (required)
  • audio: Input audio file (required)
  • mode: Processing mode, either "sequential" or "repetitive" (default: "sequential")
  • face_detect_batch: Batch size for face detection (default: 8)

Outputs

  • images: Lip-synced output video frames
  • audio: Output audio file

Installation

  1. Clone the repository to custom_nodes folder:

    git clone https://github.com/ShmuelRonen/ComfyUI_wav2lip.git
    
  2. Install the required dependencies:

    pip install -r requirements.txt
    

Model Setup

To use the Wav2Lip node, you need to download the required models separately. Please follow these steps:

wav2lip model:

  1. Download the wav2lip model: -model-
  2. Place the .pth model file in the custom_nodes\ComfyUI_wav2lip\Wav2Lip\checkpoints` folder
  3. Start or restart ComfyUI.

Usage

  1. Add the Wav2Lip node to your ComfyUI workflow.

  2. Connect the input video frames and audio file to the corresponding inputs of the Wav2Lip node.

  3. Adjust the node settings according to your requirements:

    • Set the mode to "sequential" or "repetitive" based on your video processing needs.
    • Adjust the face_detect_batch size if needed.
  4. Execute the ComfyUI workflow to generate the lip-synced output video.

Acknowledgement

Thanks to ArtemM, Wav2Lip, PIRenderer, GFP-GAN, GPEN, ganimation_replicate, STIT for sharing their code.

Related Work

comfyui_wav2lip's People

Contributors

shmuelronen avatar geekyghost avatar comfy-pr-bot avatar fuoum avatar ksenia-portu avatar

Stargazers

 avatar  avatar Pauli avatar  avatar PhakphumV avatar tjrtm avatar Mario avatar  avatar  avatar  avatar  avatar Daniel Kravec avatar  avatar Thangaraj avatar  avatar YvanKOB avatar Krtolica Vujadin avatar  avatar Tomy Spagnoletti Duval avatar Bipin Peter avatar Beckett avatar Patrick avatar  avatar  avatar Melo avatar  avatar Camilo Jiménez avatar Wonkyung Lee avatar  avatar  avatar will-gao avatar  avatar Jin Liu avatar Alexander G. Morano avatar lalo adrian morales avatar  avatar _._._.. avatar Indra Lesmana avatar xingliang lin avatar JongYoon Lim avatar  avatar  avatar Carlos Henrique R. Pereira avatar Lauren Neal avatar Emmanuel Seynaeve avatar  avatar martintomov avatar wangjianxiong avatar Paragoner avatar Batuhan Bayraktar avatar MF avatar AI_master_workflow avatar Nymph avatar youchienji avatar Yuan-Man avatar Gentleman.Hu avatar Kevin Yuan avatar  avatar rui400 avatar Cesarkon avatar  avatar Tuan-Vu Trinh  avatar  avatar JUJU avatar Dongwon Lee avatar 王鹤男 avatar  avatar  avatar  avatar  avatar Jossef Harush Kadouri avatar  avatar  avatar

Watchers

Emmanuel Seynaeve avatar  avatar

comfyui_wav2lip's Issues

ModuleNotFoundError: No module named 'custom_nodes.facerestore_cf'

Traceback (most recent call last):
File "/home/leandro/ComfyUI/nodes.py", line 1888, in load_custom_node
module_spec.loader.exec_module(module)
File "", line 883, in exec_module
File "", line 241, in _call_with_frames_removed
File "/home/leandro/ComfyUI/custom_nodes/ComfyUI_wav2lip/init.py", line 1, in
from .wav2lip import Wav2Lip
File "/home/leandro/ComfyUI/custom_nodes/ComfyUI_wav2lip/wav2lip.py", line 15, in
from .facelib.utils.face_restoration_helper import FaceRestoreHelper
File "/home/leandro/ComfyUI/custom_nodes/ComfyUI_wav2lip/facelib/utils/face_restoration_helper.py", line 7, in
from custom_nodes.facerestore_cf.facelib.detection import init_detection_model
ModuleNotFoundError: No module named 'custom_nodes.facerestore_cf'

Import Failed

When I tried installing it with ComfyUI manager there was an error "(IMPORT FAILED)"

So I tried Windows CMD to clone but there was a "Git Credentials Authentication" window that popped up.

Cloning failed

Hey, got this error on cloning the repository to custom_nodes folder.
image

TypeError: 'function' object is not subscriptable

hi,there. when loding the last node ,it show
!!! Exception during processing!!! 'function' object is not subscriptable
Traceback (most recent call last):
File "C:\Users\LYF\ComfyUI-aki-v1.1\execution.py", line 152, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
File "C:\Users\LYF\ComfyUI-aki-v1.1\execution.py", line 82, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
File "C:\Users\LYF\ComfyUI-aki-v1.1\execution.py", line 75, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
File "C:\Users\LYF\ComfyUI-aki-v1.1\custom_nodes\ComfyUI-VideoHelperSuite\videohelpersuite\nodes.py", line 523, in combine_video
channels = audio['waveform'].size(1)
TypeError: 'function' object is not subscriptable
image

audio can't be routed

Hi, I can't connect the audio of the wav2lip node to anything. Other audio nodes are working fine, like the ones come with comfyui videohelper suite. Any suggestion?

זה לא עובד כבר יותר משעה אני ממתין לתוצאות

כבר יותר משעה אני ממתין לתוצאה וזה תקוע בצומת video combine
זה לא בגלל מפרט המחשC שלי, יש לי 16 RAM וכרטיס גרפי RTX3070

צילום מסך 2024-05-21 164649

פלט יומן:
To see the GUI go to: http://127.0.0.1:8188
FETCH DATA from: C:\zxcv\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Manager\extension-node-map.json [DONE]
got prompt
(80, 2636)
Length of mel chunks: 984
Load model from: C:\zxcv\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_wav2lip\Wav2Lip\checkpoints\wav2lip_gan.pth
Load checkpoint from: C:\zxcv\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_wav2lip\Wav2Lip\checkpoints\wav2lip_gan.pth
100%|████████████████████████████████████████████████████████████████████████████████| 105/105 [00:50<00:00, 2.10it/s]
100%|████████████████████████████████████████████████████████████████████████████████████| 8/8 [01:12<00:00, 9.07s/it]
out_images len = 984

Hi there is a problem Cloning the repository (file not found) and also loading the wav2lip_gan.pth from the folder (C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_wav2lip\Wav2Lip\checkpoints) it only fined the models in the folder (C:\ComfyUI_windows_portable\ComfyUI\models\facerestore_models)

היי שמואל, תודה רבה על ה-NODE הנפלא, יש בעיה לתפעל אותו .....

Hi there is a problem Cloning the repository (file not found) and also loading the wav2lip_gan.pth from the folder (C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_wav2lip\Wav2Lip\checkpoints)
it only fined the models in the folder (C:\ComfyUI_windows_portable\ComfyUI\models\facerestore_models)

The only model that working is codeformer.

The main error after doing all the installation steps is:

Error occurred when executing FaceRestoreModelLoader:

File "C:\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\facerestore_cf_init_.py", line 293, in load_model
out = model_loading.load_state_dict(sd).eval()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\ComfyUI_windows_portable\ComfyUI\comfy_extras\chainner_models\model_loading.py", line 5, in load_state_dict
return ModelLoader().load_from_state_dict(state_dict).eval()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\spandrel__helpers\loader.py", line 94, in load_from_state_dict
return self.registry.load(state_dict).to(self.device)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\spandrel__helpers\registry.py", line 184, in load
raise UnsupportedModelError

Close
Queue size: 0
⚙️
🖼️
×
Queue Prompt
Extra options
Queue FrontView QueueView History
Save
LoadRefresh
Clipspace
Clear
Load Default
Reset View
Manager
Share
spandrel.__helpers.registry.UnsupportedModelError 142 FaceRestoreModelLoader

מחכה לעזרה, או תיקון, תודה רבה !!!

Ubuntu support and missed dep librosa

Hi, I took the liberty of creating a pull request that resolves an issue I encountered. This change made it work on Ubuntu for me.
Could someone test this on Windows to ensure compatibility?
You can find the PR here: PR #11
Thanks!

cant see

cant see wav2lip nod after installing

EOF error when executing wav2lip

Hi everyone, when the process of the workflow in comfyUI arrives at the wav2lip node, I get this error:


Error occurred when executing Wav2Lip:

unexpected EOF, expected 8549702 more bytes. The file might be corrupted.

File "C:\Users\akira\Desktop\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\akira\Desktop\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\akira\Desktop\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\akira\Desktop\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_wav2lip\wav2lip.py", line 103, in todo
out_img_list = wav2lip_(in_img_list, temp_audio_path, face_detect_batch, mode, model_path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\akira\Desktop\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_wav2lip\Wav2Lip\wav2lip_node.py", line 162, in wav2lip_
for i, (img_batch, mel_batch, frames, coords) in enumerate(tqdm(gen,
File "C:\Users\akira\Desktop\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\python_embeded\Lib\site-packages\tqdm\std.py", line 1181, in iter
for obj in iterable:
File "C:\Users\akira\Desktop\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_wav2lip\Wav2Lip\wav2lip_node.py", line 65, in datagen
face_det_results = face_detect(frames, face_detect_batch)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\akira\Desktop\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_wav2lip\Wav2Lip\wav2lip_node.py", line 20, in face_detect
detector = face_detection.FaceAlignment(face_detection.LandmarksType._2D,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\akira\Desktop\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_wav2lip\Wav2Lip\face_detection\api.py", line 60, in init
self.face_detector = sfd.FaceDetector(device=device, verbose=verbose)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\akira\Desktop\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_wav2lip\Wav2Lip\face_detection\detection\sfd\sfd_detector.py", line 22, in init
model_weights = load_url(models_urls['s3fd'])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\akira\Desktop\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\hub.py", line 770, in load_state_dict_from_url
return torch.load(cached_file, map_location=map_location, weights_only=weights_only)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\akira\Desktop\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\serialization.py", line 1040, in load
return _legacy_load(opened_file, map_location, pickle_module, **pickle_load_args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\akira\Desktop\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\serialization.py", line 1276, in _legacy_load
typed_storage._untyped_storage._set_from_file(

I tried so many thing to resolve but without success; anyone is experiencing the same error or can indicate me what to do ? thanks in advance

about result

result is very bad is there anyway to improve it like voice dont match with lips movements and lips are deformed

Error on Wav2Lip Node (SSL Certificate Verify Failed)

Hello, any chance you know what might be causing this error? Tried updating everything, restarting, etc. Still throws this error on the Wav2Lip node each time.

!!! Exception during processing!!! <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:997)>
Traceback (most recent call last):
File "urllib\request.py", line 1348, in do_open
File "http\client.py", line 1282, in request
File "http\client.py", line 1328, in _send_request
File "http\client.py", line 1277, in endheaders
File "http\client.py", line 1037, in _send_output
File "http\client.py", line 975, in send
File "http\client.py", line 1454, in connect
File "ssl.py", line 513, in wrap_socket
File "ssl.py", line 1071, in _create
File "ssl.py", line 1342, in do_handshake
ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:997)

...

line 622, in download_url_to_file
u = urlopen(req)
File "urllib\request.py", line 216, in urlopen
File "urllib\request.py", line 519, in open
File "urllib\request.py", line 536, in _open
File "urllib\request.py", line 496, in _call_chain
File "urllib\request.py", line 1391, in https_open
File "urllib\request.py", line 1351, in do_open
urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:997)>

AssertionError: An object named 'L1Loss' was already registered in 'loss' registry!

Traceback (most recent call last):
File "D:\ComfyUI\nodes.py", line 1879, in load_custom_node
module_spec.loader.exec_module(module)
File "", line 940, in exec_module
File "", line 241, in call_with_frames_removed
File "D:\ComfyUI\custom_nodes\ComfyUI_wav2lip_init
.py", line 1, in
from .wav2lip import Wav2Lip
File "D:\ComfyUI\custom_nodes\ComfyUI_wav2lip\wav2lip.py", line 14, in
from custom_nodes.ComfyUI_wav2lip.facelib.utils.face_restoration_helper import FaceRestoreHelper
File "D:\ComfyUI\custom_nodes\ComfyUI_wav2lip_init_.py", line 1, in
from .wav2lip import Wav2Lip
File "D:\ComfyUI\custom_nodes\ComfyUI_wav2lip\wav2lip.py", line 37, in
from custom_nodes.ComfyUI_wav2lip.basicsr.utils.registry import ARCH_REGISTRY
File "D:\ComfyUI\custom_nodes\ComfyUI_wav2lip\basicsr_init_.py", line 5, in
from .losses import *
File "D:\ComfyUI\custom_nodes\ComfyUI_wav2lip\basicsr\losses_init_.py", line 5, in
from .losses import (CharbonnierLoss, GANLoss, L1Loss, MSELoss, PerceptualLoss, WeightedTVLoss, g_path_regularize,
File "D:\ComfyUI\custom_nodes\ComfyUI_wav2lip\basicsr\losses\losses.py", line 30, in
@LOSS_REGISTRY.register()
^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\custom_nodes\facerestore_cf\basicsr\utils\registry.py", line 53, in deco
self._do_register(name, func_or_class)
File "D:\ComfyUI\custom_nodes\facerestore_cf\basicsr\utils\registry.py", line 39, in _do_register
assert (name not in self._obj_map), (f"An object named '{name}' was already registered "
^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError: An object named 'L1Loss' was already registered in 'loss' registry!

Cannot import D:\ComfyUI\custom_nodes\ComfyUI_wav2lip module for custom nodes: An object named 'L1Loss' was already registered in 'loss' registry!

No module named 'wav2lip'

I'm unable to get your latest version to run. This is the error upon starting comfyui:

Traceback (most recent call last):
File "C:\Users\user4\Desktop\ComfyUI_windows_portable\ComfyUI\nodes.py", line 1866, in load_custom_node
module_spec.loader.exec_module(module)
File "", line 940, in exec_module
File "", line 241, in call_with_frames_removed
File "C:\Users\user4\Desktop\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_wav2lip_init
.py", line 1, in
from .wav2lip import Wav2Lip
File "C:\Users\user4\Desktop\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_wav2lip\wav2lip.py", line 33, in
from wav2lip import Wav2Lip
ModuleNotFoundError: No module named 'wav2lip'

Cannot import C:\Users\user4\Desktop\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_wav2lip module for custom nodes: No module named 'wav2lip'

I have tried several variations of the include as well as a pip install wav2lip, with no success.
I have all of the models loaded. Any ideas?

Is there a way to FRAME LOAD CAP with Audio Path node?

I'm applying Wav2Lip at the end of a vid2vid workflow. I'm testing 24 frames of a 9 second video clip, but it appears that audio path is passing all 9 seconds worth of audio to wav2lip (i see more than 24 frames being passed to reactor face restore). The end result is a 8 sec video where the face speaks out the words in realtime, but the 24 frames of video are stretched over 9 seconds.

I tried loading audio with VHS node (which has a seconds cap), to no avail. Is there a way to apply a FRAME LOAD CAP input (ideally that can be connected to a central node)?. Feature request perhaps?

wav2lip node parameters

basically in wav2lip node there is only 2 parameters that is "mode" and "face_detect_batch"
but before update, there was a more 3 parameters. those are "lipsync_intensity" , "smoothing_factor" and "framerate".
i want those parameters but i cant get it because of update. please help me

Unable to find model wav2lip_gan.pth

Length of mel chunks: 984
Load checkpoint from: F:\Wav2Lip\checkpoints\wav2lip_gan.pth
!!! Exception during processing !!!
Traceback (most recent call last):
File "C:\zxcv\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\zxcv\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\zxcv\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\zxcv\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_wav2lip\wav2lip.py", line 179, in todo
out_img_list = wav2lip_(in_img_list, temp_audio_path, face_detect_batch, mode)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\zxcv\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_wav2lip\wav2lip\wav2lip_node.py", line 156, in wav2lip_
model = load_model(model_path)
^^^^^^^^^^^^^^^^^^^^^^
File "C:\zxcv\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_wav2lip\wav2lip\wav2lip_node.py", line 122, in load_model
checkpoint = _load(path)
^^^^^^^^^^^
File "C:\zxcv\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_wav2lip\wav2lip\wav2lip_node.py", line 113, in _load
checkpoint = torch.load(model_path)
^^^^^^^^^^^^^^^^^^^^^^
File "C:\zxcv\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\serialization.py", line 998, in load
with _open_file_like(f, 'rb') as opened_file:
^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\zxcv\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\serialization.py", line 445, in _open_file_like
return _open_file(name_or_buffer, mode)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\zxcv\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\serialization.py", line 426, in init
super().init(open(name, mode))
^^^^^^^^^^^^^^^^
FileNotFoundError: [Errno 2] No such file or directory: 'F:\Wav2Lip\checkpoints\wav2lip_gan.pth'

Prompt executed in 8.07 seconds

Yellow Line on the top of the animation box.

Hi,
I am getting this line on the top side of the animation box, which I don't get using my web-gradio app. I tried all appliable adjustments, but couldn't really get rid of it. Do you have any idea, why this might be?
Screenshot 2024-06-25 140442
Screenshot 2024-06-25 140541

Python version error when installing requirements

There is a problem with installing the requirements, and there is an error related to the Python version. May I ask if your node requires a specific Python version? The node does not show up in the ComfyUI interface.

תמיכה במודל Wav2Lip

זה תומך גם במודל Wav2Lip או רק בwav2lip_gan? והאם תוכל להוסיף תמיכה גם במודל Wav2Lip?

Installation error after the last update

ComfyUI-Manager: installing dependencies done.

** ComfyUI startup time: 2024-05-19 17:44:00.162589
** Platform: Windows
** Python version: 3.11.8 (tags/v3.11.8:db85d51, Feb 6 2024, 22:03:32) [MSC v.1937 64 bit (AMD64)]
** Python executable: C:\zxcv\ComfyUI_windows_portable\python_embeded\python.exe
** Log path: C:\zxcv\ComfyUI_windows_portable\comfyui.log

#######################################################################
[ComfyUI-Manager] Starting dependency installation/(de)activation for the extension

ComfyUI-Manager: EXECUTE => ['C:\zxcv\ComfyUI_windows_portable\python_embeded\python.exe', '-m', 'pip', 'install', 'tensorflow-gpu']

Execute install/(de)activation script for 'C:\zxcv\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_wav2lip'

Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting tensorflow-gpu
Downloading tensorflow-gpu-2.12.0.tar.gz (2.6 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'error'
[!] error: subprocess-exited-with-error
[!]
[!] python setup.py egg_info did not run successfully.
[!] exit code: 1
[!]
[!] [44 lines of output]
[!] Traceback (most recent call last):
[!] File "C:\zxcv\ComfyUI_windows_portable\python_embeded\Lib\site-packages\setuptools_vendor\packaging\requirements.py", line 35, in init
[!] parsed = _parse_requirement(requirement_string)
[!] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[!] File "C:\zxcv\ComfyUI_windows_portable\python_embeded\Lib\site-packages\setuptools_vendor\packaging_parser.py", line 64, in parse_requirement
[!] return _parse_requirement(Tokenizer(source, rules=DEFAULT_RULES))
[!] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[!] File "C:\zxcv\ComfyUI_windows_portable\python_embeded\Lib\site-packages\setuptools_vendor\packaging_parser.py", line 82, in _parse_requirement
[!] url, specifier, marker = _parse_requirement_details(tokenizer)
[!] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[!] File "C:\zxcv\ComfyUI_windows_portable\python_embeded\Lib\site-packages\setuptools_vendor\packaging_parser.py", line 126, in _parse_requirement_details
[!] marker = _parse_requirement_marker(
[!] ^^^^^^^^^^^^^^^^^^^^^^^^^^
[!] File "C:\zxcv\ComfyUI_windows_portable\python_embeded\Lib\site-packages\setuptools_vendor\packaging_parser.py", line 147, in _parse_requirement_marker
[!] tokenizer.raise_syntax_error(
[!] File "C:\zxcv\ComfyUI_windows_portable\python_embeded\Lib\site-packages\setuptools_vendor\packaging_tokenizer.py", line 165, in raise_syntax_error
[!] raise ParserSyntaxError(
[!] setuptools.extern.packaging.tokenizer.ParserSyntaxError: Expected end or semicolon (after name and no valid version specifier)
[!] python_version>"3.7"
[!] ^
[!]
[!] The above exception was the direct cause of the following exception:
[!]
[!] Traceback (most recent call last):
[!] File "", line 2, in
[!] File "", line 34, in
[!] File "C:\Users\z5050\AppData\Local\Temp\pip-install-40ldhl6k\tensorflow-gpu_6e3463bdc3604b3083c47fe7cf41b4bd\setup.py", line 40, in
[!] setuptools.setup()
[!] File "C:\zxcv\ComfyUI_windows_portable\python_embeded\Lib\site-packages\setuptools_init
.py", line 103, in setup
[!] install_setup_requires(attrs)
[!] File "C:\zxcv\ComfyUI_windows_portable\python_embeded\Lib\site-packages\setuptools_init
.py", line 74, in _install_setup_requires
[!] dist.parse_config_files(ignore_option_errors=True)
[!] File "C:\zxcv\ComfyUI_windows_portable\python_embeded\Lib\site-packages\setuptools\dist.py", line 633, in parse_config_files
[!] self._finalize_requires()
[!] File "C:\zxcv\ComfyUI_windows_portable\python_embeded\Lib\site-packages\setuptools\dist.py", line 368, in _finalize_requires
[!] self._normalize_requires()
[!] File "C:\zxcv\ComfyUI_windows_portable\python_embeded\Lib\site-packages\setuptools\dist.py", line 383, in _normalize_requires
[!] self.install_requires = list(map(str, _reqs.parse(install_requires)))
[!] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[!] File "C:\zxcv\ComfyUI_windows_portable\python_embeded\Lib\site-packages\setuptools_vendor\packaging\requirements.py", line 37, in init
[!] raise InvalidRequirement(str(e)) from e
[!] setuptools.extern.packaging.requirements.InvalidRequirement: Expected end or semicolon (after name and no valid version specifier)
[!] python_version>"3.7"
[!] ^
[!] [end of output]
[!]
[!] note: This error originates from a subprocess, and is likely not a problem with pip.
[!] error: metadata-generation-failed
[!]
[!] Encountered error while generating package metadata.
[!]
[!] See above for output.
[!]
[!] note: This is an issue with the package mentioned above, not pip.
[!] hint: See above for details.
install/(de)activation script failed: C:\zxcv\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_wav2lip

ComfyUI-Manager: EXECUTE => ['C:\zxcv\ComfyUI_windows_portable\python_embeded\python.exe', '-m', 'pip', 'install', 'PyYAML']

Execute install/(de)activation script for 'C:\zxcv\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_wav2lip'

Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com

ComfyUI-Manager: EXECUTE => ['C:\zxcv\ComfyUI_windows_portable\python_embeded\python.exe', '-m', 'pip', 'install', 'gfpgan']

Execute install/(de)activation script for 'C:\zxcv\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_wav2lip'

Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting gfpgan
Downloading gfpgan-1.3.8-py3-none-any.whl.metadata (12 kB)
Collecting facexlib>=0.2.5 (from gfpgan)
Downloading facexlib-0.3.0-py3-none-any.whl.metadata (4.6 kB)
Collecting filterpy (from facexlib>=0.2.5->gfpgan)
Downloading filterpy-1.4.5.zip (177 kB)
-------------------------------------- 178.0/178.0 kB 1.2 MB/s eta 0:00:00
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'error'
[!] error: subprocess-exited-with-error
[!]
[!] python setup.py egg_info did not run successfully.
[!] exit code: 1
[!]
[!] [6 lines of output]
[!] Traceback (most recent call last):
[!] File "", line 2, in
[!] File "", line 34, in
[!] File "C:\Users\z5050\AppData\Local\Temp\pip-install-gvce3azi\filterpy_c4b9ba98276b46cfb55e3c3e555f2013\setup.py", line 4, in
[!] import filterpy
[!] ModuleNotFoundError: No module named 'filterpy'
[!] [end of output]
[!]
[!] note: This error originates from a subprocess, and is likely not a problem with pip.
[!] error: metadata-generation-failed
[!]
[!] Encountered error while generating package metadata.
[!]
[!] See above for output.
[!]
[!] note: This is an issue with the package mentioned above, not pip.
[!] hint: See above for details.
install/(de)activation script failed: C:\zxcv\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_wav2lip

ComfyUI-Manager: EXECUTE => ['C:\zxcv\ComfyUI_windows_portable\python_embeded\python.exe', '-m', 'pip', 'install', 'realesrgan']

Execute install/(de)activation script for 'C:\zxcv\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_wav2lip'

Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting realesrgan
Downloading realesrgan-0.3.0-py3-none-any.whl.metadata (17 kB)
Collecting facexlib>=0.2.5 (from realesrgan)
Downloading facexlib-0.3.0-py3-none-any.whl.metadata (4.6 kB)
Collecting gfpgan>=1.3.5 (from realesrgan)
Downloading gfpgan-1.3.8-py3-none-any.whl.metadata (12 kB)
Collecting filterpy (from facexlib>=0.2.5->realesrgan)
Downloading filterpy-1.4.5.zip (177 kB)
-------------------------------------- 178.0/178.0 kB 1.3 MB/s eta 0:00:00
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'error'
[!] error: subprocess-exited-with-error
[!]
[!] python setup.py egg_info did not run successfully.
[!] exit code: 1
[!]
[!] [6 lines of output]
[!] Traceback (most recent call last):
[!] File "", line 2, in
[!] File "", line 34, in
[!] File "C:\Users\z5050\AppData\Local\Temp\pip-install-tfhr06ln\filterpy_30a6444468ec445b8e68751590829b88\setup.py", line 4, in
[!] import filterpy
[!] ModuleNotFoundError: No module named 'filterpy'
[!] [end of output]
[!]
[!] note: This error originates from a subprocess, and is likely not a problem with pip.
[!] error: metadata-generation-failed
[!]
[!] Encountered error while generating package metadata.
[!]
[!] See above for output.
[!]
[!] note: This is an issue with the package mentioned above, not pip.
[!] hint: See above for details.
install/(de)activation script failed: C:\zxcv\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_wav2lip

[ComfyUI-Manager] Startup script completed.

I'm trying to install the missing package and this is the error

C:\zxcv\ComfyUI_windows_portable>python_embeded\python.exe -m pip install filterpy
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting filterpy
Downloading filterpy-1.4.5.zip (177 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 178.0/178.0 kB 1.1 MB/s eta 0:00:00
Preparing metadata (setup.py) ... error
error: subprocess-exited-with-error

× python setup.py egg_info did not run successfully.
│ exit code: 1
╰─> [6 lines of output]
Traceback (most recent call last):
File "", line 2, in
File "", line 34, in
File "C:\Users\z5050\AppData\Local\Temp\pip-install-o6195xxz\filterpy_07235db6402447009f2a2458e0785499\setup.py", line 4, in
import filterpy
ModuleNotFoundError: No module named 'filterpy'
[end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

How to fix load failed?

2024-06-04 05:34:06,935- root:1897- WARNING- Traceback (most recent call last):
File "E:\Comfyui\ComfyUI\nodes.py", line 1879, in load_custom_node
module_spec.loader.exec_module(module)
File "", line 883, in exec_module
File "", line 241, in call_with_frames_removed
File "E:\Comfyui\ComfyUI\custom_nodes\ComfyUI_wav2lip_init
.py", line 1, in
from .wav2lip import Wav2Lip
File "E:\Comfyui\ComfyUI\custom_nodes\ComfyUI_wav2lip\wav2lip.py", line 56, in
from wav2lip_node import wav2lip_
File "E:\Comfyui\ComfyUI\custom_nodes\ComfyUI_wav2lip\wav2lip\wav2lip_node.py", line 5, in
from models import Wav2Lip
ImportError: cannot import name 'Wav2Lip' from 'models' (E:\Comfyui\ComfyUI\custom_nodes\ComfyUI-BiRefNet\models_init_.py)

2024-06-04 05:34:06,936- root:1898- WARNING- Cannot import E:\Comfyui\ComfyUI\custom_nodes\ComfyUI_wav2lip module for custom nodes: cannot import name 'Wav2Lip' from 'models' (E:\Comfyui\ComfyUI\custom_nodes\ComfyUI-BiRefNet\models_init_.py)

How to run ?

Thank you for your greate work. Im not familier with ComfyUI, Could you guide me on how to run your project ?

[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired

          Hello, saw this was closed, but after pulling update and trying reinstalling using instructions I'm still seeing error in trying to use this node. 

File "D:\06_Comfy\ComfyUI_windows_portable_nvidia_cu118_or_cpu\ComfyUI_windows_portable\python_embeded\lib\site-packages\torch\hub.py", line 622, in download_url_to_file
u = urlopen(req)
File "urllib\request.py", line 216, in urlopen
File "urllib\request.py", line 519, in open
File "urllib\request.py", line 536, in _open
File "urllib\request.py", line 496, in _call_chain
File "urllib\request.py", line 1391, in https_open
File "urllib\request.py", line 1351, in do_open
urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:997)>

Any suggestions appreciated.

Thank you.

Originally posted by @TheShadowNYC in #27 (comment)

Error: 'dict' object is not callable

Hi

When I open the provided workflow (wav2lip.json) I first get the error

This workflow contains one or more nodes which use the old VHS_AUDIO format. They have been highlighted in red. An AudioToVHSAudio node must be added to convert to this legacy format

If I then ignore the error and continue to run it I get this error:

Error occurred when executing Wav2Lip:

'dict' object is not callable

  File "D:\AI\ComfyUI_windows_portable_nightly_pytorch\ComfyUI\execution.py", line 151, in recursive_execute
    output_data, output_ui = get_output_data(obj, input_data_all)
                             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\AI\ComfyUI_windows_portable_nightly_pytorch\ComfyUI\execution.py", line 81, in get_output_data
    return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\AI\ComfyUI_windows_portable_nightly_pytorch\ComfyUI\execution.py", line 74, in map_node_over_list
    results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\AI\ComfyUI_windows_portable_nightly_pytorch\ComfyUI\custom_nodes\ComfyUI_wav2lip\wav2lip.py", line 98, in process
    audio_data = process_audio(audio())
                               ^^^^^^^

Comfy process gets killed

Hi! I'm having this issue where the process gets killed in the face restore node. Is this the issue you were talking about in the pull request?

Logs:

`Length of mel chunks: 2419
Load model from: /home/leandro/ComfyUI/custom_nodes/ComfyUI_wav2lip/Wav2Lip/checkpoints/wav2lip_gan.pth
Load checkpoint from: /home/leandro/ComfyUI/custom_nodes/ComfyUI_wav2lip/Wav2Lip/checkpoints/wav2lip_gan.pth
0%| | 0/19 [00:00<?, ?it/s]Downloading: "https://www.adrianbulat.com/downloads/python-fan/s3fd-619a316812.pth" to /home/leandro/.cache/torch/hub/checkpoints/s3fd-619a316812.pth
100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 85.7M/85.7M [00:10<00:00, 8.38MB/s]
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 14/14 [00:25<00:00, 1.86s/it]
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 19/19 [01:16<00:00, 4.01s/it]
out_images len = 2419
Starting restore_face with codeformer_fidelity: 0.5
Downloading: "https://github.com/xinntao/facexlib/releases/download/v0.1.0/detection_Resnet50_Final.pth" to /home/leandro/ComfyUI/models/facedetection/detection_Resnet50_Final.pth

100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 104M/104M [00:03<00:00, 35.9MB/s]
Downloading: "https://github.com/sczhou/CodeFormer/releases/download/v0.1.0/parsing_parsenet.pth" to /home/leandro/ComfyUI/models/facedetection/parsing_parsenet.pth

100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 81.4M/81.4M [00:02<00:00, 31.6MB/s]
Killed
`

Cant see the node

The cmd:

Starting server
To see the GUI go to: http://127.0.0.1:8188
To see the GUI go to: https://127.0.0.1:8189
FETCH DATA from: C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Manager\extension-node-map.json

😺dzNodes: LayerStyle -> Warning: C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_LayerStyle\custom_size.ini not found, use default size.

😺dzNodes: LayerStyle -> Warning: C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_LayerStyle\custom_size.ini not found, use default size.

😺dzNodes: LayerStyle -> Warning: C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_LayerStyle\custom_size.ini not found, use default size.

😺dzNodes: LayerStyle -> Warning: C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_LayerStyle\custom_size.ini not found, use default size.

#read_workflow_json_files_all C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-mixlab-nodes\app
FETCH DATA from: C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Manager\extension-node-map.json

😺dzNodes: LayerStyle -> Warning: C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_LayerStyle\custom_size.ini not found, use default size.

😺dzNodes: LayerStyle -> Warning: C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_LayerStyle\custom_size.ini not found, use default size.

😺dzNodes: LayerStyle -> Warning: C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_LayerStyle\custom_size.ini not found, use default size.

😺dzNodes: LayerStyle -> Warning: C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_LayerStyle\custom_size.ini not found, use default size.

#read_workflow_json_files_all C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-mixlab-nodes\app\

Import Failed

I am getting the following error in the ComfyUI log when it loads:

Base directory: /mnt/wf/ComfyUI/custom_nodes/ComfyUI_wav2lip
Checkpoints path: /mnt/wf/ComfyUI/custom_nodes/ComfyUI_wav2lip/Wav2Lip/checkpoints
Model path: /mnt/wf/ComfyUI/custom_nodes/ComfyUI_wav2lip/Wav2Lip/checkpoints/wav2lip_gan.pth
Wav2Lip path added to sys.path: /mnt/wf/ComfyUI/custom_nodes/ComfyUI_wav2lip/wav2lip
Directory created or exists: /mnt/wf/ComfyUI/custom_nodes/ComfyUI_wav2lip/facedetection
Current directory: /mnt/wf/ComfyUI/custom_nodes/ComfyUI_wav2lip
Wav2Lip path: /mnt/wf/ComfyUI/custom_nodes/ComfyUI_wav2lip/wav2lip
Traceback (most recent call last):
File "/mnt/wf/ComfyUI/nodes.py", line 1879, in load_custom_node
module_spec.loader.exec_module(module)
File "", line 883, in exec_module
File "", line 241, in call_with_frames_removed
File "/mnt/wf/ComfyUI/custom_nodes/ComfyUI_wav2lip/init.py", line 1, in
from .wav2lip import Wav2Lip
File "/mnt/wf/ComfyUI/custom_nodes/ComfyUI_wav2lip/wav2lip.py", line 56, in
from wav2lip_node import wav2lip

ModuleNotFoundError: No module named 'wav2lip_node'

Cannot import /mnt/wf/ComfyUI/custom_nodes/ComfyUI_wav2lip module for custom nodes: No module named 'wav2lip_node'

Any suggestions? I looked through existing Issues and nothing seemed to match.

unexpected EOF,i have download many wav2lip_gan.pth but all of them failed

got prompt
[rgthree] Using rgthree's optimized recursive execution.
(80, 279)
Length of mel chunks: 3
Load model from: E:\VIDEO\ComfyUI_video\ComfyUI\custom_nodes\ComfyUI_wav2lip\Wav2Lip\checkpoints\wav2lip_gan.pth
Load checkpoint from: E:\VIDEO\ComfyUI_video\ComfyUI\custom_nodes\ComfyUI_wav2lip\Wav2Lip\checkpoints\wav2lip_gan.pth
0%| | 0/1 [00:00<?, ?it/s]
!!! Exception during processing!!! unexpected EOF, expected 3976502 more bytes. The file might be corrupted.
Traceback (most recent call last):
File "E:\VIDEO\ComfyUI_video\ComfyUI\execution.py", line 152, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\VIDEO\ComfyUI_video\ComfyUI\execution.py", line 82, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\VIDEO\ComfyUI_video\ComfyUI\execution.py", line 75, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\VIDEO\ComfyUI_video\ComfyUI\custom_nodes\ComfyUI_wav2lip\wav2lip.py", line 104, in process
out_img_list = wav2lip_(in_img_list, temp_audio_path, face_detect_batch, mode, model_path, framerate, lipsync_intensity, smoothing_factor)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\VIDEO\ComfyUI_video\ComfyUI\custom_nodes\ComfyUI_wav2lip\Wav2Lip\wav2lip_node.py", line 188, in wav2lip_
for i, (img_batch, mel_batch, frames, coords) in enumerate(tqdm(gen,
File "E:\VIDEO\ComfyUI_video\python_embeded\Lib\site-packages\tqdm\std.py", line 1181, in iter
for obj in iterable:
File "E:\VIDEO\ComfyUI_video\ComfyUI\custom_nodes\ComfyUI_wav2lip\Wav2Lip\wav2lip_node.py", line 86, in datagen
face_det_results = face_detect(frames, face_detect_batch)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\VIDEO\ComfyUI_video\ComfyUI\custom_nodes\ComfyUI_wav2lip\Wav2Lip\wav2lip_node.py", line 41, in face_detect
detector = face_detection.FaceAlignment(face_detection.LandmarksType._2D,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\VIDEO\ComfyUI_video\ComfyUI\custom_nodes\ComfyUI_wav2lip\Wav2Lip\face_detection\api.py", line 60, in init
self.face_detector = sfd.FaceDetector(device=device, verbose=verbose)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\VIDEO\ComfyUI_video\ComfyUI\custom_nodes\ComfyUI_wav2lip\Wav2Lip\face_detection\detection\sfd\sfd_detector.py", line 22, in init
model_weights = load_url(models_urls['s3fd'])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\VIDEO\ComfyUI_video\python_embeded\Lib\site-packages\torch\hub.py", line 770, in load_state_dict_from_url
return torch.load(cached_file, map_location=map_location, weights_only=weights_only)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\VIDEO\ComfyUI_video\python_embeded\Lib\site-packages\torch\serialization.py", line 1040, in load
return _legacy_load(opened_file, map_location, pickle_module, **pickle_load_args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\VIDEO\ComfyUI_video\python_embeded\Lib\site-packages\torch\serialization.py", line 1276, in _legacy_load
typed_storage._untyped_storage._set_from_file(
RuntimeError: unexpected EOF, expected 3976502 more bytes. The file might be corrupted.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.