Running AVSR model in colab causes kernel to restart about av_hubert HOT 3 OPEN

@nastia-lado did you change anything inside the notebook? I just ran it and it works fine.

from av_hubert.

Hi! @chevalierNoir! Thanks a lot for your reply.
Yes, I changed the notebook because I tried to use audiovisual model

1. I tried downloading AV model instead of V presented in the original notebook
   !wget https://dl.fbaipublicfiles.com/avhubert/model/lrs3_vox/avsr/base_noise_pt_noise_ft_30h.pt
2. In function predict, the line with modalities changed:
   modalities = ["audio", "video"]
3. The line with prediction also changed - I've added audio file:
   hypo = predict(mouth_roi_path, audio_path, ckpt_path, user_dir)

from av_hubert.

@nastia-lado Did you ever get the audiovisual model to work? Trying to run it on my end.

from av_hubert.