Out of memory when Inferencing a single file. about voicefilter HOT 5 CLOSED

Hello @seungwonpark ,
Thank you for the fix! Yes, I think we will have to use slicing for this. I will give it try.

from voicefilter.

Hi, @bhaveshgg17
I think I forgot to use torch.no_grad() scope when inferencing. Will you please add that and try it again?

from voicefilter.

Oh, wait. It must be because of the length of the mixed wav. 5 minutes is too long for VoiceFilter to run at once.

from voicefilter.

First, I reduced memory usage by half using torch.no_grad() scope in #6.
However, in order to use VoiceFilter system for long audio, I think we should use some kind of slicing strategy. Since we can't process the whole audio at once, we need to slice it to some pieces and process sequentially (or in batch).

from voicefilter.

i met the same problem.
error msg:
RuntimeError: CUDA out of memory. Tried to allocate 353.38 MiB (GPU 0; 7.79 GiB total capacity; 6.92 GiB already allocated; 77.56 MiB free; 35.16 MiB cached)

modify batch_size in config.yaml file, it works
batch_size=6

from voicefilter.