I have a few questions about the paper. about freevc HOT 3 CLOSED

Thank your for your interest in our work.

1. We freeze the WavLM module and use the pre-trained weights.
2. The bottleneck extractor consists of a linear projection layer that projects the WavLM feature into $d$-dim hidden representation, 16 layers of non-causal WaveNet residual blocks, and a linear projection layer that projects $d$-dim hidden representation into $2d$-dim hidden representation, which is latter split into $d$-dim $\mu_{\theta}$ and $d$-dim $\sigma_{\theta}$.
3. Yes.
4. We use the same config as the official HiFi-GAN for producing $y'$.

from freevc.

Thank you very much for your clear answer.

So it can be said that

1. The mel-spectrograms that are input to the SR-augmentation part are obtained with 22050Hz waves, using hop size 256, window size 1024 (following the config v1 of the official HiFi-GAN repository)
2. and the linear-spectrograms that are input to the posterior encoder are obtained with 16000Hz waves, using hop size 320, window size 1280 (as said in your paper, section 3.1)
3. Perhaps the waveform reconstructed after SR-augmentation and HiFi-GAN config v1 model (which will have a sampling rate 22050 Hz) is resampled to 16000Hz before inputting into WavLM?

Yes.

from freevc.

Thank you very much for your clear answer.

So it can be said that

1. The mel-spectrograms that are input to the SR-augmentation part are obtained with 22050Hz waves, using hop size 256, window size 1024 (following the config v1 of the official HiFi-GAN repository)
2. and the linear-spectrograms that are input to the posterior encoder are obtained with 16000Hz waves, using hop size 320, window size 1280 (as said in your paper, section 3.1)
3. Perhaps the waveform reconstructed after SR-augmentation and HiFi-GAN config v1 model (which will have a sampling rate 22050 Hz) is resampled to 16000Hz before inputting into WavLM?

from freevc.