s-o-p pronunciation , high-low tone distortion about freevc HOT 5 CLOSED

1. I didn't notice the distortion in s-o-p pronunciation before, it's an interesting finding. Is it occurred in words like 'Ok', 'appleS', 'helP', etc.? Maybe that's because these pronunciations are harder to model?
2. I don't quite understand what the second problem is, what does 'rather than target speaker data' mean?

Maybe provide extra knowledges like pitch to the model can solve these problems?
So far the only distortion-related objective metric I know is WER/CER/PER.

from freevc.

I have Noticed the same, when a model is fine tuned to a specific speaker, the S sounds are really bad, so anything ending in S especially if its a longer S. I have only noticed it with S sounds though, I havent seen a problem with P or O.

Its a metallic sound, like phase offset from the vocoder.

I think he meant the output is not that of the target speaker?

from freevc.

1. I didn't notice the distortion in s-o-p pronunciation before, it's an interesting finding. Is it occurred in words like 'Ok', 'appleS', 'helP', etc.? Maybe that's because these pronunciations are harder to model?
2. I don't quite understand what the second problem is, what does 'rather than target speaker data' mean?

Maybe provide extra knowledges like pitch to the model can solve these problems? So far the only distortion-related objective metric I know is WER/CER/PER.

1. Yes that error is generated from time to time.
2. That means if the pitch or pronunciation in the source wav is not in the target, distortion occurs.

While looking for other augmentation methods, I found that there is a 'stretch function in utils.py'. Have you ever tested horizontal augmentation?

from freevc.

it'll be harder to convert if the voice of source and target are very different.
i did not use horizontal augmentation because it does not change the speaker information of source wav.
btw i'd like to share some files: ↓

i think, by applying different vertical sr rates in a wav, the augmentation can be stronger and help the disentanglement better.

from freevc.

Thanks very much for answering.

from freevc.