Comments (6)
from fastspeech2.
Hi, @hathubkhn. What kind of dataset are you using? How's the quality and what's the style of the speech (reading style or expressive style)? These factors affect the TTS training a lot.
To my understanding, if you want to train a high-quality TTS system, you need high-quality data. And I am also doing some experiments combining a speech enhancement system as a front-end (or as a preprocessing step). You can check this repo: https://github.com/facebookresearch/denoiser. The enhanced quality is quite good.
As for the style, if your data is expressive, like emotional, you might need another encoder to model these styles. A famous work is the Global Style Token (https://arxiv.org/abs/1803.09017). However, we do not support modeling the styles in this repo.
from fastspeech2.
Thank you for your reply. Actually, I am using KSS dataset (https://www.kaggle.com/datasets/bryanpark/korean-single-speaker-speech-dataset). The sampling rate is 22050. However, when I finished training and check some generated files. I see the performance is not good. I dont know when we use Hifi-Gan universal, doesnt it affect or not.
About dataset, this is single speaker with normal voice.
And also I have other question, if I want to combine emotion style, I have to use another encoder like you said and also I need to add other emotion loss for training that kind of data?
from fastspeech2.
eval.zip
This is result that I extracted from model. Could you help me to evaluate what is the problem? :(
from fastspeech2.
Hi, @hathubkhn
I think using Hifi-Gan can actually improve the quality. Just remember you make sure you extract the MelSpectrogram properly (consistent with your Hifi-GAN) in the preprocessing stage.
I listened to your sample. It sounds like some phonemes cannot be appropriately pronounced, but some phonemes sound okay (like the ones at the beginning). Just guessing; maybe you can check your text preprocessing to see if it transforms the text into the correcet phonemes.
You can also check if it can synthesize well for the "training data".
from fastspeech2.
Thank you,
What is happend if model transform the text into correct phonemes? Could we have any other reasons for this problem?
from fastspeech2.
Related Issues (6)
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from fastspeech2.