Comments (3)
This is probably not going to happen. Lots of playing around has yielded weird and inconsistent results. With the same sample, running the same text multiple times, most of the time the result was good and superior to VITS. HOWEVER, on multiple occasions, the text that was read back did not exactly match what was fed in! Sometimes entire words were dropped, other times, only part of a word was spoken (streambed became stream for instance).
The other larger issue is that there's no way to predict how much text you can feed it at a time. AND since this is a "one shot" model, you need to feed the sample and new text each time, meaning you waste a lot of resources on that first pass of cloning the voice.
It may be possible to use XTTS with RVC (https://github.com/skshadan/TTS-RVC-API)? When I have time, I'll experiment and see if chaining tools like this could work to give an even better sounding reading voice.
from epub2tts.
Will not be doing this, XTTS seems nice for one-shot short clone attempts, but currently not suitable for long stuff like books.
from epub2tts.
XTTS v2 is so good, and works awesome. This has been added. It's slow (as expected), but worth the wait. Support for XTTS has been merged.
from epub2tts.
Related Issues (20)
- Add more VITS voices via piper HOT 11
- Conversion to text file adds in spaces inside of words and add extra punctuation where it is not supposed to be. HOT 4
- "Unable to import torch" error on Windows HOT 4
- UnboundLocalError every time HOT 6
- Can edge TTS be incorporated? HOT 3
- README --extract txt for --export txt HOT 1
- First chapter - Title missmatch HOT 8
- PopOS/Ubuntu installation HOT 1
- Using cloning with xtts HOT 3
- Enable integration with Metal API for accelerated generation on Apple Silicon HOT 2
- Allow voice change per chapter
- urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self signed certificate in certificate chain HOT 2
- Add a little pause between paragraphs HOT 2
- Add support for TTS which fully support Apple Silicon HOT 5
- Removing unnecessary silences is a waste of time HOT 1
- Multiple voice handling HOT 1
- A way to export to a custom folder in linux. HOT 1
- Error using epub source and default settings HOT 1
- Mac M1 problem with setup HOT 9
- Issue on audio ratio for XTTS HOT 11
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from epub2tts.