Giter Club home page Giter Club logo

neon-tts-plugin-larynx_server's Introduction

Description

TTS plugin for Larynx

Install

pip install neon-tts-plugin-larynx-server

Configuration

  "tts": {
    "module": "neon-tts-plugin-larynx-server",
    "neon-tts-plugin-larynx-server": {
      "host": "http://138.68.25.242:5002",
      "voice": "mary_ann",
      "vocoder": "hifi_gan/vctk_small"
    }
 }

⚠️ depending on where larynx is hosted different voices and vocoders might be available, see below for default list

  • host - url where larynx is running
  • voice - additional voices can be downloaded in the web interface, default mary_ann
  • vocoder - recommend using hifi_gan/vctk_small for performance reasons, other options are hifi_gan/universal_medium and hifi_gan/universal_large
  • noise - Volatility of speaker (0-1, default: 0.333)
  • denoiser - Strength of vocoder denoiser (0-1, 0 is disabled)
  • length - Speed of speaker (default: 1.0, faster < 1 < slower)

Voices

the config will accept either the name or voice_id

{'bart_de_leeuw': 'nl/bart_de_leeuw-glow_tts',
 'biblia_takatifu': 'sw/biblia_takatifu-glow_tts',
 'blizzard_fls': 'en-us/blizzard_fls-glow_tts',
 'blizzard_lessac': 'en-us/blizzard_lessac-glow_tts',
 'carlfm': 'es-es/carlfm-glow_tts',
 'cmu_aew': 'en-us/cmu_aew-glow_tts',
 'cmu_ahw': 'en-us/cmu_ahw-glow_tts',
 'cmu_aup': 'en-us/cmu_aup-glow_tts',
 'cmu_bdl': 'en-us/cmu_bdl-glow_tts',
 'cmu_clb': 'en-us/cmu_clb-glow_tts',
 'cmu_eey': 'en-us/cmu_eey-glow_tts',
 'cmu_fem': 'en-us/cmu_fem-glow_tts',
 'cmu_jmk': 'en-us/cmu_jmk-glow_tts',
 'cmu_ksp': 'en-us/cmu_ksp-glow_tts',
 'cmu_ljm': 'en-us/cmu_ljm-glow_tts',
 'cmu_lnh': 'en-us/cmu_lnh-glow_tts',
 'cmu_rms': 'en-us/cmu_rms-glow_tts',
 'cmu_rxr': 'en-us/cmu_rxr-glow_tts',
 'cmu_slp': 'en-us/cmu_slp-glow_tts',
 'cmu_slt': 'en-us/cmu_slt-glow_tts',
 'ek': 'en-us/ek-glow_tts',
 'eva_k': 'de-de/eva_k-glow_tts',
 'flemishguy': 'nl/flemishguy-glow_tts',
 'gilles_le_blanc': 'fr-fr/gilles_le_blanc-glow_tts',
 'hajdurova': 'ru-ru/hajdurova-glow_tts',
 'harvard': 'en-us/harvard-glow_tts',
 'hokuspokus': 'de-de/hokuspokus-glow_tts',
 'judy_bieber': 'en-us/judy_bieber-glow_tts',
 'karen_savage': 'es-es/karen_savage-glow_tts',
 'karlsson': 'de-de/karlsson-glow_tts',
 'kathleen': 'en-us/kathleen-glow_tts',
 'kerstin': 'de-de/kerstin-glow_tts',
 'lisa': 'it-it/lisa-glow_tts',
 'ljspeech': 'en-us/ljspeech-glow_tts',
 'mary_ann': 'en-us/mary_ann-glow_tts',
 'minaev': 'ru-ru/minaev-glow_tts',
 'nathalie': 'nl/nathalie-glow_tts',
 'nikolaev': 'ru-ru/nikolaev-glow_tts',
 'northern_english_male': 'en-us/northern_english_male-glow_tts',
 'pavoque': 'de-de/pavoque-glow_tts',
 'rdh': 'nl/rdh-glow_tts',
 'rebecca_braunert_plunkett': 'de-de/rebecca_braunert_plunkett-glow_tts',
 'riccardo_fasol': 'it-it/riccardo_fasol-glow_tts',
 'scottish_english_male': 'en-us/scottish_english_male-glow_tts',
 'siwis': 'fr-fr/siwis-glow_tts',
 'southern_english_female': 'en-us/southern_english_female-glow_tts',
 'southern_english_male': 'en-us/southern_english_male-glow_tts',
 'talesyntese': 'sv-se/talesyntese-glow_tts',
 'thorsten': 'de-de/thorsten-glow_tts',
 'tom': 'fr-fr/tom-glow_tts'}

neon-tts-plugin-larynx_server's People

Contributors

builderjer avatar jarbasal avatar neondaniel avatar neonjarbas avatar

Stargazers

avatar avatar avatar avatar

Watchers

avatar avatar

Forkers

neonjarbas neonvitaliy builderjer jarbasal

neon-tts-plugin-larynx_server's Issues

unable to install: No matching distribution found

I get the following output when running pip install neon-tts-plugin-larynx-server :

Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
ERROR: Could not find a version that satisfies the requirement neon-tts-plugin-larynx-server (from versions: none)
ERROR: No matching distribution found for neon-tts-plugin-larynx-server

platform i tested on is a raspberry pi 4 with the 64-bit OS.

Host configuration seems to be ignored and defaults to the Neon hosted instance

For example, I define the host and the port here:

config_larynx = {
        "host": larynx_host,
        "voice": voice,
        "vocoder": "hifi_gan/universal_large",
    }

When I run the script with let's say a host of: "127.0.0.1:5002", I see nothing in the logs of my local instance, however when I run TTS via the front end of my local instance, I see the logs reporting the usage.

Also I do get an output of the correct TTS files.

Either I am doing something totally wrong (which is always a possibility), there are no logs in Larynx when you run it via this script(?), or the plugin is ignoring the host config and using the default (Neon) instance.

Error loading plugin

I've been working on trying to get this to work with the latest ovos-core and such. The first issue was neon-utils was clashing at some point. The only thing that was used from it was a parser to use ssml. I eliminated that and things started loading. After changing a few other things, I came across an error that I don't know where to go to next.

2022-02-25 03:38:32.511 - OVOS - mycroft.audio.speech:mute_and_speak:99 - ERROR - TTS execution failed.
Traceback (most recent call last):
  File "/usr/lib/python3.8/site-packages/mycroft/audio/speech.py", line 94, in mute_and_speak
    tts.execute(utterance, ident, listen)
  File "/home/mycroft/.local/lib/python3.8/site-packages/ovos_plugin_manager/templates/tts.py", line 552, in execute
    self._execute(sentence, ident, listen, **kwargs)
  File "/home/mycroft/.local/lib/python3.8/site-packages/ovos_plugin_manager/templates/tts.py", line 575, in _execute
    if sentence_hash in self.cache:  # load from cache
  File "/home/mycroft/.local/lib/python3.8/site-packages/ovos_plugin_manager/templates/tts.py", line 372, in cache
    return self.caches[self.tts_id]
KeyError: 'LarynxServerTTSPlugin/northern_english_male-glow_tts/en-us'

self.caches = {'LarynxServerTTSPlugin/northern_english_male/en-us': <ovos_plugin_manager.utils.tts_cache.TextToSpeechCache object at 0x7f6e5f1040>}

so I think the key is there, so I don't know where to go next. Maybe in OPM

this commit are the changes I made.

Add Automation for PyPI

  • Ensure setup.py parameters are correct
  • Add publish_release, publish_test_build, and pull_master workflows
  • Ensure unit tests all pass
  • Open PR to NeonGeckoCom/dev
  • After PR is approved/merged, open separate PR incrementing version to next 0.x.0
  • Merge version bump PR
  • Merge PR to master closing this issue

Example automation available here: https://github.com/NeonGeckoCom/neon-tts-plugin-polly

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.