chou2008 / esp-va-sdk Goto Github PK

The ESP-Voice-Assistant SDK provides an implementation of Amazon's Alexa Voice Service, Google Voice Assistant and Google's conversational interface (aka Dialogflow) for ESP32 microcontroller. This facilitates the developers directly run these voice-assistants on an ESP32. The SDK will run on hardware boards that have Microphone/Speaker interfaced with the ESP32.

Please refer to Changelog to track release changes and known-issues.

The SDK contains pre-built libraries for Amazon Alexa, Google Voice Assistant (GVA) and Google Dialogflow along with sources of some of the utility components such as audio pipeline and connection manager. Below are the list of some of the features supported for each voice assistant:

• Amazon Alexa:

  • Basic conversation
  • Multi-turn conversations
  • Audio Streaming and Playback
  • Audio Book Support: Kindle, Audible
  • Volume control via voice command
  • Seek support for Audible
  • Alarms, Timers, Reminders, Notifications

• Google Voice Assistant:

  • Basic conversation
  • Multi-turn conversations
  • Getting weather reports
  • Multiple language support

• Google Dialogflow:

  • Basic conversation
  • Multi-turn conversations
  • Configure and control connected devices via voice, e.g "Start the Laundry"
  • Multiple language support

The SDK supports the following hardware platforms:

• ESP32-LyraT
• ESP32-LyraTD-MSC

The following list of acoustic front-ends is also supported. Please contact Espressif to enable acccess to these solutions.

• DSPG DBMD5P
• Intel s1000
• Synaptics CX20921

• Follow the Getting Started Guide to clone the required repositories and to compile and flash the firmware.
• When flashing the SDK for the first time, it is recommended to do make erase_flash to wipe out entire flash and start out fresh.
• Once you have the firmware flashed, visit the following pages for interacting with the device:
  • Alexa
  • Google Voice Assistant
  • DialogFlow
• If you are updating from previous release, please check the Upgrading from Previous Release section from the Getting Started Guide to know about any specific actions that needs to be taken while upgrading.