create-speech-to-text-pipeline / pipeline Goto Github PK

using react

• The tag shall be used in front-end applications to communicate with your Kafka cluster - present a sentence to be read by a user and send back audio and other necessary metadata to your Kafka cluster.

• You should look at the following to understand how an app or a browser captures and sends audio and text events to your kafka cluster
  Using the MediaStream Recording API - Web APIs | MDN (mozilla.org)
  Handling Large Messages with Apache Kafka (CSV, XML, Image, Video, Audio, Files) - Kai Waehner (kai-waehner.de)

• Based on Installing a Kafka Cluster and Creating a Topic - Hands-on Labs | A Cloud Guru, set up a cluster in your assigned AWS machine.

• Your cluster will be responsible for creating a Delta Lake - a bucket in S3 where Spark transformed streaming data from users reading the texts you showed them are stored. (hint You will write a code that can generate an ID for a randomly selected text and its audio equivalent, receives an ID from an API, sends back as json the ID + audio to Kafka like URL

• Build or simulate a Kafka event source for the text corpus - you should read Breaking News: Everything Is An Event! (Streams, Kafka And You) (florimond.dev)

• Develop an overview of your approach and document it. Explain why this approach and why these tools. Explain how this approach will provide a good data source for the clients’ speech-to-text ML engine. Explain the purpose of each of these tools - should defend it if one asks them why, not simple python code.

Jupyter notebook that illustrate your data exploration with professional plots, readable axes labels, title, and legend; good choice of color

prepare API endpoints for kafka - using flask

linked to #11

• Using PySpark, write code that will transform and load the data from the data lake
• By using Kafka as an input source for Spark Structured Streaming and Delta Lake as a storage layer, build a complete streaming data pipeline to consolidate our data - you should read From Kafka to Delta Lake using Apache Spark Structured Streaming (michelin.io)