media_nlp

apply nlp to breaking news from various websites and youtube videos

To run youtube script

make sure YOUTUBE_API_KEY is set and

python3 scripts/main.py

to run the astro script

cd website
yarn build

In order to find the channel id for stonks, after viewing a video from that channel click on the channel name on the video and the channel id will be shown.

As for finding videos, you have to inspect iframes and find where the video is being loaded from and then run assemblyAi on that video file to extract the transcript

Objectives

Fix the weaknesses from ytube_nlp and leverage the ability of astro to serve various youtube transcripts as json

• [] improve nlp format with my expanded knowledge
• [] improve emails sent out and improve discord integration
• [] tagging so I can search for videos by /tag
• [] single csv as before with redesigned format
• [] reuse code that is available
• [] support other media formats such as articles and/or hardcoded audio via assemblyai (transcript calls not available on youtube)
• [] astro format to support tags, view https://stackblitz.com/github/withastro/astro/tree/latest/examples/blog-multiple-authors?file=src%2Fpages%2Fauthors%2F[author].astro&on=stackblitz as an example