This project aims to provide a collection of machine learning tools and examples for deployment, implemented in Python and integrated with various data tools. The tools and technologies covered include Kafka, StreamLit, FastAPI, and more.
- Web Scraping
- Scraping Quotes 101: Scrapy
- Scraping ResearchGate:Scrapy + Elastic Search
- - Apache Airflow
- - Apache Kafka: Data streaming
- **NASA API: Kafka + Elastic Search + Kibana
- - Docker: Container & Virtualization
- - Apache Pyspark: Parallel processing
- - Prefect: Data Pipeline
- - FastAPI: API Development
- - StreamLit: Web GUI
- - Dash: Visualization
- - Terraform: Cloud Services