This project is using for demo to FA about how to initialize a project and draft data pipeline
Building the data pipeline
- Design data pipeline here
- Normalize and Denormalize data
- Build data model
- Ingest data from flat file
- Extract and Load into Data warehouse
- Load data onto Cloud with the transformation
- Enrich data with different data sources
- Visualize your data
- Login into MSSQL and run init_mssql.sql
- Authen SnowSQL and run init_snowflake.sql
- Generate data:
python data-generator.py