This repo is a collection of Azure Data Factory projects.
List of projects to cover:
1. copy from http to azure blob storage.
2. copy from azure blob storage to azure datalake gen 2.
3. Impementing SCD2 logic with Data Flow in ADF
4. Implementing azure databricks in pipeline.
5. Using DataFlow to transform data into meaningful pipeline.
6. Publishing ADF projects to github and maintaining code as a part of CI/CD devOps
https://docs.microsoft.com/en-us/azure/data-factory/
I am a passionate Data Engineer