abandaru / datalake-etl-pipeline Goto Github PK
View Code? Open in Web Editor NEWThis project forked from vim89/datapipelines-essentials-python
Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations
License: Apache License 2.0