pawsanie / pyspark_universal_dq_report Goto Github PK
View Code? Open in Web Editor NEWThe script reads the dataset along the path and selects the columns in it received from the argument for the specified dates. Then it saves the report to the specified path of HDFS.
License: BSD Zero Clause License