loum Goto Github PK

acrta-cs

ACRTA Case Study

airflow-base

Build a vanilla base Docker image on Ubuntu

baip-loader

BAIP Loader

baip-munger

BAIP HTML munger tool

baip-munger-ui

BAIP Munger User Interface

baip-parser

baip-parser-ui

BAIP Parser User Interface

configa

daemoniser

dagsesh

Airflow DAG Session Manager

dagster

Workflow management primer

data-kafka-connect

Streaming data to/from Kafka using Kafka Connect

data-pipelines-dags

Airflow DAGs (task-level) component of a Data Workflow Management system

data-pipelines-infrastructure

Infrastructure component of a Data Workflow Management system

diffit

Report differences between two Apache Spark DataFrames

domain-intel

filester

geoutils

hadoop-hive

Quick and easy way to get Hive running in Hadoop pseudo distributed mode using docker

hadoop-object-store

Hadoop Over S3

hadoop-pseudo

Hadoop pseudo-distributed container image

hive-on-spark

Hive on Spark (using YARN) with Docker

itt

jupyter-pyspark

Jupyter Notebook (with PyPI Apache Spark)

jupyter-spark-pseudo

Jupyter Notebook (with Apache Spark on YARN over Pseudo Distributed Hadoop)

jwt-auth

klapka

Kafka pub/sub SASL over SSL

logga

Python logging made super easy!

makester

Common Infrastructure commands wrapped in Makefiles

pyjdk

Gives you Python3 and OpenJDK as a primer for PySpark (or anything else ...)