pascals-ager Goto Github PK

aiomultiprocess

Take a modern Python codebase to the next level of performance.

autoschema

Generates JSON Schema from Scala classes

avro-ddl-tool

Tool to generate Database Definition Langauge Statements from Avro Schemas

avro-sql

Use SQL to transform your avro schema/records

avrohugger

Generate Scala case class definitions from Avro schemas

big-data-containers

This Repo builds upon previous work to integrate Zookeeper, Schema Registry, Kafka, Spark, Yarn, Hive, Postrgres Metastore and three node Hadoop to provide an easily accessible Big Data Development environment

cloudflow

Cloudflow enables users to quickly develop, orchestrate, and operate distributed streaming applications on Kubernetes.

data-model-generator

Data model generator based on Scala case classes

deployment-systemd

Deployment scripts to configure passwordless sudo, ssh, iptables, self-signed certificates, nginx and also set up the a web app , postgres, and nginx as on-boot services in a remote server using systemd unit files. The repo also contains git post-receive hooks to trigger builds on push to remote git repository.

fast-data-dev

Kafka Docker for development. Kafka, Zookeeper, Schema Registry, Kafka-Connect, Landoop Tools, 20+ connectors

federalreserve-python

Flask app to read federal reserve data and incrementally persist to a postgresql database

fixerapi

Slurp data from the Fixer API

flask-nginx-docker

Recipes to provision staging (debian) and development servers; deploy a dockerized nginx, flask and postgres application to the staging server using systemd units and git hooks.

frameless

Expressive types for Spark.

fs2-avro-producer

FS2 demo to produce Avro records to a Kafka topic

fs2-hive

FS2 bindings for Apache Hive3 ACID Streaming API

fs2-window-tests

Implementing time windows from scratch on fs2

fs2kstreams

Typed Compositional Kafka to Kafka Stream using fs2

hadoop-streaming

Lest I forget.

japronto

Screaming-fast Python 3.5+ HTTP toolkit integrated with pipelining HTTP server based on uvloop and picohttpparser.

jolt

JSON to JSON transformation library written in Java.

k8s-kafka-playground

A Kafka playground using the Strimzi Operator

kafka-connect-redshift

Kafka Sink Connector for Amazon Redshift

kafka-spark-avro-streaming

A streaming pipeline between Kafka and Spark using Avro schema registry

librdkafka

The Apache Kafka C/C++ library

openvswitch-event-processing

Implementation of an event processing framework within a DPDK accelerated Open vSwitch. The implemented framework embeds the vSwitch with capabilities to detect and process L7 events based on configured event rules. Additionally, an SDN controller based northbound API is implemented to offload application rules onto the vSwitch remotely.

ossrh-56282

Public repo to publish Sonatype Artifacts

postgres-k8s

Postgresql minikube deployment and service for quick development set ups

postgres-utilities

pyox

A simple REST client library for Hadoop / Knox in Python