jsoft88 Goto Github PK

airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

aws-serverless-streaming

AWS serverless streaming of changes in a RDBS.

cptr-vision-transformer

Implementation of the CPTR model by https://arxiv.org/pdf/2101.10804.pdf

datahub

The Metadata Platform for the Modern Data Stack

distributedprocesswatcher

Fully distributed and asynchronous Process Monitoring library

e2e_spark_streamlib_af_cp

Complete run for the generic spark streaming library available @ https://github.com/jsoft88/structured-streaming-lib

hadoop-ozone

Scalable, redundant, and distributed object store for Apache Hadoop

impala

Real-time Query for Hadoop

jcavroschemaclassbuilder

Generates a class file based on an avro schema.

jcavrotokudu

Implementation of a kafka application to take data from avro data files and insert them into a kudu table.

jcclassbuilder

Library for generating classes from schema. It provides interfaces for making process easy.

jcgenerickafka

This a generic kafka producer-consumer java library.

joyn-challenge

My design for the challenge

k8s-helper-ui

Drag 'n drop style helper for building k8s concepts, based on predefined templates and custom k8s concepts components

kudujdbhelper

Helper library for inserting data into a Kudu table or querying the information contained in a table.

mapreducejsqoophelper

Library for spliting data imported with sqoop before exporting.

play-scala

Starting interface for Sentiment Analysis

pyspark-conda-k8s

A running example of how to run a pyspark application on k8s with a conda environment

sentimentanalysis

Twitter sentiment analysis

spark-csv2mongodb

An extensible library which allows to load csv data into a mongodb using spark 2.4.6

spark-mllib-twitter-sentiment-analysis

:star2: :sparkles: Analyze and visualize Twitter Sentiment on a world map using Spark MLlib

structured-streaming-lib

A spark structured lib which can be extended to accommodate different sources, different transformation algorithms and different sinks - with a sample out of the box

webdpwmanager