abhishek6s Goto Github PK

amazon-codeguru-profiler-for-spark

A Spark plugin for CPU and memory profiling

awesome-low-level-design

Learn Low Level Design (LLD) and prepare for interviews using free resources.

awesome-opensource-data-engineering

An Awesome List of Open-Source Data Engineering Projects

awesome-spark

A curated list of awesome Apache Spark packages and resources.

awesome-system-design-resources

Learn System Design concepts and prepare for interviews using free resources.

build-your-own-x

Master programming by recreating your favorite technologies from scratch.

c2-recipe-app-api-2

cert-manager

Automatically provision and manage TLS certificates in Kubernetes

dolphinscheduler

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code

great_expectations

Always know what to expect from your data.

iceberg

Apache Iceberg

incubator-livy

Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.

incubator-toree

Mirror of Apache Toree (Incubating)

india-mutual-fund-ter-tracker

Tracking Total Expense Ratios of Indian Mutual Funds. Automatically updated daily.

java-jmx-in-docker-sample-app

A sample Java app to expose a JMX port from a JVM running inside a Docker container

lighter

REST API for Apache Spark on K8S or YARN

openmetadata

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.

pinot

Apache Pinot - A realtime distributed OLAP datastore

pinot-docs

Apache Pinot Documentation

project_3d_developer_portfolio

The most impressive websites in the world use 3D graphics and animations to bring their content to life. Learn how to build your own ThreeJS 3D Developer Portfolio today!

pyhive

Python interface to Hive and Presto. 🐝

s3committer

Hadoop output committers for S3

snakebite

A pure python HDFS client

spark

Apache Spark - A unified analytics engine for large-scale data processing

spark-on-kubernetes-helm

Spark on Kubernetes infrastructure Helm charts repo

spark-profiler

sparkexecutorplugins2.4

Spark Executor Plugins Examples for Spark 2.4

sparkplugins

Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are initialized. This also allows extending the Spark metrics systems with user-provided monitoring probes.

trino-by-example

Presto Trino with Apache Hive Postgres metastore

trino-local-setup

trino local setup