Topic: apache-kafka Goto Github

Some thing interesting about apache-kafka

👇 Here are 1098 public repositories matching this topic...

airscholar / e2e-data-engineering

apache-kafka,An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.

User: airscholar

Home Page: https://www.youtube.com/watch?v=GqAcTrqKcrY

apache-airflow apache-kafka apache-spark apache-zookeeper big-data cassandra containerization data-engineering data-pipeline data-processing data-storage docker etl-pipeline postgresql real-time-analytics

aiven-open / klaw

apache-kafka,Klaw, the latest OS tool by Aiven, helps enterprises cope with Apache Kafka(r) topics, schema registry and connectors governance by introducing roles/authorizations to users of various teams of an org.

Organization: aiven-open

Home Page: https://www.klaw-project.io/

apache-kafka governance kafka kafka-connect kafka-governance

artie-labs / transfer

apache-kafka,Database replication platform that leverages change data capture. Stream production data from databases to your data warehouse (Snowflake, BigQuery, Redshift) in real-time.

Organization: artie-labs

Home Page: https://artie.com

snowflake cdc change-data-capture golang bigquery kafka apache-kafka data-integration data-pipelines database

azure / azure-event-hubs-for-kafka

apache-kafka,Azure Event Hubs for Apache Kafka Ecosystems

Organization: azure

Home Page: https://docs.microsoft.com/azure/event-hubs/event-hubs-for-kafka-ecosystem-overview

azure eventhubs event-hubs microsoft messaging apache-kafka apache kafka

ballerina-platform / module-ballerinax-kafka

apache-kafka,Ballerina Kafka Module.

Organization: ballerina-platform

Home Page: http://www.ballerina.io

ballerina kafka apache-kafka messaging ballerina-lang

bogdanp / franz

apache-kafka,A desktop client for Apache Kafka.

User: bogdanp

Home Page: https://franz.defn.io

apache-kafka kafka kafka-client racket redpanda swift swiftui

ches / docker-kafka

apache-kafka,Apache Kafka on Docker

User: ches

Home Page: https://hub.docker.com/r/ches/kafka/

apache-kafka kafka docker docker-image

confluentinc / cp-all-in-one

apache-kafka,docker-compose.yml files for cp-all-in-one , cp-all-in-one-community, cp-all-in-one-cloud, Apache Kafka Confluent Platform

Organization: confluentinc

quickstart apache-kafka kafka confluent confluent-platform docker-compose kraft

confluentinc / cp-helm-charts

apache-kafka,The Confluent Platform Helm charts enable you to deploy Confluent Platform services on Kubernetes for development, test, and proof of concept environments.

Organization: confluentinc

Home Page: https://cnfl.io/getting-started-kafka-kubernetes

kubernetes statefulsets zookeeper apache-kafka helm-charts helm kafka-connect kafka-rest-proxy ksql ksql-server

consdata / kouncil

apache-kafka,Powerful dashboard for your Kafka. Monitor status, manage groups, topics, send messages and diagnose problems. All in one user friendly web dashboard.

Organization: consdata

kafka kafka-ui kafka-companion docker topics dashboard open-source gui ui kafka-tools

debezium / debezium

apache-kafka,Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.

Organization: debezium

Home Page: https://debezium.io

change-data-capture kafka-connect apache-kafka debezium cdc database kafka kafka-producer event-streaming

deviceinsight / kafkactl

apache-kafka,Command Line Tool for managing Apache Kafka

Organization: deviceinsight

Home Page: https://deviceinsight.github.io/kafkactl/

apache-kafka avro cli kafka golang zsh fish

farfetch / kafkaflow

apache-kafka,Apache Kafka .NET Framework to create applications simple to use and extend.

Organization: farfetch

Home Page: https://farfetch.github.io/kafkaflow/

kafka dotnet csharp kaflaflow farfetch nuget middlewares consumer workers dotnetcore

fgeller / kt

apache-kafka,Kafka command line tool that likes JSON

User: fgeller

kafka json golang cli apache-kafka

gvolpe / trading

apache-kafka,💱 Trading application written in Scala 3 that showcases an Event-Driven Architecture (EDA) and Functional Programming (FP)

User: gvolpe

Home Page: https://leanpub.com/feda

event-driven-architecture functional-programming fp eda fs2 cats-effect apache-pulsar apache-kafka elm-lang elm-architecture

harry-027 / go-notify

apache-kafka,An email automation solution, written in Golang.

User: harry-027

go golang gofiber cobra apache-kafka redis postgres k6 prometheus grafana

infoslack / awesome-kafka

apache-kafka,A list about Apache Kafka

User: infoslack

kafka streaming-data data-pipeline stream-processing apache-kafka apache-spark kafka-streams infrastructure data-processing

jaceklaskowski / kafka-notebook

apache-kafka,The Internals of Apache Kafka

User: jaceklaskowski

Home Page: https://bit.ly/apache-kafka-internals

apache-kafka gitbook internals

joowani / kq

apache-kafka,Kafka-based Job Queue for Python

User: joowani

Home Page: http://kq.readthedocs.io

kafka job-queue python kafka-client kafka-consumer kafka-producer python3 queueing apache-kafka worker-queue

kafbat / kafka-ui

apache-kafka,Open-Source Web UI for managing Apache Kafka clusters

Organization: kafbat

Home Page: http://ui.docs.kafbat.io

apache-kafka big-data cluster-management event-streaming hacktoberfest kafka kafka-brokers kafka-client kafka-cluster kafka-connect

kafkakru / meetup

apache-kafka,Kafka 한국 사용자 모임에서 운영하는 meetup repository

Organization: kafkakru

kafka apache-kafka

kaiwaehner / tensorflow-serving-java-grpc-kafka-streams

apache-kafka,Kafka Streams + Java + gRPC + TensorFlow Serving => Stream Processing combined with RPC / Request-Response

User: kaiwaehner

apache kafka kafka-streams apache-kafka confluent grpc grpc-java tensorflow tensorflow-serving deeplearning

karafka / karafka

apache-kafka,Ruby and Rails efficient Kafka processing framework

Organization: karafka

Home Page: https://karafka.io

karafka-framework kafka kafka-client kafka-clients kafka-producer kafka-consumer apache-kafka ruby rails kafka-ruby

karafka / rdkafka-ruby

apache-kafka,Modern and performant Kafka client library for Ruby based on librdkafka

Organization: karafka

Home Page: https://karafka.io

ruby kafka librdkafka apache-kafka apache-kafka-consumer apache-kafka-producer

karafka / waterdrop

apache-kafka,Standalone Karafka library for producing Kafka messages

Organization: karafka

Home Page: https://karafka.io

waterdrop ruby-kafka karafka-framework karafka karafka-application kafka apache-kafka rubygems rubygem ruby apache-kafka-producer

kcctl / kcctl

apache-kafka,A modern and intuitive command line client for Kafka Connect

Organization: kcctl

apache-kafka kafka-connect cli

kroxylicious / kroxylicious

apache-kafka,An open-source network proxy framework for Apache Kafka

Organization: kroxylicious

Home Page: https://kroxylicious.io

apache-kafka java kafka

learningjournal / apachekafkatutorials

apache-kafka,Example Code for Kafka Tutorials @ Learning Journal

User: learningjournal

apache-kafka java kafka-client kafka-producer kafka-consumer kafka-topic

learningjournal / kafka-streams-real-time-stream-processing

apache-kafka,This is the central repository for all materials related to Kafka Streams : Real-time Stream Processing! Book by Prashant Pandey.

User: learningjournal

kafka-streams stream-processing apache-kafka real-time-stream-processing java-8 kafka-client kafka-producer kafka streams messaging-system

mfontanini / cppkafka

apache-kafka,Modern C++ Apache Kafka client library (wrapper for librdkafka)

User: mfontanini

apache-kafka kafka librdkafka rdkafka

miguno / kafka-storm-starter

apache-kafka,[PROJECT IS NO LONGER MAINTAINED] Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

User: miguno

Home Page: http://www.michael-noll.com/blog/2014/05/27/kafka-storm-integration-example-tutorial/

apache-kafka kafka apache-storm storm spark apache-spark scala integration avro apache-avro

miguno / wirbelsturm

apache-kafka,[PROJECT IS NO LONGER MAINTAINED] Wirbelsturm is a Vagrant and Puppet based tool to perform 1-click local and remote deployments, with a focus on big data tech like Kafka.

User: miguno

Home Page: http://www.michael-noll.com/blog/2014/03/17/wirbelsturm-one-click-deploy-storm-kafka-clusters-with-vagrant-puppet/

apache-kafka apache-spark apache-storm kafka puppet spark storm vagrant

mmolimar / kafka-connect-fs

apache-kafka,Kafka Connect FileSystem Connector

User: mmolimar

confluent kafka apache-kafka kafka-connector kafka-connect hadoop filesystem hdfs kafka-connect-fs files

mmolimar / kukulcan

apache-kafka,A REPL for Apache Kafka

User: mmolimar

kafka apache-kafka repl shell kafka-repl kafka-shell ammonite kafka-connect kafka-streams kafka-admin

mostafa / xk6-kafka

apache-kafka,k6 extension to load test Apache Kafka with support for various serialization formats, SASL, TLS, compression, Schema Registry client and beyond

User: mostafa

k6 kafka apache-kafka load-testing performance-testing avro extension xk6 jsonschema json-schema

oryxproject / oryx

apache-kafka,Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

Organization: oryxproject

Home Page: http://oryx.io

lambda-architecture oryx apache-spark machine-learning kafka apache-kafka java cloudera

oslabs-beta / atomickafka

apache-kafka,

Organization: oslabs-beta

kafka kafka-clusters websocket consumer producer react typescript javascript apache apache-kafka

oslabs-beta / kafka-sprout

apache-kafka,:rocket: Web GUI for Kafka Cluster Management

Organization: oslabs-beta

apache apache-kafka developer-tools java kafka spring-boot typescript

ovotech / kafka-serialization

apache-kafka,Lego bricks to build Apache Kafka serializers and deserializers

Organization: ovotech

apache-kafka serialization json circe avro4s avro json4s spray-json company-kaluza

parsely / pykafka

apache-kafka,Apache Kafka client for Python; high-level & low-level consumer/producer, with great performance.

Organization: parsely

Home Page: http://pykafka.readthedocs.org/

kafka python c-extension apache-kafka

ppatierno / formula1-telemetry-kafka

apache-kafka,

User: ppatierno

kafka kafka-influxdb udp-kafka telemetry-data telemetry-events grafana influxdb kafka-streams formula1 apache-camel

provectus / kafka-ui

apache-kafka,Open-Source Web UI for Apache Kafka Management

Organization: provectus

kafka-ui kafka-brokers kafka kafka-streams kafka-client opensource kafka-connect kafka-producer streams big-data

raystack / dagger

apache-kafka,Dagger is an easy-to-use, configuration over code, cloud-native framework built on top of Apache Flink for stateful processing of real-time streaming data.

Organization: raystack

Home Page: https://raystack.github.io/dagger/

stream-processing framework apache-flink apache-kafka real-time-processing real-time-analytics prometheus influxdb dataops

raystack / firehose

apache-kafka,Firehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems.

Organization: raystack

Home Page: https://raystack.github.io/firehose/

kafka sink streaming firehose dataops bigquery postgresql influxdb prometheus apache-kafka

redpanda-data / console

apache-kafka,Redpanda Console is a developer-friendly UI for managing your Kafka/Redpanda workloads. Console gives you a simple, interactive approach for gaining visibility into your topics, masking data, managing consumer groups, and exploring real-time data with time-travel debugging.

Organization: redpanda-data

Home Page: https://redpanda.com

apache-kafka dataops go kafka kafka-gui kafka-ui react typescript web-ui

rjurney / agile_data_code_2

apache-kafka,Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

User: rjurney

Home Page: http://bit.ly/agile_data_science

data-syndrome data data-science analytics apache-spark apache-kafka kafka spark predictive-analytics machine-learning

streamnative / kop

apache-kafka,Kafka-on-Pulsar - A protocol handler that brings native Kafka protocol to Apache Pulsar

Organization: streamnative

Home Page: https://streamnative.io/docs/kop

apache-pulsar apache-kafka pubsub event-streaming kafka-on-pulsar kop pub-sub dotnet pulsar kafka

streamthoughts / azkarra-streams

apache-kafka,🚀 Azkarra is a lightweight java framework to make it easy to develop, deploy and manage cloud-native streaming microservices based on Apache Kafka Streams.

Organization: streamthoughts

Home Page: https://www.azkarrastreams.io/