Topic: kafka-connect Goto Github

👇 Here are 690 public repositories matching this topic...

aiven-open / klaw
kafka-connect,Klaw, the latest OS tool by Aiven, helps enterprises cope with Apache Kafka(r) topics, schema registry and connectors governance by introducing roles/authorizations to users of various teams of an org.
Organization: aiven-open
Home Page: https://www.klaw-project.io/
apache-kafka governance kafka kafka-connect kafka-governance

altinity / clickhouse-sink-connector
kafka-connect,Replicate data from MySQL, Postgres and MongoDB to ClickHouse
Organization: altinity
Home Page: https://www.altinity.com
avro kafka kafka-connect clickhouse postgresql replication cdc debezium mysql mongo

averemee-si / oracdc
kafka-connect,Oracle database CDC (Change Data Capture)
User: averemee-si
Home Page: http://a2-solutions.eu/
oracle-database oraclegoldengate cdc change-data-capture kafka kafka-connect amazon amazon-web-services aws aws-msk

bitbouncer / kspp
kafka-connect,A high performance/ real-time C++ Kafka streams framework (C++17)
Organization: bitbouncer
kafka kafka-streams librdkafka cpp cpp17 cpp17-library stream-processing kafka-connect

blueapron / kafka-connect-protobuf-converter
kafka-connect,Protobuf converter plugin for Kafka Connect
Organization: blueapron
kafka kafka-connect protocol-buffers protobuf-converter jar data data-platform protobuf

camunda-community-hub / kafka-connect-zeebe
kafka-connect,Kafka Connect for Zeebe.io
Organization: camunda-community-hub
zeebe kafka kafka-connect camunda-8

castorm / kafka-connect-http
kafka-connect,Kafka Connect connector that enables Change Data Capture from JSON/HTTP APIs into Kafka.
User: castorm
Home Page: https://castorm.github.io/kafka-connect-http/
kafka kafka-connect connectors http rest source connector cdc change-data-capture api json source-connector confluent-hub

clickhouse / clickhouse-kafka-connect
kafka-connect,ClickHouse Kafka Connector
Organization: clickhouse
clickhouse kafka kafka-connect sink

confluentinc / cp-ansible
kafka-connect,Ansible playbooks for the Confluent Platform
Organization: confluentinc
ansible confluent playbook kafka kafka-connect ksql rest-proxy schema-registry

confluentinc / cp-helm-charts
kafka-connect,The Confluent Platform Helm charts enable you to deploy Confluent Platform services on Kubernetes for development, test, and proof of concept environments.
Organization: confluentinc
Home Page: https://cnfl.io/getting-started-kafka-kubernetes
kubernetes statefulsets zookeeper apache-kafka helm-charts helm kafka-connect kafka-rest-proxy ksql ksql-server

confluentinc / demo-scene
kafka-connect,👾Scripts and samples to support Confluent Demos and Talks. ⚠️Might be rough around the edges ;-) 👉For automated tutorials and QA'd code, see https://github.com/confluentinc/examples/
Organization: confluentinc
Home Page: https://developer.confluent.io
kafka ksql elasticsearch syslog mysql debezium kafka-streams kafka-connect ksqldb demo

confluentinc / kafka-connect-elasticsearch
kafka-connect,Kafka Connect Elasticsearch connector
Organization: confluentinc
confluent elasticsearch kafka kafka-connect kafka-connector

confluentinc / kafka-connect-storage-cloud
kafka-connect,Kafka Connect suite of connectors for Cloud storage (Amazon S3)
Organization: confluentinc
kafka kafka-connect confluent cloud s3 aws aws-s3

confluentinc / ksql
kafka-connect,The database purpose-built for stream processing applications.
Organization: confluentinc
Home Page: https://ksqldb.io
stream-processing real-time sql interactive kafka kafka-connect materialized-views ksqldb ksqldb-documentation ksqldb-tutorials streaming-queries event-streaming-database

damklis / dataengineeringproject
kafka-connect,Example end to end data engineering project.
User: damklis
big-data scraping mongodb elasticsearch data-engineering kafka kafka-connect debezium django-rest-framework redis

ddd-by-examples / all-things-cqrs
kafka-connect,Comprehensive guide to a couple of possible ways of synchronizing two states with Spring tools. Synchronization is shown by separating command and queries in a simple CQRS application.
Organization: ddd-by-examples
cqrs ddd domain-driven-design events spring spring-boot kafka kafka-connect debezium mongodb

debezium / debezium
kafka-connect,Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.
Organization: debezium
Home Page: https://debezium.io
change-data-capture kafka-connect apache-kafka debezium cdc database kafka kafka-producer event-streaming

debezium / debezium-incubator
kafka-connect,Previously used repository for new Debezium modules and connectors in incubation phase (archived)
Organization: debezium
debezium change-data-capture cdc kafka kafka-connect

erdemcer / kafka-connect-oracle
kafka-connect,Kafka Source Connector For Oracle
User: erdemcer
kafka kafka-connect kafka-connector logminer oracle

hpgrahsl / kafka-connect-mongodb
kafka-connect,**Unofficial / Community** Kafka Connect MongoDB Sink Connector -> integrated 2019 into the official MongoDB Kafka Connector here: https://www.mongodb.com/kafka-connector
User: hpgrahsl
kafka kafka-connect mongodb sink-connector sink connector change-data-capture cdc avro json

itadventurer / kafka-backup
kafka-connect,Backup and Restore for Apache Kafka
User: itadventurer
kafka kafka-connect backup

ivangfr / springboot-kafka-connect-jdbc-streams
kafka-connect,Project goal: Explore Kafka, Kafka Connect, and Kafka Streams. Components: store-api: Inserts/updates MySQL records. Source Connectors: Monitor MySQL changes, push messages to Kafka. Sink Connectors: Listen to Kafka, insert/update Elasticsearch docs. store-streams: Listens to Kafka, processes with Kafka Streams, pushes new messages to Kafka.
User: ivangfr
spring-boot kafka kafka-connect kafka-streams mysql elasticsearch spring-cloud-stream schema-registry avro json java docker springdoc-openapi mapstruct jib web spring-data-jpa

jcustenborder / kafka-connect-spooldir
kafka-connect,Kafka Connect connector for reading CSV files into Kafka.
User: jcustenborder
kafka-connect csv json

jcustenborder / kafka-connect-transform-common
kafka-connect,Common Transforms for Kafka Connect.
User: jcustenborder
kafka-connect transformations

jcustenborder / kafka-connect-twitter
kafka-connect,Kafka Connect connector to stream data in real time from Twitter.
User: jcustenborder
kafka-connect twitter

kafbat / kafka-ui
kafka-connect,Open-Source Web UI for managing Apache Kafka clusters
Organization: kafbat
Home Page: http://ui.docs.kafbat.io
apache-kafka big-data cluster-management event-streaming hacktoberfest kafka kafka-brokers kafka-client kafka-cluster kafka-connect

kaiwaehner / hivemq-mqtt-tensorflow-kafka-realtime-iot-machine-learning-training-inference
kafka-connect,Real Time Big Data / IoT Machine Learning (Model Training and Inference) with HiveMQ (MQTT), TensorFlow IO and Apache Kafka - no additional data store like S3, HDFS or Spark required
User: kaiwaehner
kafka hivemq mqtt kafka-streams kafka-connect ksql tensorflow grpc java python

kaiwaehner / kafka-connect-iot-mqtt-connector-example
kafka-connect,Internet of Things Integration Example => Apache Kafka + Kafka Connect + MQTT Connector + Sensor Data
User: kaiwaehner
confluent confluent-kafka confluent-platform internet-of-things iot kafka kafka-connect kafka-connector mosquitto mqtt mqtt-broker mqtt-connector opensource

kaiwaehner / ksql-udf-deep-learning-mqtt-iot
kafka-connect,Deep Learning UDF for KSQL for Streaming Anomaly Detection of MQTT IoT Sensor Data
User: kaiwaehner
kafka kafka-connect kafka-client confluent confluent-platform open-source deep-learning machine-learning tensorflow h2oai

kakao / kafka-connect-web
kafka-connect,Web tool for operating kafka connect https://hub.docker.com/r/officialkakao/kafka-connect-web
Organization: kakao
kafka kafka-connect streaming

kcctl / kcctl
kafka-connect,A modern and intuitive command line client for Kafka Connect
Organization: kcctl
apache-kafka kafka-connect cli

langstream / langstream
kafka-connect,LangStream. Event-Driven Developer Platform for Building and Running LLM AI Apps. Powered by Kubernetes and Kafka.
Organization: langstream
Home Page: https://langstream.ai
genai gpt-4 huggingface kafka kafka-connect kubernetes langchain llamaindex llm openai python vectordb

lensesio / kafka-connect-tools
kafka-connect,Kafka Connect Tooling
Organization: lensesio
kafka kafka-connect cli

lensesio / kafka-connect-ui
kafka-connect,Web tool for Kafka Connect |
Organization: lensesio
Home Page: http://lenses.io/product/features
kafka kafka-connect elasticsearch cassandra s3 documentdb redis jms mqtt hdfs

lensesio / stream-reactor
kafka-connect,A collection of open source Apache 2.0 Kafka Connector maintained by Lenses.io.
Organization: lensesio
Home Page: https://lenses.io
awss3 azure-datalake cassandra connector cosmosdb elasticsearch eventhubs gcp http influxdb jms kafka kafka-connect mongodb mqtt pubsub s3

mmolimar / kafka-connect-fs
kafka-connect,Kafka Connect FileSystem Connector
User: mmolimar
confluent kafka apache-kafka kafka-connector kafka-connect hadoop filesystem hdfs kafka-connect-fs files

mmolimar / kukulcan
kafka-connect,A REPL for Apache Kafka
User: mmolimar
kafka apache-kafka repl shell kafka-repl kafka-shell ammonite kafka-connect kafka-streams kafka-admin

mongey / terraform-provider-kafka-connect
kafka-connect,Terraform provider for managing Apache Kafka Connect
User: mongey
terraform terraform-provider kafka-connect kafka

mongodb / mongo-kafka
kafka-connect,MongoDB Kafka Connector
Organization: mongodb
mongodb kafka kafka-connect sink sink-connector source source-connector cdc bson avro

mtpatter / postgres-kafka-demo
kafka-connect,Fully reproducible, Dockerized, step-by-step, demo on how to stream tables from Postgres to Kafka/KSQL back to Postgres. Detailed blog post published on Medium.
User: mtpatter
Home Page: https://medium.com/high-alpha/data-stream-processing-for-newbies-with-kafka-ksql-and-postgres-c30309cfaaf8?sk=3da652f7ab08ef3a138241569857e110
kafka kafka-connect ksql ksql-server postgresql debezium streaming

nodefluent / kafka-connect
kafka-connect,equivalent to kafka-connect :wrench: for nodejs :sparkles::turtle::rocket::sparkles:
Organization: nodefluent
kafka connect framework datastore etl nodejs kafka-connect

provectus / kafka-ui
kafka-connect,Open-Source Web UI for Apache Kafka Management
Organization: provectus
kafka-ui kafka-brokers kafka kafka-streams kafka-client opensource kafka-connect kafka-producer streams big-data

qubole / streamx
kafka-connect,kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)
Organization: qubole
kafka connector kafka-connect s3 aws gcp gcs streaming big-data

salesforce / mirus
kafka-connect,Mirus is a cross data-center data replication tool for Apache Kafka
Organization: salesforce
kafka kafka-connect mirroring

simplesteph / kafka-connect-github-source
kafka-connect,Get a stream of issues and pull requests for your chosen GitHub repository
User: simplesteph
Home Page: https://links.datacumulus.com/kafka-connect-coupon
kafka kafka-connect github github-api source

snowflakedb / snowflake-kafka-connector
kafka-connect,Snowflake Kafka Connector (Sink Connector)
Organization: snowflakedb
kafka kafka-connect snowflake java

streamthoughts / kafka-connect-file-pulse
kafka-connect,🔗 A multipurpose Kafka Connect connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka
Organization: streamthoughts
Home Page: https://streamthoughts.github.io/kafka-connect-file-pulse/
kafka kafka-connect grok-filters etl file-streaming kafka-producer kafka-connector avro csv xml

strimzi / strimzi-kafka-operator
kafka-connect,Apache Kafka® running on Kubernetes
Organization: strimzi
Home Page: https://strimzi.io/
kafka kubernetes openshift docker messaging enmasse kafka-connect kafka-streams data-streaming data-stream

vdesabou / kafka-docker-playground
kafka-connect,🐳✨ Fully automated Apache Kafka® and Confluent Docker based examples // 👷‍♂️ Easily build examples or reproduction models
User: vdesabou
Home Page: https://kafka-docker-playground.io
kafka confluent-kafka kafka-connectors kafka-connect confluent-cloud confluent-platform confluent

xaecbd / kcenter
kafka-connect,KCenter(KafkaCenter) is a unified platform for kafka cluster management and maintenance, producer / consumer monitoring, and use of ecological components(ksql/kafka connect).it's kafkacenter(kafka center).
Organization: xaecbd
Home Page: https://xaecbd.github.io/KCenter
kafka kafkacenter kafkamanager kafka-center kafka-manager kmanager kafkaoffsetmonitor kafka-monitor kafka-eagle ksql