Playground for Kafka/Confluent Docker experimentations...

• 👾 Playgrounds
  • ☁️ Confluent Cloud
  • 🔄 Confluent Replicator and Mirror Maker 2
  • 🔐 Environments
  • Confluent Commercial
  • CP-Ansible Playground
  • 👾 Other Playgrounds
• 🎓 How to use
  • 0️⃣ Prerequisites
  • 🐳 Recommended Docker settings
  • 🌩 Running on AWS EC2 instance

Quick start examples from Confluent docs but in Docker version for ease of use.

Connector	Product Category	Latest Version (*)	Type	Release Date	CP 6.2.0 CI	CP 6.1.2 CI latest results	CP 6.0.3 CI latest results	CP 5.5.5 CI latest results
ActiveMQ Sink	Message Queue	1.3.4	Confluent Subscription	2021-08-05	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05
ActiveMQ Source	Message Queue	11.0.7	Confluent Subscription	2021-06-03	👍 2021-07-29	👍 2021-08-02	👍 2021-07-29	👍 2021-08-02
Amazon CloudWatch Logs Source	Analytics	1.1.3	Confluent Subscription	2021-07-30	👍 2021-07-30	👍 2021-07-30	👍 2021-07-30	👍 2021-07-30
Amazon CloudWatch Metrics Sink	Analytics	1.1.5	Confluent Subscription	2021-07-08	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31
Amazon DynamoDB Sink	Database	1.2.0	Confluent Subscription	2021-04-20	👍 2021-07-29	👍 2021-08-02	👍 2021-07-29	👍 2021-08-02
Amazon Kinesis Source (also with 🌐 proxy)	Message Queue	1.3.7	Confluent Subscription	2021-05-07	👍 2021-07-29	👍 2021-08-02	👍 2021-07-29	👍 2021-08-02
Amazon Redshift Sink	Data Warehouse	1.1.0	Confluent Subscription	2021-04-23	🤷‍♂️ not tested	🤷‍♂️ not tested	🤷‍♂️ not tested	🤷‍♂️ not tested
Amazon Redshift Source (using JDBC)	Data Warehouse	JDBC version	Confluent Community License		🤷‍♂️ not tested	🤷‍♂️ not tested	🤷‍♂️ not tested	🤷‍♂️ not tested
Amazon S3 Sink (also with 🌐 proxy)	Datastore	10.0.1	Confluent Community License	2021-07-20	❌ 2021-08-05 🐞 #935	❌ 2021-08-05 🐞 #935	❌ 2021-08-05 🐞 #935	❌ 2021-08-05 🐞 #935
Amazon S3 Source	Datastore	1.4.6	Confluent Subscription	2021-07-15	❌ 2021-08-05 🐞 #921	❌ 2021-08-05 🐞 #921	❌ 2021-08-05 🐞 #921	❌ 2021-08-05 🐞 #921
Amazon SQS Source	Message Queue	1.1.2	Confluent Subscription	2021-08-04	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05
AMPS Source	Message Queue	1.0.0-preview	Confluent Subscription	2020-07-08	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05
Apache Kudu Source	Database	1.0.2	Confluent Subscription	2021-03-12	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05
Apache Kudu Sink	Database	1.0.2	Confluent Subscription	2021-03-12	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05
AWS Lambda Sink	SaaS Apps	1.1.1	Confluent Subscription	2021-01-07	👍 2021-07-29	👍 2021-08-02	👍 2021-07-29	👍 2021-08-02
Azure Blob Storage Sink	Datastore	1.6.2	Confluent Subscription	2021-04-12	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31	👍 2021-08-01
Azure Blob Storage Source	Datastore	1.4.6	Confluent Subscription	2021-07-15	❌ 2021-08-05 🐞 #778	❌ 2021-08-05 🐞 #778	👍 2021-07-31	👍 2021-07-31
Azure Cosmos DB Sink	Datastore	1.1.0	MIT License	2021-07-08	👍 2021-07-29	👍 2021-07-30	👍 2021-07-30	❌ 2021-08-05 🐞 #894
Azure Cosmos DB Source	Datastore	1.1.0	MIT License	2021-07-08	👍 2021-07-29	👍 2021-07-30	👍 2021-07-30	❌ 2021-08-05 🐞 #846
Azure Data Lake Storage Gen1 Sink	Datastore	1.6.2	Confluent Subscription	2021-04-12	👍 2021-07-29	👍 2021-08-02	👍 2021-07-29	👍 2021-08-02
Azure Data Lake Storage Gen2 Sink	Datastore	1.6.2	Confluent Subscription	2021-04-12	👍 2021-08-04	👍 2021-08-04	👍 2021-08-04	👍 2021-08-04
Azure Event Hubs Source	Message Queue	1.2.1	Confluent Subscription	2021-07-26	👍 2021-07-29	👍 2021-07-29	👍 2021-07-29	👍 2021-08-04
Azure Functions Sink	SaaS Apps	1.0.11	Confluent Subscription	2021-07-05	❌ 2021-08-05 🐞 #931	❌ 2021-08-05 🐞 #931	❌ 2021-08-05 🐞 #931	❌ 2021-08-05 🐞 #931
Azure Search Sink	Analytics	1.0.5	Confluent Subscription	2021-08-04	❌ 2021-08-05 🐞 #1146	❌ 2021-08-05 🐞 #1146	❌ 2021-08-05 🐞 #1146	❌ 2021-08-05 🐞 #1146
Azure Service Bus Source	Message Queue	1.2.1	Confluent Subscription	2021-07-26	👍 2021-08-04	👍 2021-08-03	👍 2021-08-03	👍 2021-08-04
Azure SQL Data Warehouse Sink	Data Warehouse	1.0.4	Confluent Subscription	2020-10-08	👍 2021-07-29	👍 2021-08-02	👍 2021-07-29	👍 2021-08-02
Cassandra Sink	Database	2.0.0	Confluent Subscription	2020-12-04	👍 2021-08-04	👍 2021-08-04	👍 2021-08-04	👍 2021-08-04
Couchbase Sink	Database	4.1.0	Open Source (Couchbase, Inc.)	2021-07-21	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31
Couchbase Source	Database	4.1.0	Open Source (Couchbase, Inc.)	2021-07-21	👍 2021-08-02	👍 2021-08-02	👍 2021-08-02	👍 2021-08-02
Debezium CDC Microsoft SQL Server Source	CDC	1.6.0	Open Source (Debezium Community)		👍 2021-07-31	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31
Debezium CDC MySQL Source	CDC	1.6.0	Open Source (Debezium Community)		👍 2021-07-31	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31
Debezium CDC PostgreSQL Source (also with 🔑 SSL and mTLS)	CDC	1.6.0	Open Source (Debezium Community)		👍 2021-07-31	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31
Debezium CDC MongoDB Source	CDC	1.6.0	Open Source (Debezium Community)		👍 2021-07-31	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31
Data Diode Sink	Logs	1.1.1	Confluent Subscription	2019-10-18	👍 2021-07-29	👍 2021-08-02	👍 2021-07-29	👍 2021-08-02
Data Diode Source	Logs	1.1.1	Confluent Subscription	2019-10-18	👍 2021-07-29	👍 2021-08-02	👍 2021-07-29	👍 2021-08-02
Datadog Metrics Sink	Analytics	1.1.5	Confluent Subscription	2021-07-08	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31	👍 2021-08-01
ElasticSearch Sink	Analytics	11.1.0	Confluent Community License	2021-07-30	👍 2021-07-30	👍 2021-07-30	👍 2021-07-30	👍 2021-07-30
FilePulse Source	Datastore	2.0.0	The Apache Software License, Version 2.0	2021-06-10	👍 2021-07-29	👍 2021-08-02	👍 2021-07-29	👍 2021-08-02
FileStream Source	Datastore	:connect/connect-filestream-source:
FileStream Sink	Datastore	:connect/connect-filestream-sink:
FTPS Sink	Datastore	1.0.3-preview	Confluent Subscription	2020-10-01	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31
FTPS Source	Datastore	1.0.3-preview	Confluent Subscription	2020-10-01	👍 2021-07-29	👍 2021-08-02	👍 2021-07-29	👍 2021-08-02
Gemfire Sink	Database	1.0.6	Confluent Subscription	2021-03-09	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05
Github Source	SaaS Apps	2.0.0	Confluent Subscription	2021-08-04	❌ 2021-08-05 🐞 #1225	❌ 2021-08-05 🐞 #1225	❌ 2021-08-05 🐞 #1225	❌ 2021-08-05 🐞 #1225
Google BigQuery Sink	Data Warehouse	2.1.4	Open Source (WePay)	2021-06-08	👍 2021-08-02	👍 2021-08-02	👍 2021-08-02	👍 2021-08-03
Google Cloud BigTable Sink	Database	1.0.9	Confluent Subscription	2021-05-17	💀 known issue 🐞 #907	💀 known issue 🐞 #907	💀 known issue 🐞 #907	👍 2021-08-02
Google Cloud Functions Sink	SaaS Apps	1.1.5	Confluent Subscription	2021-05-15	👍 2021-07-29	👍 2021-08-02	👍 2021-08-02	👍 2021-08-02
Google Cloud Pub/Sub Source (also with 🌐 proxy)	Message Queue	1.1.0	Confluent Subscription	2021-07-22	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31
Google Cloud Spanner Sink	Database	1.0.4	Confluent Subscription	2021-02-04	👍 2021-07-29	👍 2021-08-02	👍 2021-07-29	👍 2021-08-02
Google Cloud Storage Sink	Datastore	5.5.8	Confluent Subscription	2021-08-05	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05	❌ 2021-08-05 🐞 #1010
Google Cloud Storage Source	Datastore	1.4.6	Confluent Subscription	2021-07-15	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31
Google Firebase Realtime Database Sink	Database	1.2.0	Confluent Subscription	2020-12-01	👍 2021-07-29	👍 2021-08-02	👍 2021-07-29	👍 2021-08-02
Google Firebase Realtime Database Source	Database	1.2.0	Confluent Subscription	2020-12-01	👍 2021-07-29	👍 2021-08-02	👍 2021-07-29	👍 2021-08-02
HBase Sink	Database	1.0.9	Confluent Subscription	2021-05-17	💀 known issue 🐞 #907	💀 known issue 🐞 #907	💀 known issue 🐞 #907	👍 2021-08-02
HDFS 2 Source	Datastore	1.4.6	Confluent Subscription	2021-07-15	❌ 2021-08-05 🐞 #1168	❌ 2021-08-05 🐞 #1168	❌ 2021-08-05 🐞 #1168	❌ 2021-08-05 🐞 #1168
HDFS 3 Source	Datastore	1.4.6	Confluent Subscription	2021-07-15	❌ 2021-08-05 🐞 #1175	❌ 2021-08-05 🐞 #1175	❌ 2021-08-05 🐞 #1175	❌ 2021-08-05 🐞 #1175
HDFS 2 Sink	Datastore	10.1.1	Confluent Community License	2021-08-05	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05
HDFS 3 Sink	Datastore	1.1.2	Confluent Subscription	2021-07-16	👍 2021-07-29	👍 2021-07-29	👍 2021-07-29	👍 2021-08-05
HTTP Sink	SaaS Apps	1.4.0	Confluent Subscription	2021-05-26	👍 2021-07-29	👍 2021-08-02	👍 2021-07-29	👍 2021-08-02
IBM MQ Sink (also with 🔑 SSL and mTLS)	Message Queue	1.3.4	Confluent Subscription	2021-08-05	❌ 2021-08-05 🐞 #1228	❌ 2021-08-05 🐞 #1228	❌ 2021-08-05 🐞 #1228	❌ 2021-08-05 🐞 #1228
IBM MQ Source (also with 🔑 SSL and mTLS)	Message Queue	11.0.7	Confluent Subscription	2021-06-03	❌ 2021-08-05 🐞 #1221	❌ 2021-08-05 🐞 #1221	❌ 2021-08-05 🐞 #1221	❌ 2021-08-05 🐞 #1221
InfluxDB Sink	Database	1.2.1	Confluent Subscription	2020-09-30	👍 2021-07-29	👍 2021-08-02	👍 2021-07-29	👍 2021-08-02
InfluxDB Source	Database	1.2.1	Confluent Subscription	2020-09-30	👍 2021-07-29	👍 2021-08-02	👍 2021-07-29	👍 2021-08-02
JDBC CockroachDB Source	Database	10.2.1	Confluent Community License	2021-07-30	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31	👍 2021-08-02
JDBC Hive Sink	Database	JDBC version	Confluent Community License		🤷‍♂️ not tested	🤷‍♂️ not tested	🤷‍♂️ not tested	🤷‍♂️ not tested
JDBC MySQL Sink (also with 🔑 SSL and mTLS)	Database	10.2.1	Confluent Community License	2021-07-30	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31
JDBC Oracle 11 Sink	Database	10.2.1	Confluent Community License	2021-07-30	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05
JDBC Oracle 12 Sink (also with 🔑 SSL and mTLS)	Database	10.2.1	Confluent Community License	2021-07-30	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05
JDBC PostGreSQL Sink (also with 🔑 SSL and mTLS)	Database	10.2.1	Confluent Community License	2021-07-30	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31
JDBC Microsoft SQL Server Sink (also with 🔑 SSL)	Database	10.2.1	Confluent Community License	2021-07-30	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31
JDBC MySQL Source (also with 🔑 SSL and mTLS)	Database	10.2.1	Confluent Community License	2021-07-30	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31
JDBC Oracle 11 Source	Database	10.2.1	Confluent Community License	2021-07-30	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05
JDBC Oracle 12 Source (also with 🔑 SSL and mTLS)	Database	10.2.1	Confluent Community License	2021-07-30	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05
JDBC PostGreSQL Source (also with 🔑 SSL and mTLS)	Database	10.2.1	Confluent Community License	2021-07-30	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31
JDBC Microsoft SQL Server Source (also with 🔑 SSL)	Database	10.2.1	Confluent Community License	2021-07-30	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31
JDBC Snowflake Sink	Data Warehouse	10.2.1	Confluent Community License	2021-07-30	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31	👍 2021-08-02
JDBC Snowflake Source	Data Warehouse	10.2.1	Confluent Community License	2021-07-30	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31	👍 2021-08-02
JDBC Vertica Sink	Database	10.2.1	Confluent Community License	2021-07-30	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31	👍 2021-08-02
JIRA Source	SaaS Apps	1.0.5-preview	Confluent Subscription	2021-05-27	👍 2021-07-29	👍 2021-08-02	👍 2021-07-29	👍 2021-08-02
JMS ActiveMQ Sink	Message Queue	1.3.4	Confluent Subscription	2021-08-05	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05
JMS Solace Sink	Message Queue	1.3.4	Confluent Subscription	2021-08-05	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05
JMS TIBCO EMS Sink	Message Queue	1.3.4	Confluent Subscription	2021-08-05	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05
JMS TIBCO EMS Source	Message Queue	11.0.7	Confluent Subscription	2021-06-03	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05
JMS Oracle Weblogic Source	Message Queue	11.0.7	Confluent Subscription	2021-06-03	👍 2021-07-29	👍 2021-08-02	👍 2021-07-29	👍 2021-08-02
Mapr Sink	Datastore	1.1.3	Confluent Subscription	2021-03-11	👍 2021-07-29	👍 2021-07-30	👍 2021-07-29	👍 2021-08-01
Marketo Source	SaaS Apps	1.0.0-preview	Confluent Subscription	2020-10-20	👍 2021-07-29	👍 2021-08-02	👍 2021-07-29	👍 2021-08-02
Minio Sink	Datastore	10.0.1	Confluent Community License	2021-07-20	👍 2021-07-29	👍 2021-07-29	👍 2021-07-29	👍 2021-08-04
MongoDB Sink	Database	1.6.0	Open Source (MongoDB)	2021-07-13	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31
MongoDB Source	Database	1.6.0	Open Source (MongoDB)	2021-07-13	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31
MQTT Sink	IoT	1.4.1	Confluent Subscription	2021-06-10	👍 2021-07-29	👍 2021-08-02	👍 2021-07-29	👍 2021-08-02
MQTT Source	IoT	1.4.1	Confluent Subscription	2021-06-10	👍 2021-07-29	👍 2021-08-02	👍 2021-07-29	👍 2021-08-02
Neo4j Sink	Database	1.0.9	Open Source (Neo4j, Inc.)	2020-09-02	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31
OmniSci Sink	Database	1.0.3	Confluent Subscription	2021-05-07	👍 2021-07-29	👍 2021-08-02	👍 2021-07-29	👍 2021-08-02
Oracle CDC (also with 🔑 SSL and mTLS)	Database	1.2.1	Confluent Subscription	2021-07-20	👍 2021-07-29	👍 2021-07-29	👍 2021-07-29	👍 2021-08-05
PagerDuty Sink	SaaS Apps	1.0.2	Confluent Subscription	2020-11-18	👍 2021-07-29	👍 2021-08-02	👍 2021-07-29	👍 2021-08-02
Prometheus Sink	Analytics	1.1.5-preview	Confluent Subscription	2021-07-08	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31	👍 2021-08-01
RabbitMQ Sink	Message Queue	1.5.2	Confluent Subscription	2021-08-02	👍 2021-08-02	👍 2021-08-02	👍 2021-08-02	👍 2021-08-02
RabbitMQ Source	Message Queue	1.5.2	Confluent Subscription	2021-08-02	👍 2021-08-02	👍 2021-08-02	👍 2021-08-02	👍 2021-08-02
Redis Sink	Database	0.0.2.13	Open Source (Jeremy Custenborder)	2021-07-07	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31
SalesForce Bulk API Sink	SaaS Apps	1.10.1	Confluent Subscription	2021-07-21	👍 2021-07-29	👍 2021-07-29	👍 2021-07-29	👍 2021-07-29
SalesForce Bulk API Source	SaaS Apps	1.10.1	Confluent Subscription	2021-07-21	👍 2021-07-29	👍 2021-07-29	👍 2021-07-29	👍 2021-07-29
SalesForce CDC Source	SaaS Apps	1.10.1	Confluent Subscription	2021-07-21	👍 2021-07-29	👍 2021-07-29	👍 2021-07-29	👍 2021-07-29
SalesForce Platform Events Sink	SaaS Apps	1.10.1	Confluent Subscription	2021-07-21	👍 2021-07-29	👍 2021-07-29	👍 2021-07-29	👍 2021-07-29
SalesForce Platform Events Source	SaaS Apps	1.10.1	Confluent Subscription	2021-07-21	👍 2021-07-29	👍 2021-07-29	👍 2021-07-29	👍 2021-07-29
SalesForce PushTopics Source	SaaS Apps	1.10.1	Confluent Subscription	2021-07-21	👍 2021-07-29	👍 2021-07-29	👍 2021-07-29	👍 2021-07-29
SalesForce SObject Sink	SaaS Apps	1.10.1	Confluent Subscription	2021-07-21	👍 2021-07-29	👍 2021-07-29	👍 2021-07-29	👍 2021-07-29
ServiceNow Sink	SaaS Apps	2.3.3	Confluent Subscription	2021-08-04	👍 2021-08-04	👍 2021-08-04	👍 2021-08-04	👍 2021-08-04
ServiceNow Source (also with 🌐 proxy)	SaaS Apps	2.3.3	Confluent Subscription	2021-08-04	👍 2021-08-04	👍 2021-08-04	👍 2021-08-04	👍 2021-08-04
SFTP Sink (also with 🔑 Kerberos)	Datastore	2.3.4	Confluent Subscription	2021-08-05	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05
SFTP Source (also with 🔑 Kerberos)	Datastore	2.3.4	Confluent Subscription	2021-08-05	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05
SNMP Trap Source	IoT	1.1.2	Confluent Subscription	2020-04-09	👍 2021-07-29	👍 2021-08-02	👍 2021-08-03	👍 2021-08-02
Snowflake Sink	Data Warehouse	1.5.5	Open Source (Snowflake, Inc.)	2021-06-22	👍 2021-07-31	👍 2021-08-02	👍 2021-07-29	👍 2021-08-02
Solace Sink	Message Queue	1.3.4	Confluent Subscription	2021-08-05	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05
Solace Source	Message Queue	1.2.0	Confluent Subscription	2020-08-26	👍 2021-07-29	👍 2021-08-02	👍 2021-07-29	👍 2021-08-02
Splunk Sink	Analytics	2.0.2	Open Source (Splunk)		👍 2021-07-29	👍 2021-08-02	👍 2021-07-29	👍 2021-08-02
Splunk Source	Analytics	1.0.3	Confluent Subscription	2020-11-18	👍 2021-07-29	👍 2021-07-29	👍 2021-07-29	👍 2021-07-29
Splunk S2S Source	Analytics	1.0.0	Confluent Subscription	2021-06-29	👍 2021-07-31	👍 2021-07-31	👍 2021-07-31	👍 2021-08-01
Spool Dir Source	Datastore	2.0.62	Open Source (Jeremy Custenborder)	2021-04-29	👍 2021-07-29	👍 2021-08-02	👍 2021-07-29	👍 2021-08-02
Syslog Source	Logs	1.3.3	Confluent Subscription	2021-06-28	👍 2021-07-29	👍 2021-07-29	👍 2021-07-29	👍 2021-07-29
TIBCO EMS Sink	Message Queue	1.3.4	Confluent Subscription	2021-08-05	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05
TIBCO EMS Source	Message Queue	1.2.0	Confluent Subscription	2020-08-26	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05	👍 2021-08-05
Vertica Sink	Database	1.2.5	Confluent Subscription	2021-02-18	👍 2021-07-29	👍 2021-08-02	👍 2021-08-02	👍 2021-08-02
Zendesk Source	SaaS Apps	1.0.6	Confluent Subscription	2021-03-09	👍 2021-08-02	👍 2021-08-02	👍 2021-07-29	👍 2021-08-02

* You can change default connector version by setting CONNECTOR_TAG environment variable before starting a test, get more details here

• How to connect your components to Confluent Cloud
• How to monitor your Confluent Cloud cluster
• How to restrict access
• etc...

• AWS Kinesis source
• ServiceNow source
• ServiceNow sink
• MongoDB source
• Firebase

• Using cp-ansible with Confluent Cloud
• Using cp-helm-charts with Confluent Cloud
• Using confluent operator with Confluent Cloud
• Demo using dabz/ccloudexporter in order to pull Metrics API data from Confluent Cloud cluster and export it to Prometheus (Grafana dashboard is also available)
• .NET client (producer/consumer)
• Go client (producer/consumer)
• KafkaJS client (producer/consumer)
• Python client (producer/consumer)
• kafka-admin Managing topics and ACLs using matt-mangia/kafka-admin
• Confluent Replicator OnPrem to cloud and Cloud to Cloud examples
• Multi-Cluster Schema Registry with hybrid configuration (onprem/confluent cloud)
• Confluent REST Proxy Security Plugin with Principal Propagation
• Confluent Schema Registry Security Plugin
• Migrate Schemas to Confluent Cloud using Confluent Replicator
• Confluent Cloud Networking using HAProxy
• Multiple Event Types in the Same Topic

Using Multi-Data-Center setup with US 🇺🇸 and EUROPE 🇪🇺 clusters.

• Using Confluent Replicator as connector
  • Using PLAINTEXT
  • Using SASL_PLAIN
  • Using Kerberos
• 👾 Using Confluent Replicator as executable
  • Using PLAINTEXT
  • Using SASL_PLAIN
  • Using Kerberos
• Using Mirror Maker 2
  • Using PLAINTEXT

Single cluster:

• PLAINTEXT: no security
• SASL_PLAIN: no SSL encryption, SASL/PLAIN authentication
• SASL/SCRAM no SSL encryption, SASL/SCRAM-SHA-256 authentication
• SASL_SSL: SSL encryption, SASL/PLAIN authentication
• 2WAY_SSL: SSL encryption, SSL authentication
• Kerberos: no SSL encryption, Kerberos GSSAPI authentication
• SSL_Kerberos SSL encryption, Kerberos GSSAPI authentication
• LDAP Authentication with SASL/PLAIN no SSL encryption, SASL/PLAIN authentication using LDAP
• LDAP Authorizer with SASL/PLAIN no SSL encryption, SASL/PLAIN authentication, LDAP Authorizer for ACL authorization
• RBAC with SASL/PLAIN RBAC with no SSL encryption, SASL/PLAIN authentication

Multi-Data-Center setup:

• PLAINTEXT: no security
• SASL_PLAIN: no SSL encryption, SASL/PLAIN authentication
• Kerberos: no SSL encryption, Kerberos GSSAPI authentication

• Control Center
  • Control Center in "Read-Only" mode
  • Configuring Control Center with LDAP authentication
• Tiered Storage
  • Tiered storage with AWS S3
  • Tiered storage with Minio (unsupported)
• Confluent Rebalancer
• JMS Client
• RBAC with SASL/PLAIN RBAC with no SSL encryption, SASL/PLAIN authentication
• Audit Logs
• Confluent REST Proxy Security Plugin with SASL_SSL and 2WAY_SSL Principal Propagation
• Cluster Linking

Easily play with Confluent Platform Ansible playbooks by using Ubuntu based Docker images generated daily from this cp-ansible-playground repository

There is also a Confluent Cloud version available here

• Confluent Replicator [also with SASL_SSL and 2WAY_SSL]
• Testing Separate principals (connector.client.config.override.policy) for Source connector (SFTP source)
• Testing Separate principals (connector.client.config.override.policy) for Source connector (SFTP sink)
• How to write logs to files when using docker-compose
• Publish logs to kafka with Elastic Filebeat
• .NET basic producer
• KafkaJS client (producer/consumer)
• Monitor Confluent Platform with Datadog
• Testing KIP-108 Create Topic Policy

You just need to have docker and docker-compose installed on your machine ! Every command used in the playground is using Docker, this includes jq (except if you have it on your host already), aws, az, gcloud, etc.. The goal is to have a consistent behaviour and only depends on Docker.

If you want to run it on EC2 instance (highly recommended if you have low internet bandwith), you can use the AWS CloudFormation template provided here.

For example, this is how I start it using aws CLI:

$ cp /path/to/kafka-docker-playground/cloudformation/kafka-docker-playground.json tmp.json
$ aws cloudformation create-stack  --stack-name kafka-docker-playground-$USER --template-body file://tmp.json --region eu-west-3
 --parameters ParameterKey=KeyName,ParameterValue=$KEY_NAME ParameterKey=InstanceName,ParameterValue=kafka-docker-playground-$USER