Giter Club home page Giter Club logo

Comments (9)

dmathieu avatar dmathieu commented on July 30, 2024 1

It is safe for now, but not upgradable.
I have a plan to use the OpenSearch client, but they don't provide access to the access/security areas, which are required for tests.

See opensearch-project/opensearch-java#59

from kafka-connect-opensearch.

dmathieu avatar dmathieu commented on July 30, 2024

Are you able to connect to the same OpenSearch database with the same configuration, using the Elasticsearch Java library? (the one used in this package). Also, is your configuration working with the elasticsearch connector?
AFAIK, we just pass through the config options, exactly the same way as they are with the elasticsearch connector.

from kafka-connect-opensearch.

mann2108 avatar mann2108 commented on July 30, 2024

I didn't understand, I have used the latest JAR for kafka-connect-opensearch, given in the release tab. I am not using an elasticsearch connector, I am only using the opensearch connector forked by you.

from kafka-connect-opensearch.

mann2108 avatar mann2108 commented on July 30, 2024

Can you confirm the connect-distributed.properties configuration, I have share the file content above, also the post request body for creating a connector task?

from kafka-connect-opensearch.

dmathieu avatar dmathieu commented on July 30, 2024

I can't give you any expert validation on that configuration, no. I forked the elasticsearch connector, and I'm doing my best to maintain it, but I'm neither an Elasticsearch, OpenSearch or even Java expert.

My question is because at the moment, this library is still using the elasticsearch java client.

from kafka-connect-opensearch.

mann2108 avatar mann2108 commented on July 30, 2024

I see, I have one question, is it okay or safe to use elasticsearch java client with OpenSearch as a sink? OpenSearch provides their own client as well - https://opensearch.org/docs/latest/clients/java-rest-high-level/.

from kafka-connect-opensearch.

XI1876-ManojSharma avatar XI1876-ManojSharma commented on July 30, 2024

@mann2108 Are you able to register kafka-connect-opensearch connector. I am getting {"error_code":500,"message":"Failed to find any class that implements Connector and which name matches com.dmathieu.kafka.opensearch.OpenSearchSinkConnector, available connectors are... @dmathieu can you help me in this regards?

from kafka-connect-opensearch.

dmathieu avatar dmathieu commented on July 30, 2024

This kind of error usually indicates the jar isn't in the proper folder.
The path to the folder where the jar is need to be specified in the environment variable CONNECT_PLUGIN_PATH.

from kafka-connect-opensearch.

XI1876-ManojSharma avatar XI1876-ManojSharma commented on July 30, 2024

Hi, Can you please add this to the readme file as it is missing from there. I would be great if complete step is mention separately for distributed as well as standalone.

We are trying to configure this in AWS MSK ? could you please help us here?

from kafka-connect-opensearch.

Related Issues (8)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.