Comments (5)
cc @jianyun8023 @yjshen @syhily for visibility.
from pulsar-flink.
@mhaseebmlk Noted. @nlu90 @syhily Can someone take a look at this issue?
from pulsar-flink.
@mhaseebmlk The Pulsar-Flink Connector has support for protobuf_native
format, so it has dependency on protobuf native. You will need to put it under the /lib
directory or add when starting the sql-client. You also need to put some pulsar or avro related jars under lib
.
And this is the command I used to start sql-client:
./bin/sql-client.sh embedded --jar /Users/nlu/workspace/stream-native/pulsar-flink/pulsar-flink-connector/target/pulsar-flink-connector-origin-1.13.1.0.jar --jar /Users/nlu/.m2/repository/com/google/protobuf/protobuf-java/3.11.1/protobuf-java-3.11.1.jar
And here's an example lib
dir with all dependencies:
➜ flink-1.13.2 ls lib
avro-1.10.0.jar flink-dist_2.11-1.13.2.jar flink-shaded-zookeeper-3.4.14.jar flink-table_2.11-1.13.2.jar jackson-databind-2.11.4.jar log4j-api-2.12.1.jar pulsar-client-admin-api-2.8.0.jar
flink-avro-1.13.2.jar flink-json-1.13.2.jar flink-sql-avro-1.13.2.jar jackson-annotations-2.11.4.jar jul-to-slf4j-1.7.12.jar log4j-core-2.12.1.jar pulsar-client-all-2.8.0.jar
flink-csv-1.13.2.jar flink-protobuf-2.7.6.jar flink-table-blink_2.11-1.13.2.jar jackson-core-2.11.4.jar log4j-1.2-api-2.12.1.jar log4j-slf4j-impl-2.12.1.jar pulsar-client-api-2.8.0.jar
from pulsar-flink.
@mhaseebmlk does Neng's comment answer your question?
from pulsar-flink.
Yes, it does. Thank you. I'll go ahead and close this issue.
from pulsar-flink.
Related Issues (20)
- [BUG] Set pulsar event time when it exceed zero. HOT 1
- [BUG]pulsar-flink catalog options HOT 1
- [DOC] Catalog config and DDL properties in README doc is out of date HOT 1
- [BUG] Pulsar client issue causing unacknowledged messages. HOT 1
- Json Format stores Timestamp as long but schema will be translated to Row<> type. HOT 1
- Expose metrics/profiling in docker HOT 1
- Merge pulsar-flink docker build process with sql-gateway image build process
- [BUG][FLINK-26980] PulsarUnorderedSourceReaderTest hang on azure
- [QUESTION] How does this project relate to apache pulsar flink connector HOT 1
- [FEATURE] Support auto failover in Flink connector
- [FEATURE] Allow USE_LATEST_WHEN_TOO_LARGE_CURSOR
- [BUG] Flink pulsar source upgrade from 1.13.1.4 to 1.13.6.2 fails HOT 1
- [BUG] Cumulative Acknowledgement is not happening in the flink-connector-pulsar
- [BUG] {"errorMsg":"org.apache.pulsar.transaction.common.exception.TransactionConflictException
- [FEATURE] 基于keyshare模式的简单使用
- [protobuf] infinite recursive call in protobuf-native parser HOT 3
- [BUG] Question about Flink Event-time support.
- [BUG]Flink connects pulsar ,that offtens responses PulsarAdminException HTTP 502 Bad Gateway HOT 1
- verify if OAuth works on 1.14 branch
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pulsar-flink.