Comments (4)
We are planning to have the next delta-flink release 0.7.0 support flink 1.16 and SQL/ Table API.
We can then have Flink 1.17 on the 0.8.0 release
from connectors.
Hi @PrabhuJoseph
I'm wondering, have you tried running 0.6.0 with Flink 1.17 maybe?
The connector does not ship any Flink dependencies so if there were no changes in Flink Sink/Source API then 0.6.0 and 0.7.0 could be used with 1.17.
For example,
0.5.0 will work only with Flink 1.13.x
0.6.0 will work with Flink 1.15.x and 1.16.x even though 0.6.0 has a "dependency" on Flink 1.15. You can still create Flink jobs using Flink 1.16 libs and 0.6.0 connector on Flink 1.16. [1]
In other words, even though connector has FlinkVersion X in build.sbt it does not mean that It will not work with Flink X + 1 version.
I've not tried 0.6.0 on 1.17 yet.
[1] #523
from connectors.
Thanks @kristoffSC and @scottsand-db .
Delta build ran fine with just changing the Flink dependency version to 1.17. We are now testing with few Flink Delta Streaming examples on Flink-1.17 cluster.
from connectors.
This repo has been deprecated and the code is moved under connectors
module in https://github.com/delta-io/delta repository. Please create the issue in repository https://github.com/delta-io/delta. See #556 for details.
from connectors.
Related Issues (20)
- sql-delta-import.jar HOT 3
- Scala incompatibility for Delta Flink connector when deploying connector jar to the Flink cluster. HOT 5
- Flink DeltaSource should use Flink Configuration and not hadoop configuration HOT 2
- cluster flink 1.14.6, Which version of delta-flink should be selected HOT 2
- Create De/Serializers for DeltaLog instance for Flink connector HOT 6
- Add versions lag metric to DeltaSource HOT 2
- External parquet files - trying to relativize path HOT 1
- Delta Standalone: Jar Hell - Hadoop dependencies HOT 8
- [Delta-Standalone] create table HOT 2
- Maturity custom connector delta HOT 1
- Scala library 2.13.8: CVE-2022-36944 HOT 1
- Hadoop libraries and CVEs HOT 1
- Cannot build this project due to dependencies with CVEs HOT 1
- Support for other formats than Flink's Table API RowData format HOT 4
- Proposal: Unify this Delta Connectors and Delta-Spark codebases HOT 4
- HiveAccessControlException Permission denied: user [integration_user] does not have [RWSTORAGE] privilege on [deltastoragehandler://true/] HOT 1
- Missing Doc/Readme.md for Flink SQL and Delta Connector HOT 3
- Question: Delta Standalone - which version of the delta lake transaction log spec used? HOT 1
- CREATE_TABLE operation should fail if the table already exists HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from connectors.