Comments (8)
danny0405
commented on June 9, 2024
Looks like a jackson jar conflict.
from hudi.
huliwuli
commented on June 9, 2024
Looks like a jackson jar conflict.
Is there anything I can do for this issue?
from hudi.
danny0405
commented on June 9, 2024
Finds out where the legacy jackson comes from and remove it from the classpath.
from hudi.
huliwuli
commented on June 9, 2024
Finds out where the legacy jackson comes from and remove it from the classpath.
Ok, thanks I will try ... since it's on EMR. Not sure whether I have permission to remove it.
Or do you know which EMR/Hudi version is suitable to solve this issue?
from hudi.
ad1happy2go
commented on June 9, 2024
@huliwuli Did you tried using 0.14.1 ? 0.13.0 was not even supported with spark 3.4
from hudi.
ad1happy2go
commented on June 9, 2024
Sorry, Looks like you are using the AWS managed hudi. Can you try using emr-6.15.0 which has hudi 0.14.0
from hudi.
huliwuli
commented on June 9, 2024
Sorry, Looks like you are using the AWS managed hudi. Can you try using emr-6.15.0 which has hudi 0.14.0
EMR 6.15 worked, I tested it yesterday.
from hudi.
ad1happy2go
commented on June 9, 2024
Great! Thanks lot @huliwuli. Closing out this issue then. Please reopen in case you have any concerns.
from hudi.
Related Issues (20)
- [SUPPORT] spark stuctrued streaming failed to update MDT metadata HOT 14
- Critical and High vulnerabilities reported in hudi jar HOT 7
- [SUPPORT] Using BULK_INSERT mode multiple times writing causing a bug: Duplicate fileId 00000000-8651-4ae5-8f9e-4424fed2d181 from bucket 0 of partition found during the BucketStreamWriteFunction index bootstrap. HOT 1
- Nested object support in Hudi Table using Flink HOT 12
- [SUPPORT] Requesting Support for insert_overwrite in Delta Streamer HOT 12
- [SUPPORT] Occur bucketid multiple cannot write data to the wrong partition HOT 4
- [SUPPORT] Questions about LOG in Hudi source code HOT 2
- [SUPPORT] IllegalArgumentException at org.apache.hudi.common.util.ValidationUtils.checkArgument(ValidationUtils.java:33) HOT 16
- [SUPPORT] The parquet files for the MOR table have been generated, but the RO table in Hive still cannot query the latest data in the parquet files. HOT 7
- [SUPPORT] Flink-Hudi - Upsert into the same Hudi table via two different Flink pipelines (stream and batch) HOT 2
- [SUPPORT] AWS Glue 4.0 taking to long to write to S3 HOT 3
- [SUPPORT] `Caused by: org.apache.hudi.exception.HoodieException: Unable to instantiate class org.apache.hudi.hive.HiveSyncTool` HOT 4
- [SUPPORT] How to run org.apache.spark.sql.execution.benchmark.LSMTimelineReadBenchmark ？ HOT 6
- [SUPPORT] During the process of ingesting data from Kafka and persisting it into a Hudi MOR table, an Out of Memory exception was encountered HOT 3
- [SUPPORT] No way to clean `archived/` folder HOT 4
- [SUPPORT] Data duplicated in base file on updating record partition HOT 4
- [SUPPORT] Optimized code ComparableVersion HOT 3
- Data lose after writing HOT 4
- [SUPPORT] Avoid direct dependency on Flink Table Planner Jar HOT 2
- [SUGGEST] Can the community version be updated regularly and faster? The roadmap should also be updated regularly and synchronized. HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from hudi.