Comments (4)
Curious, is the jvm configurable on startup? Is it unstable on Java 11?
The Hadoop requirement is to compile Hadoop on Java 8, but it should theoretically run fine on Java 11. Unsurprised if that isn't true.
We can revert, but I really was hoping to start leveraging Java 11 without introducing yet another concurrent version.
from cascading.
it's possible to override but it's just not the default out of the box on AWS EMR and I would imagine there could be some breaking assumptions that would be a huge pain to deal with.
Java 8 is the default Java Virtual Machine (JVM) for cluster instances created using Amazon EMR release version 5.0.0 or later.
https://docs.aws.amazon.com/emr/latest/ReleaseGuide/configuring-java8.html
I have have no doubt that hadoop itself works fine on java11. If it's a dealbreaker that's fine just would be more convenient in a managed runtime.
from cascading.
Fair enough, I'll revert the build version.
from cascading.
thank you @cwensel if this is pushed to say 4.6/4.7 I think that is reasonable. I would assume that newer release labels from AWS EMR will be java11+ within a year or so.
from cascading.
Related Issues (20)
- NestedRegexFilter is not building a nested pointer HOT 1
- Task cleanup should not look for _temporary dirs when talking to s3
- BaseHashFunction should optionally emit null for null inputs
- Support get for nested lists in JSON objects HOT 1
- Upgrade Janino to 3.x HOT 1
- Janino expressions should accept both named and position parameters
- Add ByteArrayCoercibleType
- Support parallelization of child partition .close() operations
- Native support for Parquet HOT 1
- Move counter duration measurements to aggregated nanos
- Hadoop 3 Support HOT 3
- Compile and language support for Java 11 HOT 1
- JSONCoercibleType should use #treeToValue for coercions HOT 1
- Local mode does not support setting "cascading.source.path"
- `TapOutputCollector` committing partial output on task failure HOT 7
- Possible to publish WIP to maven-central? HOT 13
- refactoring org.apache.hadoop.mapred usage against org.apache.hadoop.mapreduce HOT 8
- potential regression on scalding joinWithTiny on 4.5-wip HOT 7
- Casting issue in PropertyUtil HOT 10
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from cascading.