Comments (5)
zhang5059T
commented on July 17, 2024
The answer is found that my Kubernetes version is too low. Are there any images suitable for the Kubernetes version of 1.18.6?
from spark-on-k8s-operator.
yuchaoran2011
commented on July 17, 2024
K8s 1.18 is already deprecated and out of support by all major cloud providers. It's best to upgrade the k8s version of your cluster
from spark-on-k8s-operator.
Amri91
commented on July 17, 2024
@zhang5059T I got the same error. Here is my issue: #2051
I eventually made it work on k8s 1.17 by switching to the branch v1beta2-1.3.3-3.1.1 and using Apache Spark 3.4.1, as 3.5.1 did not work. I had to rebuild the operator image and update the app spark version.
from spark-on-k8s-operator.
zhang5059T
commented on July 17, 2024
@yuchaoran2011 Upgrading the k8s cluster is a bit difficult, and this is our online environment. I'm afraid the impact range will be too wide.
from spark-on-k8s-operator.
zhang5059T
commented on July 17, 2024
@Amri91 Thank you for providing the version. The version 3.4.1 of Spark also fits my environment very well. I will try to build the image of this version to solve this problem.
from spark-on-k8s-operator.
Related Issues (20)
- [BUG] spark-operator v1beta2-1.4.2-3.5.0 install with helm timeout HOT 4
- Add support for livenessProbe and ReadinessProbe of driver and executor pods HOT 4
- [FEATURE] Custom log patterns
- [BUG] Not able to open additional port on executor HOT 1
- [FEATURE] Metrics for pod update, pod delete, pod added
- [QUESTION] How can we monitor the Spark Operator container logs?
- [BUG] Submitting a Spark Application Fails on K8s versions < 1.21 HOT 2
- [Feature] Spark Operator Deployment Not Handling Multiple Namespaces HOT 6
- [FEATURE] prevent driver pod from being deleted before its status is processed by the operator HOT 2
- [BUG] volumes configmap not find in driver pod HOT 3
- [QUESTION] How should we upgrade to newer Spark versions for: the Spark Operator and long running Spark Applications?
- [BUG] Executor run error HOT 1
- [FEATURE] Reduce startup time associated with duplicated dependency downloads
- Add new slack channel to README.md HOT 3
- [BUG] Spark Operator Lock identity is empty while HA HOT 3
- [BUG] Changed the usage of the path of Example, a strange exception occurred.
- [BUG] A strange ClassCastException HOT 1
- [SECURITY ISSUE] A potential risk in spark-operator which can be levereaged to make cluster-level privilege escalation HOT 1
- [BUG] Env vars are randomly dropped HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from spark-on-k8s-operator.