Comments (3)
jacobtomlinson
commented on August 25, 2024
1
Thanks @dbalabka. I think having multiple running schedulers is an edge case that folks shouldn't run into. If you have any interest in making another PR to protect against that edge case then please feel free, but I think #847 should resolve this issue for most people.
from dask-kubernetes.
dbalabka
commented on August 25, 2024
1
@jacobtomlinson , it would be great if dask-kubernetes could handle the exception and provide a better explanation of what is happening. The error ValueError: Expected exactly one Pod object. Use selectors to narrow down the search. does not help to resolve the issue. I can add the proper exception handling with another PR
from dask-kubernetes.
dbalabka
commented on August 25, 2024
The proposed PR provides a possible solution. However, I don't believe that it is the completely right solution. It is still not prone to multiple running schedulers.
from dask-kubernetes.
Related Issues (20)
- Env var duplication HOT 2
- Ability to add different scheduler address to workers outside of standard format HOT 2
- Add a Changelog HOT 4
- Does dask-kubernetes compatible with newer version of k8rs? HOT 4
- Can not connect to k8s websocket deployed in Rancher HOT 5
- Update dask-kubernetes to a newer kr8s HOT 4
- Add Python 3.12 support HOT 1
- TOCTOU Bug while scaling down workers HOT 5
- Worker RestartPolicy not setable HOT 2
- Dask cluster creation issue with TLS HOT 1
- KubeCluster is shut down automatically even if shutdown_on_close is False HOT 1
- Go code failing to lint
- Dask Cluster with name longer than 53 chars is stuck in Created state, cannot be deleted
- Cannot Overwrite DASK_SCHEDULER_ADDRESS in Worker env HOT 1
- ConnectionClosedError during Dask Cluster Creation with k8s HOT 1
- Missing idleTimeout key in daskcluster_autoshutdown HOT 9
- Add IngressSpec besides ServiceSpec to Scheduler HOT 2
- Handle `image`, `env` and `args` fields updates in DaskCluster in k8s operator HOT 3
- Allow setting generateName in DaskJob resources HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dask-kubernetes.