Comments (4)
Yeah totally, this has also been on my mind recently. I've been working on a comparison table of the four ways of deploying Dask on Kubernetes (Helm, KubeCluster classic, Operator and Gateway).
Ideally, I want the default to be the operator for the majority of users. Folks with special cases that require a gateway should also consider that. Classic is deprecated and scheduled to be removed by the end of the summer. The single-user helm chart is still valid and useful, but I'd like to update it to build on the operator which would address most of its shortcomings.
Given our proliferation of Kubernetes tooling, I still think the docs.dask.org page is a good catchall page to signpost folks to the right place for them. But that page needs updating with the comparison table I've been working on and needs reordering to use the operator first and then discuss reasons why you might want the other tools.
from dask-kubernetes.
I'm talking to lots of folks from conferences right now and when they're married to Kubernetes I'm sending them to kubernetes.dask.org. Is that where you'd like me to send them today? Are there things we can do to make that a better landing experience now while we wait for other things to settle?
from dask-kubernetes.
That's a fine place to send them. As you say the note will redirect new users to docs.dask.org.
I've opened dask/dask#10232 to update the docs page with up-to-date information about Dask Kubernetes, Dask Gateway and the Helm Charts.
from dask-kubernetes.
I'm going to close this issue now that dask/dask#10232 is merged. But finishing up the comparison table and further improving the docs and writing a blog post are on my todo list.
from dask-kubernetes.
Related Issues (20)
- Dask dashboard not loading HOT 4
- Env var duplication HOT 2
- Ability to add different scheduler address to workers outside of standard format HOT 2
- Add a Changelog HOT 4
- Cluster creation constantly failing because of existing scheduler in "Terminating" status HOT 3
- Does dask-kubernetes compatible with newer version of k8rs? HOT 4
- Can not connect to k8s websocket deployed in Rancher HOT 5
- Update dask-kubernetes to a newer kr8s HOT 4
- Add Python 3.12 support HOT 1
- TOCTOU Bug while scaling down workers HOT 5
- Worker RestartPolicy not setable HOT 2
- Dask cluster creation issue with TLS HOT 1
- KubeCluster is shut down automatically even if shutdown_on_close is False HOT 1
- Go code failing to lint
- Dask Cluster with name longer than 53 chars is stuck in Created state, cannot be deleted
- Cannot Overwrite DASK_SCHEDULER_ADDRESS in Worker env HOT 1
- ConnectionClosedError during Dask Cluster Creation with k8s HOT 1
- Missing idleTimeout key in daskcluster_autoshutdown HOT 9
- Add IngressSpec besides ServiceSpec to Scheduler HOT 2
- Handle `image`, `env` and `args` fields updates in DaskCluster in k8s operator HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dask-kubernetes.