Comments (1)
scottyhq
commented on July 30, 2024
@bonnland - looks like cesm_lens is still using dask_kubernetes, we're in the process of moving people to dask_gateway for creating clusters (dask_kubernetes isn't going to work going forward b/c of configuration changes) It should be an easy transition for your notebook:
you have:
# Create cluster
from dask_kubernetes import KubeCluster
from dask.distributed import Client
cluster = KubeCluster()
cluster.adapt(minimum=2, maximum=100, wait_count=60)
# Connect to cluster
client = Client(cluster)
# Display cluster dashboard URL
clusterYou need:
from dask_gateway import Gateway
from dask.distributed import Client
gateway = Gateway()
cluster = gateway.new_cluster()
cluster.adapt(minimum=2, maximum=100)
client = Client(cluster)
clusterexample notebook:
http://gallery.pangeo.io/repos/TomAugspurger/pangeo-dask-gateway/using-dask-gateway.html
blog post:
https://medium.com/pangeo/pangeo-with-dask-gateway-4b638825f105
You'll also need to update your binder configuration to ensure you're using dask_gateway>0.7.1
from pangeo-binder.
Related Issues (20)
- 404 with nbgitpuller on pangeo gallery HOT 4
- New DockerHub Image retention policies will delete unused images after 6 months
- AWS BinderHub deploy failed on staging HOT 8
- Update prometheus-operator deployments HOT 5
- Failing deployment on AWS staging HOT 5
- Dask-Gateway Workers in CrashLoopBackOff HOT 2
- Patch setting of AWS credential file environment variable
- Can't set environment variables for dask-gateway HOT 1
- prod deployment failed on both AWS and GCP HOT 6
- Set cluster limits
- AWS binder failing to launch sessions due to SSL certificate problem HOT 3
- can't launch dask gateway cluster if image has dask-gateway>=0.9 HOT 7
- temporarily disabled aws binder due to bitcoin mining HOT 5
- Redirect problem with static file viewing
- Simple Pangeo binder spin up failing on provision HOT 4
- Launching server fails HOT 11
- Failing to build image (Docker Rate Limit for jupyter/repo2docker) HOT 3
- binder.pangeo.io shut down due to crypto mining HOT 7
- Unable to get AWS pangeo binder to work HOT 4
- Can't get R-based Conda environment to deploy
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pangeo-binder.