Cannot connect to cluster in 2023.6.0 about dask-kubernetes HOT 6 CLOSED

@jacobtomlinson Should we add a smoke test that installs the helm operator and runs a simple cluster? 🤔 Or is there a reason this would have been caught?

from dask-kubernetes.

Ok I've fixed the bug in kr8s and released v0.6.0. Then in #752 I've bumped our dependency here and tested the helm chart locally using the pytest-kind cluster.

Build the dev image

$ docker build -t ghcr.io/dask/dask-kubernetes-operator:dev -f dask_kubernetes/operator/deployment/Dockerfile .

Load the image into Kubernetes

$ kind load docker-image --name pytest-kind ghcr.io/dask/dask-kubernetes-operator:dev

Install the helm chart

$ cd dask_kubernetes/operator/deployment/helm/

$ helm install --generate-name ./dask-kubernetes-operator --set image.tag=dev

Create a cluster

In [1]: from dask_kubernetes.operator import KubeCluster
   ...: cluster = KubeCluster(name="foo", n_workers=1)
╭───────────────────────── Creating KubeCluster 'foo' ─────────────────────────╮
│                                                                              │
│   DaskCluster                                                      Running   │
│   Scheduler Pod                                                    Running   │
│   Scheduler Service                                                Created   │
│   Default Worker Group                                             Created   │
│                                                                              │
│ ⠇ Getting dashboard URL                                                      │
╰──────────────────────────────────────────────────────────────────────────────╯

In [2]: 

I'm going to cut another release here and things should be good!

from dask-kubernetes.

2023.6.1 is up on PyPI. Conda Forge is still stuck on 2023.3.2 due to some packaging issues but will skip right over this problem. So I'm going to close this out.

Looking forward to seeing the tests @bstadlbauer.

from dask-kubernetes.

It looks like kr8s is unable to find the service account credentials that are being provided by the Dask Operator helm chart. I'm investigating now.

from dask-kubernetes.

Yeah I think that's a great idea.

from dask-kubernetes.

Thank you! I've been working on the automated test but my kind cluster wouldn't come up on the train 🤦

from dask-kubernetes.