Giter Club home page Giter Club logo

Comments (10)

compilenix avatar compilenix commented on August 26, 2024

the network problem was on my end and had nothing to do with ceph-csi.

it's still not working and the logs are looking the same as uploaded.

from ceph-csi.

rootfs avatar rootfs commented on August 26, 2024

at least the ceph keyring doesn't look right to me in the provisioner log, there was an extra trailing \n
AQDi4QVa4oKkKRAAjNMW7IzhwfqSDFWyW2jaxQ==\n

Please recreate the secret with
echo -n AQDi4QVa4oKkKRAAjNMW7IzhwfqSDFWyW2jaxQ==|base64

from ceph-csi.

rootfs avatar rootfs commented on August 26, 2024

please also attach the driver log from container csi-rbdplugin here https://github.com/ceph/ceph-csi/blob/master/deploy/rbd/kubernetes/csi-rbdplugin.yaml#L41

from ceph-csi.

compilenix avatar compilenix commented on August 26, 2024

Thanks, i've recreated the secret, this part looks fine now.
A pvc can't be created, yet.

Here are the current logs:
logs-from-csi-provisioner-in-csi-rbdplugin-provisioner-0(1).txt
logs-from-csi-rbdplugin-attacher-in-csi-rbdplugin-attacher-0(1).txt
logs-from-driver-registrar-in-csi-rbdplugin-kqdsj.txt
logs-from-csi-rbdplugin-in-csi-rbdplugin-kqdsj.txt

from ceph-csi.

rootfs avatar rootfs commented on August 26, 2024

this is where rbd got stuck,

rbd: status pvc-6fa0d2c1e2d811e8 using mon pve2.wbig-wg.net:6789,pve3.wbig-wg.net:6789,pve6.wbig-wg.net:6789, pool test id kubernetes key AQAWDeJbnPREOhAASSyoGW8YmZPM49ct5AQlvQ==

can you check on your rbd driver container, if
rbd status --pool test -m pve2.wbig-wg.net:6789,pve3.wbig-wg.net:6789,pve6.wbig-wg.net:6789 --id kubernetes --key=AQAWDeJbnPREOhAASSyoGW8YmZPM49ct5AQlvQ== pvc-6fa0d2c1e2d811e8 works?

from ceph-csi.

compilenix avatar compilenix commented on August 26, 2024 
# kubectl exec csi-rbdplugin-kqdsj -c csi-rbdplugin -i -t -- sh -il
sh-4.2# rbd status --pool test -m pve2.wbig-wg.net:6789,pve3.wbig-wg.net:6789,pve6.wbig-wg.net:6789 --id kubernetes --key=AQAWDeJbnPREOhAASSyoGW8YmZPM49ct5AQlvQ== pvc-6fa0d2c1e2d811e8
2018-11-08 14:00:32.896988 7f1f2467ad40 -1 did not load config file, using default settings.
2018-11-08 14:00:32.901703 7f1f2467ad40 -1 Errors while parsing config file!
2018-11-08 14:00:32.901718 7f1f2467ad40 -1 parse_file: cannot open /etc/ceph/ceph.conf: (2) No such file or directory
2018-11-08 14:00:32.901720 7f1f2467ad40 -1 parse_file: cannot open ~/.ceph/ceph.conf: (2) No such file or directory
2018-11-08 14:00:32.901721 7f1f2467ad40 -1 parse_file: cannot open ceph.conf: (2) No such file or directory
2018-11-08 14:00:32.902992 7f1f2467ad40 -1 Errors while parsing config file!
2018-11-08 14:00:32.903005 7f1f2467ad40 -1 parse_file: cannot open /etc/ceph/ceph.conf: (2) No such file or directory
2018-11-08 14:00:32.903007 7f1f2467ad40 -1 parse_file: cannot open ~/.ceph/ceph.conf: (2) No such file or directory
2018-11-08 14:00:32.903007 7f1f2467ad40 -1 parse_file: cannot open ceph.conf: (2) No such file or directory
2018-11-08 14:00:32.946054 7f1f2467ad40 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.kubernetes.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin,: (2) No such file or directory

and

ls -la /etc/ceph/
total 12
drwxr-xr-x 2 root root 4096 Oct 26 14:08 .
drwxr-xr-x 1 root root 4096 Nov  7 21:58 ..
-rw-r--r-- 1 root root   92 May 21 11:32 rbdmap

from ceph-csi.

compilenix avatar compilenix commented on August 26, 2024

I also tried the following:

# rbd du --pool test -m pve2.wbig-wg.net:6789,pve3.wbig-wg.net:6789,pve6.wbig-wg.net:6789 --id kubernetes --key=AQAWDeJbnPREOhAASSyoGW8YmZPM49ct5AQlvQ==

the output is the same and the command does hang / not complete.

from ceph-csi.

compilenix avatar compilenix commented on August 26, 2024

Ahh i found that the ceph monitor does listen on a seperate ip address and not to any address (as i assumed). the cli test from the container works now.

i'll try this by updating the config that the pod's use and report here again.

from ceph-csi.

compilenix avatar compilenix commented on August 26, 2024

Nice, it's working now \o/

# kubectl get persistentvolumeclaim 
NAME      STATUS    VOLUME                 CAPACITY   ACCESS MODES   STORAGECLASS   AGE
rbd-pvc   Bound     pvc-cb045cc4e36111e8   4Gi        RWO            csi-rbd        43s

Most of the times, it's the little things ;)

Thanks @rootfs for pointing me into the right direction!

from ceph-csi.

rootfs avatar rootfs commented on August 26, 2024

cool!

from ceph-csi.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.