denisok / elk_supportconfig Goto Github PK

• non standard keyring location (may be caused from a non-std. ceph-deploy for eg)

2018-01-08 11:32:03.256234 7fedbd3a9e00 -1 auth: unable to find a keyring on /var/lib/ceph/radosgw/ceph-rgw/keyring: (2) No such file or directory
2018-01-08 11:32:03.256294 7fedbd3a9e00 -1 monclient: ERROR: missing keyring, cannot use cephx for authentication
2018-01-08 11:32:03.256297 7fedbd3a9e00  0 librados: client.rgw initialization error (2) No such file or directory
2018-01-08 11:32:03.256768 7fedbd3a9e00 -1 Couldn't init storage provider (RADOS)

In this particular case there was a missing keyring

• Wrong keyring format
  For eg. a keyring is copy pasted from ceph auth list

2018-01-09 12:36:07.389254 7fb4eb01be00  0 librados: client.rgw authentication error (22) Invalid argument
2018-01-09 12:36:07.390270 7fb4eb01be00 -1 Couldn't init storage provider (RADOS)

parse mon's audit log to have a dashboard with commands that were executed for Ceph.

for salt/deepsea

SaltRenderError: Jinja variable 'salt.utils.templates.AliasedLoader
object' has no attribute 'WHAT_EVER_MODULE'

can also be limited to grep to SaltRenderError

The minion function caused an exception

after this there is usually a traceback which gives you a good insight..

Module function cephprocesses.wait executed

means that something something timed out and needs to be investigated

I'll update the issue once I find more

usual error not wiping old partition

2018-05-03 14:32:09.209742 7f1712c5ad00 1 bdev(0x560395346a00 /var/lib/ceph/tmp/mnt.Tg0cwp/block) open size 399982530560 (0x5d20d11000, 372 GB) block_size 4096 (4096 B) non-rotational
2018-05-03 14:32:09.209943 7f1712c5ad00 -1 bluestore(/var/lib/ceph/tmp/mnt.Tg0cwp/block) _check_or_set_bdev_label bdev /var/lib/ceph/tmp/mnt.Tg0cwp/block fsid bd9789c3-340b-40ba-8cc4-84e5ad963678 does not match our fsid aef452f5-75d1-4699-b3f6-b1aaa13737fc
2018-05-03 14:32:09.209949 7f1712c5ad00 1 bdev(0x560395346a00 /var/lib/ceph/tmp/mnt.Tg0cwp/block) close
2018-05-03 14:32:09.483483 7f1712c5ad00 -1 bluestore(/var/lib/ceph/tmp/mnt.Tg0cwp) mkfs fsck found fatal error: (5) Input/output error
2018-05-03 14:32:09.483510 7f1712c5ad00 -1 OSD::mkfs: ObjectStore::mkfs failed with error (5) Input/output error
2018-05-03 14:32:09.483665 7f1712c5ad00 -1 ^[[0;31m ** ERROR: error creating empty object store in /var/lib/ceph/tmp/mnt.Tg0cwp: (5) Input/output error^[[0m