Redis command failures & command timeouts after adding a new Master about hiredis-cluster HOT 9 OPEN

@SS-TruMinds Regarding the observed multiple connect callbacks, do you know if the status argument in the callbacks are REDIS_OK or REDIS_ERR? One scenario might be that the last callback is REDIS_OK, while the first ones are REDIS_ERR which wont trigger a disconnect callback. The disconnect callback should only be called after a successful connect.

Ran this again & we do see disconnects after connects. It seems the client keeps losing connection to the newly added Master, and keep trying to connect again & again.
cluser state on redis-cli is 'ok'

from hiredis-cluster.

Thanks for the report! It's appreciated. Your testing helps us improve this library.

We'll try to reproduce this and solve this, hopefully soon. If you have a test case that can reproduce this issue, we're happy if you can share it.

from hiredis-cluster.

@SS-TruMinds Which version of Redis are you running towards?

from hiredis-cluster.

@SS-TruMinds Which version of Redis are you running towards?

Hello, we are using Redis v7.0.4

from hiredis-cluster.

Thanks for the report! It's appreciated. Your testing helps us improve this library.

We'll try to reproduce this and solve this, hopefully soon. If you have a test case that can reproduce this issue, we're happy if you can share it.

Thank you.

We have a 3 node Redis cluster running in a Kubernetes namespace, and an application performing CRUD operation on some keys running in another namespace. The issue starts after we add a 4th node while the test is still running.

We have also observed multiple connect callbacks from this new node. There are no disconnect callbacks in between, just connect callbacks one after the other.

Thank you.

from hiredis-cluster.

@SS-TruMinds Regarding the observed multiple connect callbacks, do you know if the status argument in the callbacks are REDIS_OK or REDIS_ERR?
One scenario might be that the last callback is REDIS_OK, while the first ones are REDIS_ERR which wont trigger a disconnect callback. The disconnect callback should only be called after a successful connect.

from hiredis-cluster.

We ran this again, and did notice disconnect callbacks too after connect callback. It seems the connection is not stable & we keep seeing connects followed by disconnects.
On redis-cli, cluster info command shows cluster_state:ok

from hiredis-cluster.

I have found an issue with missing callbacks when the ASKING command is not sent due to a disconnect.
This might be related but its not obvious to me, will be fixed.

from hiredis-cluster.

Solved by #120?

from hiredis-cluster.