Error during insertions about clickhouse_sinker HOT 12 CLOSED

There is a config named retryTimes. see https://github.com/housepower/clickhouse_sinker/blob/master/output/clickhouse.go#L133

from clickhouse_sinker.

@bun4uk
Well if you implement at-least-once delivery
them you can just reset an offset for your Kafka consumer group

1. stop clickhouse_sinker
2. reset the offset
3. start clickhouse_sinker

or as an option, if you don't wanna stop the ingestion
and you need to re-fill the gap you many start another instance of clickhouse_sinker
with the same configuration but with another Kafka group-id and stop it later when the gap gonna will re-filled

from clickhouse_sinker.

I think this option is to manual. I'm looking for a way how to prevent such outages.
In my case, I have 4 ch nodes with 2 shards and 2 replicas. What do you think of the usage of haproxy for rebalancing insertion load?

You can set multiple hosts separated by a comma, such as host1,host2,host3 for rebalancing inserts.

Yes, a delay between retries can be a feature option, but ClickHouse has many more error codes, such as Table is in read only mode, Missing columns, Table does not exist. It's hard to catch all error expectations.

from clickhouse_sinker.

@sundy-li
Thanks! That's a good option.
But what if the Clickhouse server will be unreachable for several minutes and all retries will be run out?
Is there a way to prevent data loss in the database?

from clickhouse_sinker.

@ArtemChekunov thanks!
I think this option is to manual. I'm looking for a way how to prevent such outages.
In my case, I have 4 ch nodes with 2 shards and 2 replicas. What do you think of the usage of haproxy for rebalancing insertion load?

from clickhouse_sinker.

@bun4uk
you may look at chproxy

from clickhouse_sinker.

@ArtemChekunov will check. Thanks

from clickhouse_sinker.

@ArtemChekunov
Wait, chproxy works over HTTP and Clickhouse-sinker works over TCP.

from clickhouse_sinker.

Hmm indeed

from clickhouse_sinker.

@sundy-li is there any param to set a delay between reties?

from clickhouse_sinker.

@sundy-li
Am I right understood? In case of insertion error, clickhouse-sinker would initiate retry and it will choose some random host from the host-list?

from clickhouse_sinker.

@sundy-li
Am I right understood? In case of insertion error, clickhouse-sinker would initiate retry and it will choose some random host from the host-list?

Yes

from clickhouse_sinker.