Hi, thanks for the great work. I'm curious about the default data retention days of OS

Hi <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="

<a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/us

Data retention of OSS version about hyperdx HOT 2 CLOSED

shan-mx commented on June 1, 2024

Data retention of OSS version

from hyperdx.

wrn14897 commented on June 1, 2024

Hi @shan-mx, thanks for bringing this issue up. The default data retention is a month (source:

Line 283 in 2769576

TTL toDateTime(_created_at) + INTERVAL 1 MONTH DELETE

). We should make it obvious to customize the data retention. Currently the way to do it is to run a command to update the clickhouse tables schema:

docker compose exec ch-server clickhouse-client

Let's say we want to bump the retention to 90 days.

ALTER TABLE log_stream MODIFY  TTL toDateTime(_created_at) + INTERVAL 90 DAY DELETE

ALTER TABLE metric_stream MODIFY  TTL toDateTime(_created_at) + INTERVAL 90 DAY DELETE

Hope this is helpful :)

from hyperdx.

shan-mx commented on June 1, 2024

@wrn14897 Thank you for your detailed response. It's very helpful to me!

from hyperdx.