TickTock just shutting down about ticktock HOT 9 CLOSED

@Soren-klars Sorry to hear about the crash. We are still in beta and currently fully focusing on perf. Absolutely lots of stability works need to be done.

I haven't had a chance to run in Orange PI but I look at your log and realize that you are using a pretty old version 0.3.10. Would you mind to try the latest version 0.10.2 which already resolved lots of corner cases causing TT to crash? One thing to mention is that you will have to start from scratch by removing all the data files and append logs in 0.3.10, since 0.10.* is a major design change and uses different data format than previous versions.

TT doesn't restart itself if crash. You can add TT as a systemctl service to achieve that.

We may need to find an Orange PI to fully test TT.

Thanks for making TT better.

from ticktock.

Thanks for the quick response. I did install it from the latest sources now and let's see. I will try to re-import the old data per script via http requests.
Thanks guys for all your work, it looks very promising...
I'm happy to test more if you want.

from ticktock.

@Soren-klars We just realized another bug in 0.10.2. It will lead to incorrect floating values, though no crash issue. Please use v2 compressor instead of the default v3 compressor. Just add this line into your config and restart from scratch.

tsdb.compressor.version = 2

Thanks.

from ticktock.

I have the same signal 11 (SIGSEGV) crash from time to time. It always happened when querying (I'm using Grafana - query is quite simple). If it happened once, it re-happens when running the same query again. I always had to throw away the whole database after such an error because it seemed not to self heal - which indeed is annoying.

I already spent some hours but unfortunately wasn't able to drill it down to a reproducible scenario yet - still working on this.
My current working approach - it's related to metrics having the same name but different cardinality of the tag lists.

I'm running version 0.11.4 compiled from sources on my own.
My hardware: ARM32 (ODROID HC1 with Ubuntu Linux - 5.4.227-248 #1 SMP PREEMPT Thu Dec 15 11:36:07 EST 2022 armv7l armv7l armv7l GNU/Linux)

from ticktock.

Next time it happens, do you mind sending us the content of the whole data directory? Plus the config file. Thanks!

from ticktock.

Yes I'm working on it.
Unfortunately the last times it happened my database had about 80-100 megabytes ~5 weeks of collected data.

I hope to get it "a little" smaller :)

from ticktock.

@jens-ylja Looks to me your crash issue (caused by query) is different from the crash in this thread which is caused by compact and fixed in 0.10.4-beta already. Please feel free to open a new issue once you have a repro.

Unfortunately I don't have your hardware ODRoid HC1 for a repro. I try 0.11.5 in RaspberryPI-zero-w with ARM32 and it works with Grafana. Hope you can share with us the data, config, and queries when you get a chance to repro it.

from ticktock.

Also, consider moving to the latest version (v0.11.6).

from ticktock.

@ylin30 - OK, I'll create a new issue.

from ticktock.