Comments (4)
@outofrange I believe you can fetch information about each block inside their meta.json
file, including the byte size of the block's index and chunk files. With this information you shouldn't need to do a recursive list in the object storage to calculate size.
I often download the meta.json
file through the Compactor UI to look at the size of chunks and indexes. Would be awesome to have this information there directly in the page.
Feel free to work on this and come over to #thanos-dev in the CNCF slack if you need any help.
from thanos.
@douglascamata PR is open :)
I added values I'd benefit from:
- total size of blocks
- size of all chunks and size of index - also in relation to total size, to get a feeling for index overhead on different compaction levels
- daily growth to estimate future storage requirements and compare different compaction levels
- sum of all block sizes per source
Not sure if this is either too much, or could benefit from more or a different presentation, so I'd be happy for feedback :)
from thanos.
#3221 can 100% be closed. I'll do it.
#3219 not yet, as most of its stats are per block stream. We are discussing block stream UI improvements on #7237.
from thanos.
#3221
I am wondering if we can finally close this?
And maybe this one #3219
from thanos.
Related Issues (20)
- Extend Thanos bucket rewrite to support filtered archiving of existing blocks
- Support additional aggregates for downsampling
- Store Announced LabelSets Unexpected
- Warning in Grafana 11+: Thanos Receive dashboard depends on Angular
- compactor: Thanos Compactor compaction level number being set to 93+ for 1 half of HA Prometheus (S3 Storage) HOT 3
- Query: Network bandwidth usage upward of 500MB/s between Querier and configured stores HOT 17
- Codespace doesn't seem to be working
- AWS S3 objectstorage is not working for ap-south-2 region inspite of endpoint and region is mentioned and getting default to dualstack endpoint of us-east-1 HOT 7
- Thanos receive running on ext4 FS experiencing compaction failures HOT 10
- query: If i choose time window shorter than 6 months, i don't see downsampled metrics HOT 6
- compact: Thanos Compactor doesn't delete blocks which are marked for deletion HOT 2
- [Bug] Gaps in sum and avg aggregations when joining histogram quantile with pod labels
- store: disk usage continually increasing over time HOT 6
- Thanos store does not show data in downsampled block
- Receive: compaction failure causing query returning irrelevant time series HOT 2
- found duplicate storeEndpoints producer (sidecar or ruler)
- Compactor: Downsample second pass creates duplicate blocks HOT 2
- thanos compact panic on GetActiveAndPartialBlockIDs HOT 4
- why can't thanos fail properly on errors (like everone else)? HOT 2
- compactor: Fails cleaning blocks marked for deletion with Access Denied (solved)
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from thanos.