Comments (9)
When setting GOMAXPROCS
we prefer to do it in the Jsonnet or Helm chart based on testing. It's unlikely we'd ever want components doing it automatically.
from mimir.
yes, it goes over a variable, same as the limit/requests are set.
but, we have to inform the container about the resources that linux will provide.
to avoid the container to be killed, it will go slow but will not be killed.
and cpu the same, it will run slow but it will not be throttled.
slow x crash.
from mimir.
it will work like this, close to limit, but never cross it:
from mimir.
the documentation:
https://github.com/uber-go/automaxprocs
from mimir.
not sure why it is marked closed.
it is related to Mimir
https://github.com/grafana/mimir/tree/main/operations/helm/charts/mimir-distributed
from mimir.
I don't understand your point. GOMAXPROCS
and GOMEMLIMIT
can already be set via the Helm chart or Jsonnet today to whatever values you like. Automatically setting them from the application binary using automaxprocs
is not something we're interested in doing. The behavior you're describing is already possible today with no changes.
from mimir.
today, we are getting ingester crash due OutofMemory.
in order to use GOMAXPROCS and GOMEMLIMIT, we shall include into the code
_ "go.uber.org/automaxprocs"
and compile it.
during the startup it will show :
must be on import:
from mimir.
in order to use GOMAXPROCS and GOMEMLIMIT, we shall include into the code
Using these variables doesn't require the automaxprocs
library, they're supported by the go runtime.
I'd suggest you read this documentation:
https://pkg.go.dev/runtime#GOMAXPROCS
https://dave.cheney.net/2015/11/29/a-whirlwind-tour-of-gos-runtime-environment-variables
from mimir.
good point, Thanks Nick
I will test it
env:
- name: GOMAXPROCS
value: 8
- name: GOMEMLIMIT
value: "42GiB"
and
ingester:
persistentVolume:
size: 40Gi
replicas: 3
resources:
limits:
memory: 42Gi
cpu: 8
requests:
cpu: 4
memory: 12Gi
from mimir.
Related Issues (20)
- Alert State History from Mimir
- ingester.max-global-series-per-user: 2000000 is not parsable in ingester values HOT 3
- Chunk compression at rest HOT 3
- Unable to deploy helm-chart mimir-distributed with ArgoCD when setting any of `rbac.podSecurityContext` to `null`
- Lots of `"error processing requests from scheduler"` in querier logs HOT 3
- Test flake: TestDistributor/caching_unmarshal_data_disabled/reduce_native_histogram_buckets_via_down_scaling HOT 6
- Prometheus is crashign with Mimir push errors HOT 2
- failed to fetch some blocks | err-mimir-store-consistency-check-failed
- mimir-distributed Chart Env Var Expansion Failure: S3 Access Key and Access Key ID HOT 1
- [ingester] Ingester service state and lifecycler ring state not synchronized HOT 4
- Compactor fails to upload indexes larger than 1G to swift object storage
- Scrape commit failed" err="write to WAL: log samples: write data/wal/XXXXXXXX: no space left on device HOT 1
- Helm: Missing fields in Topology Spread Constraints
- Ruler Pods OOM/spike in memory observed with warning log closing ingester client stream failed
- store-gateway: add timeout to index-header loading
- Mimir returns HTTP status 422 in cases where 5xx makes more sense
- Docs: Update references to mmap in store-gateway architecture
- Query with aggregation return incorrect num of points HOT 1
- [mimir-distributed] Add additionalRuleLabels to PrometheusRule alerts HOT 1
- Request per Second Metric Does Not Sync with Total Request Count in Mimir Visualization
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from mimir.