Comments (8)
Application metrics is something we have been wanting to collect in
heapster for a while. But most of the existing monitoring solutions use
either collectd or statsd and so we were looking at leveraging them for
application metrics. Native support in heapster sounds even better. My
concern is that of diverging from the open source community around
monitoring.
On Fri, Mar 20, 2015 at 3:21 AM, Jimmi Dyson [email protected]
wrote:
Currently Heapster collects metrics from cAdvisor to gather container
level metrics. Collecting application level metrics would provide an even
richer set of data. Applications would be required to implement an http
endpoint to expose the metrics that it wants to publish.As a PoC, we have a heapster fork, jadvisor (
https://github.com/fabric8io/jadvisor), that collects JVM stats via JMX
exposed via Jolokia (http://jolokia.org/) for http access to JMX.
Currently the stats that are collected are hard-coded, or rather discovered
by what is available in the JMX tree. I would like to make this more
generic so it can handle any http endpoint & hence be stack agnostic.The difference that this would introduce to heapster is the need to
connect to individual pods rather than just to the kubelet/cadvisor so
would increase the number of connections made significantly. This would
likely require work on clustering & sharding to implement properly.—
Reply to this email directly or view it on GitHub
#173.
from heapster.
Agreed that heapster should support statsd & collectd, but running those would require extra setup rather than natively supporting collection in heapster.
Also heapster providing discovery of what to monitor would probably be easier than configuration of collectd & statsd to do the same. My initial thoughts on this were to use selectors to collect configured metrics over http. I'm not sure how you would achieve that simply with statsd/collectd. Adding a REST service to heapster to allow for dynamic configuration of metrics collectors would make this even better IMO.
from heapster.
Application type discovery is an open issue in kubernetes. Filed an issue to discuss
that.
Filed #177 for dynamic backend configuration.
from heapster.
Thanks for raising those. Wonder if it's worth pushing on with using labels while the discussion around discovering application types via the Kubernetes API kicks off?
from heapster.
from heapster.
from heapster.
subscribe. @jjw27
from heapster.
Possible with custom metrics. Support in Heapster is done.
from heapster.
Related Issues (20)
- Error pulling heapster-influxdb-amd64:v1.5.2 HOT 16
- ARM image for heapster-influxdb missing HOT 4
- Cpu/usage - what does it mean 'cumulative'? HOT 6
- don't pull images HOT 3
- can k8s 1.11.0 version use heapster 1.4.2 version? HOT 3
- Grafana displays the pods which have been deleted long ago HOT 4
- Changing container names -> series growth HOT 5
- Multiple Deployment Errors HOT 7
- node_utilization count only metrics from the docker? HOT 2
- Graphite sink reports filesystem metrics for different POD volumes in same timeseries/metric HOT 3
- heapster version is not bumped heapster-1.5.4 tag. HOT 4
- Retention policy not work in influxdb sink HOT 1
- did not create cluster, pods dashboard in grafana HOT 5
- [Elasticsearch Sink] Healthcheck fails with ES 5.6.3 as 'timeout' not supported.
- Deploy heapster result:error HOT 4
- influxdb error: Mapping Values not Allowed in This Context HOT 3
- grafana page require setting root_url to work through kubernetes apiserver proxy HOT 2
- panic: runtime error: invalid memory address or nil pointer dereference
- Invalid pod level metrics HOT 1
- heapster log reporting Failed to create influxdb
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from heapster.