tommyulfsparre / aurora_exporter Goto Github PK
View Code? Open in Web Editor NEWPrometheus Aurora exporter
License: Apache License 2.0
aurora_exporter's People
Contributors
Stargazers
Watchers
aurora_exporter's Issues
Support HTTPS URL endpoints
Hi,
When attempting to provide an HTTPS url to the exporter.aurora-url flag I get "finder: bad address" error message. It looks like http is the only supported check in https://github.com/tommyulfsparre/aurora_exporter/blob/master/finder.go#L27
Could you please add support for HTTPS endpoints? (In my case, I'm using a load balancer in front of the schedulers with ssl termination.
Thanks for this very handy tool!
Create default aurora_exporter console template
As a community it is probably worthwhile to invest into a common set of consoles for Aurora. Otherwise everyone has to re-invent the basics.
Does anyone still have something worth sharing?
I have a very rudimentary template plotting the content of Aurora's task store (total and deltas) that I am willing to share, if there is some interest.
Same name and value values
An error has occurred during metrics collection:
3 error(s) occurred:
* collected metric aurora_tasks_pending label: label: label: gauge: was collected before with the same name and label values
* collected metric aurora_tasks_pending label: label: label: gauge: was collected before with the same name and label values
* collected metric aurora_tasks_pending label: label: label: gauge: was collected before with the same name and label values
Build broken with latest prometheus/client_golang
A recent change to prometheus/client_golang has broken this build. (prometheus/client_golang@2fee50b) Would be nice if your external dependencies were explicitly versioned to ensure new users dont run into compatibility issues as your dependent libraries update.
GOROOT=/Users/gabe/code/go/src/github.com/tommyulfsparre/aurora_exporter/.build/go1.7.1 GOPATH=/Users/gabe/code/go/src/github.com/tommyulfsparre/aurora_exporter/.build/gopath /Users/gabe/code/go/src/github.com/tommyulfsparre/aurora_exporter/.build/go1.7.1/bin/go build -o aurora_exporter
# _/Users/gabe/code/go/src/github.com/tommyulfsparre/aurora_exporter
./vars.go:503: metric.(prometheus.Counter).Set undefined (type prometheus.Counter has no field or method Set)
make: *** [aurora_exporter] Error 2
The workaround:
[19:13:40] [gabe@dev-96dbecdb] ( 2 ) ~/.gvm/pkgsets/go1.7/global/src/github.com/tommyulfsparre/aurora_exporter master
-> $ cd .build/gopath/src/github.com/prometheus/client_golang/
~/.gvm/pkgsets/go1.7/global/src/github.com/tommyulfsparre/aurora_exporter/.build/gopath/src/github.com/prometheus/client_golang master
-> $ git reset --hard 2fee50beaa152342e8347c41edf2202c3bd5f858^
HEAD is now at 6450fc5 Convert process collector to const metrics
[19:14:14] [gabe@dev-96dbecdb] ( 0 ) ~/.gvm/pkgsets/go1.7/global/src/github.com/tommyulfsparre/aurora_exporter master
-> $ make
GOROOT=/home/gabe/.gvm/pkgsets/go1.7/global/src/github.com/tommyulfsparre/aurora_exporter/.build/go1.7.1 GOPATH=/home/gabe/.gvm/pkgsets/go1.7/global/src/github.com/tommyulfsparre/aurora_exporter/.build/gopath /home/gabe/.gvm/pkgsets/go1.7/global/src/github.com/tommyulfsparre/aurora_exporter/.build/go1.7.1/bin/go build -o aurora_exporter
Inplement a more robust serverset discovery implementation for zookeeper.
The current Zookeeper finder does not watch the member_ document. Additionally a few items I have and will continue working on for a PR in the near future is:
- ZK Auth
- ACL/Group
- Watch leader node at
member_(\d+) - Allow ZK ensemble to be provided in the format as used by other zk:// aware services
- Remove static port definition and get port from the serverset.
I have started this but should have a PR to open in a couple weeks as time allows.
SLA metrics per job
add sla metrics per job_key. The job_key should be extracted into Prometheus labels.
The aurora url should be able to be a zookeeper ensemble address
That way when you have many schedulers in a HA configuration, it will find the current one.
Scraping of /quota fails for non-leading master
The recently added quota scraping (#21) fails on non-leading masters when the exporter.bypass-leader-redirect flag is used.
We query all masters individually with the flag exporter.bypass-leader-redirect. Via the HTTP header Bypass-Leader-Redirect: true this asks Aurora to serve requests by the queried instance rather than by the leading master.
For the /qutoas endpoint this results in an internal server error:
<html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 500 </title>
</head>
<body>
<h2>HTTP ERROR: 500</h2>
<p>Problem accessing /quotas. Reason:
<pre> org.apache.aurora.scheduler.storage.Storage$TransientStorageException: Storage is not READY</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.11.v20160721</a><hr/>
</body>
</html
The exporter then chokes on this error
main.go:224] invalid character '<' looking for beginning of value
I will have a look at this, but I am unsure yet if we'd want to fix this in Aurora, in the exporter, or maybe even both.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.