samsaffron / graphite_docker Goto Github PK

Hi!

I've been using this image in production for a couple of weeks now, gathering various metrics on the health of my system. I'm sending data to StatsD over UDP, and I have a Grafana dashboard where I view the data. It's been working great with no issues until yesterday, when I suddenly started to get "gaps" in my counter metrics.

Here's a couple of screenshots that shows graphs over a few different metrics for the same timespan:

In the first two graphs - whose metric type are counters - there are two large gaps. However, the third and fourth graph - whose metrics are timer and gauge - does not have any gaps.

Does anyone have any idea of what might be going on?

What I've checked so far:

• Disk IO is low (An answer to http://serverfault.com/questions/533198/graphite-stops-collecting-data-randomly seems to suggest that one could see similar symptoms if an IOPS bottleneck is encountered)
• Since it's still collecting timer and gauge data, it seems unlikely to be a network problem.
• The following script reported no whisper file corruptions: https://gist.github.com/gonsfx/4111791

I expected to see Grafana on port 81, nothing shows though. Is there something I need to configure?

Great image! We're finding it really useful as a workbench to locally test monitoring for apps.

It'd be extremely helpful if you could setup an automated build on Docker Hub for this project. Then the README could be changed to refer to e.g. "docker run .. samsaffron/graphite" instead of the somewhat outdated "nickstenning/graphite". These days Docker Hub can build directly from github and can use Web Hooks to automate it, some info is available at

https://docs.docker.com/docker-hub/github/

Hello,

I was following this link and came across to use this docker to setup graphite web view. Grafana web interface worked fine. I am stuck on graphite web view. It says OperationalError: no such table: auth_user
Error log image for your reference

I am using this docker thing first time, so might be missing something in the process.

To best of my knowledge, logging into grafana should allow be to add carbon/graphite as datasource. I've tried to put localhost as $(docker-machine ip) in the URL section of new Datasource but I have only the "Failed to add datasource" message.

What am I doing wrong? What can I check to provide further details for this problem?

Hi,

Could you add more details about the google auth:

Fill in the blanks in supervisord.conf before building the image, otherwise Google auth will not work. You will need to register an app on google see: https://github.com/bitly/google_auth_proxy for more details

I looked at supervisord.conf and I didn't see any obvious blank. I'm also not totally familiar with Docker, how am I supposed to edit this file before running? I also see there is a script file start, what does it do?

I really want to use your docker application because it contains everything I need, but I need more info about it.
Regards

Update to Grafana 2.1.3

hi,

how to start your docker only with Graphite + Carbon and not start Statsd + Grafana?
would it work if i only forward the related ports for Graphite + Carbon?

  graphite:
    image: samsaffron/graphite
    ports:
      - "2003:2003"
      - "2004:2004"
      - "7002:7002"
      - "8080:80"
    restart: always

how can i connect graphite-exporter to Graphite using your docker?

Thanks,
Arnold

In current Dockerfile, supervisior is not running as pid 1 therefore, it is not able to receive signals sent to docker container. Due to this, there is no graceful shutdown.

To enable graceful shutdown, cmd of Dockerfile should be cmd exec /usr/bin/init instead of cmd /usr/bin/init

The Dockerfile is using EXPOSE incorrectly. Currently it lists each port with both the container and host ports (expose 85:80 for example). It should really only list the ports that the container exposes.

Use docker run -p 85:80... to bind the container port to the host port.

I am a docker newbie so please forgive me if these are stupid questions.

I am unable to bind volumes from host to container for graphite, elasticdata or supervisor logs. The crux seems to be permissions. The carbon and graphite run as www-data but if I start docker like your example. The host folder will only be writable by root (and the container docker user) not by www-data.

docker run -v /data/graphite:/var/lib/graphite/storage/whisper
-d nickstenning/graphite

How do you handle permissions for the container process users to write to the host volumes?

I noticed that my graphite graphs were crashing with 500 errors ('LocalTimezone' object has no attribute 'localize'), and after digging in I found this issue:

graphite-project/graphite-web#1019

Adding pip install pytz to the Dockerfile made everything work again.

On container startup, following warning is thrown:

/var/lib/graphite/webapp/graphite/settings.py:244: UserWarning: SECRET_KEY is set to an unsafe default. This should be set in local_settings.py for better security warn('SECRET_KEY is set to an unsafe default. This should be set in local_settings.py for better security')

This is due to installation of python-django >= 1.5, which expects SECRET_KEY to be set.

Graphite can use Memcached to cache calculated targets including functions. Any plans to add that?

So with the latest update to django(1.9.x) when building the dock image will actually break the run command for the supervisor command, specifically

command = /usr/bin/gunicorn_django -b127.0.0.1:8000 -w2 graphite/settings.py

where gunicorn_django has been apparently been depricated and is no longer in use. The solution to use is to link gunicorn directorly with wsig, however I am not versed in python or django and cant get that command to run successfully.

How Do i i fix it?