Cannot open metric file: '/sys/fs/cgroup/memory/system.slice about dockbix-agent-xxl HOT 22 CLOSED

Sorry, I've asked you to follow https://github.com/monitoringartist/dockbix-agent-xxl#support
Did you read it? You didn't provide logs with DebugLevel=5! Please save my time and read README first.

Closing, because use didn't read README.

from dockbix-agent-xxl.

I set debug level to 5, see the pastebin link for logging of roughly 5 minutes of uptime.

https://pastebin.com/Wsy0w4va

from dockbix-agent-xxl.

   11:20170619:183658.072 In zbx_docker_dir_detect()
   11:20170619:183658.073 Cannot detect used docker driver

is your problem.

from dockbix-agent-xxl.

Ok, what driver specifically are we talking about here?
We are running docker version 1.12.6

from dockbix-agent-xxl.

Docker execution driver.

Are you able to run non dockerized zabbix agent with docker monitoring module on that host without any issue?

from dockbix-agent-xxl.

Such as installing it via Yum?
When I run docker info , I find 3 drivers listed, I am assuming these are NOT what you're talking about though.
Storage Driver: devicemapper
Logging Driver: splunk
Cgroup Driver: systemd

from dockbix-agent-xxl.

Yes, use yum/apt ... to install non dockerized version.

from dockbix-agent-xxl.

Yes. It starts correctly and is able to communicate with the Zabbix server.

3591:20170619:143559.350 Zabbix Agent stopped. Zabbix 2.0.20 (revision 64242).
6414:20170619:143559.379 Starting Zabbix Agent [shp-corp-shpyd01.swansonhealth.com]. Zabbix 2.0.20 (revision 64242).
6414:20170619:143559.379 In init_collector_data()
6414:20170619:143559.380 End of init_collector_data()
6415:20170619:143559.380 agent #0 started [collector]
6415:20170619:143559.380 In init_cpu_collector()
6415:20170619:143559.380 End of init_cpu_collector():SUCCEED
6415:20170619:143559.381 In update_cpustats()
6416:20170619:143559.381 agent #1 started [listener]
6417:20170619:143559.381 agent #2 started [listener]
6418:20170619:143559.381 agent #3 started [listener]
6415:20170619:143559.381 End of update_cpustats()
6419:20170619:143559.381 agent #4 started [active checks]
6419:20170619:143559.381 In init_active_metrics()
6419:20170619:143559.381 Buffer: first allocation for 100 elements
6419:20170619:143559.381 In send_buffer() host:'192.168.1.113' port:10051 values:0/100
6419:20170619:143559.381 End of send_buffer():SUCCEED
6419:20170619:143559.381 refresh_active_checks() host:'192.168.1.113' port:10051
6419:20170619:143559.382 sending [{
"request":"active checks",
"host":"CENSORED"}]
6419:20170619:143559.382 before read
6419:20170619:143559.386 got [{"response":"success","data":[]}]
6419:20170619:143559.386 In parse_list_of_checks()
6419:20170619:143559.386 In disable_all_metrics()
6419:20170619:143559.387 In process_active_checks() server:'192.168.1.113' port:10051)
6419:20170619:143559.387 End of process_active_checks()
6419:20170619:143559.387 In get_min_nextcheck()
6419:20170619:143559.387 Sleeping for 1 second(s)
6415:20170619:143600.381 In update_cpustats()
6415:20170619:143600.382 End of update_cpustats()
6419:20170619:143600.387 In send_buffer() host:'192.168.1.113' port:10051 values:0/100
6419:20170619:143600.387 End of send_buffer():SUCCEED
6419:20170619:143600.387 Sleeping for 1 second(s)
6415:20170619:143601.382 In update_cpustats()
6415:20170619:143601.382 End of update_cpustats()
6419:20170619:143601.387 In send_buffer() host:'192.168.1.113' port:10051 values:0/100
6419:20170619:143601.387 End of send_buffer():SUCCEED
6419:20170619:143601.388 Sleeping for 1 second(s)

from dockbix-agent-xxl.

Again you are wasting my time: non dockerized zabbix agent with docker monitoring module. You didn't started agent with docker module. I'm not a free Zabbix support, so please follow my instructions carefully, otherwise any support for you must be paid.

from dockbix-agent-xxl.

I am not trying to get support for Zabbix. The problem I have is with dockbix, which you wrote, correct?
I have setup all the other Servers without issue and have them reporting back to Zabbix. I apologize but the way you worded the previous reply/comment is very difficult to parse. I will attempt to find the docker monitoring module.

from dockbix-agent-xxl.

I have tried both the version provided on your page, and compiling the module myself, and I am getting an error "undefined symbol:zbx_alarm_timed_out", any thoughts on this? My version of Zabbix agent is 3.2 as is the version I downloaded/compiled.

28774:20170619:162301.307 Starting Zabbix Agent [Zabbix server]. Zabbix 3.2.0 (revision 62485).
28774:20170619:162301.307 **** Enabled features ****
28774:20170619:162301.307 IPv6 support: YES
28774:20170619:162301.307 TLS support: YES
28774:20170619:162301.307 **************************
28774:20170619:162301.307 using configuration file: /etc/zabbix/zabbix_agentd.conf
28774:20170619:162301.307 In zbx_load_modules()
28774:20170619:162301.307 loading module "/var/lib/zabbix/modules//zabbix_module_docker.so"
28774:20170619:162301.307 cannot load module "zabbix_module_docker.so": /var/lib/zabbix/modules//zabbix_module_docker.so: undefined symbol: zbx_alarm_timed_out
28774:20170619:162301.307 End of zbx_load_modules():FAIL
28774:20170619:162301.307 loading modules failed, exiting...

from dockbix-agent-xxl.

Please use package provided by Zabbix (http://repo.zabbix.com/), don't use Zabbix package provided by your Linux distribution.

from dockbix-agent-xxl.

I used this method to install - https://www.zabbix.com/documentation/3.2/manual/installation/install_from_packages/repository_installation- which appears to point to the same location, having added it as an external repository. See version below, vs the link I followed from yours, this should be the same version.

http://repo.zabbix.com/zabbix/3.2/rhel/7/x86_64/zabbix-agent-3.2.0-1.el7.x86_64.rpm

Installed Packages
Name : zabbix-agent
Arch : x86_64
Version : 3.2.6
Release : 1.el7
Size : 1.3 M
Repo : installed
From repo : zabbix
Summary : Zabbix Agent
URL : http://www.zabbix.com/
License : GPLv2+
Description : Zabbix agent to be installed on monitored systems.

from dockbix-agent-xxl.

Dunno. Pls use 3.2.6 http://repo.zabbix.com/zabbix/3.2/rhel/7/x86_64/zabbix-agent-3.2.6-1.el7.x86_64.rpm

from dockbix-agent-xxl.

zabbix_agentd --version
zabbix_agentd (daemon) (Zabbix) 3.2.6
Revision 67849 4 May 2017, compilation time: May 6 2017 00:30:54

Copyright (C) 2017 Zabbix SIA
License GPLv2+: GNU GPL version 2 or later http://gnu.org/licenses/gpl.html.
This is free software: you are free to change and redistribute it according to
the license. There is NO WARRANTY, to the extent permitted by law.

from dockbix-agent-xxl.

I was able to start Zabbix agent with the Docker module after confirming the version above, and I am attaching the logs.
https://pastebin.com/0wgYp0EC

from dockbix-agent-xxl.

No problem there. Now run plain dockbix container (see README https://github.com/monitoringartist/dockbix-agent-xxl, no Kubernetes) in debug mode and provide logs again please?

from dockbix-agent-xxl.

Got it, seemed to start ok with the following command
docker run --name=zabbix-agent-xxl -h $(hostname) --privileged -p 10050:10050 -v /:/rootfs -v /var/run:/var/run -e "ZA_DebugLevel=5" -e "ZA_Server=$IP OF SERVER" --log-driver journald -d monitoringartist/dockbix-agent-xxl-limited:latest

Logs : https://pastebin.com/cw5x3hjk

from dockbix-agent-xxl.

Standalone zabbix agent + plain Dockbix container:

  1588:20170620:091653.323 In zbx_docker_dir_detect()
  1588:20170620:091653.323 Detected docker stat directory: /sys/fs/cgroup/
  1588:20170620:091653.323 Detected used docker driver dir: system.slice/
  1588:20170620:091653.323 Detected systemd docker - prefix/suffix will be used
  1588:20170620:091653.323 Detected JoinController cpu,cpuacct

=> stat cgroup directory is detected without problem

Your Dockbix container managed by Kubernetes:

  11:20170619:183658.072 In zbx_docker_dir_detect()
   11:20170619:183658.073 Cannot detect used docker driver

=> module is not able to detect stat cgroup directory.

=> problem of your Kubernetes configuration. It's not a issue of Dockbix project or zabbix docker module. Unfortunately Kubernetes orchestration is not in the scope of this project.

Yes, I can probably help you also with Dockix deployment on Kubernetes. But it's very specific, so it must be paid support.

from dockbix-agent-xxl.

I am not sure what happened but the driver loaded correctly after I set ZA_Debug to 5, nothing else changed. I am noticing that I am getting a lot of the previous metric errors on Dockbix containers, but not on others. Is there an option to filter these hosts from discovery within the Dockbix configuration? I know how to filter them from Zabbix but that will not stop the logging messages, which is a concern for our environment. Let me know if you have any thoughts, thank you.

from dockbix-agent-xxl.

Nope. See Zabbix doc how LLD works.

from dockbix-agent-xxl.

Thank you for your assistance in this matter. Please close this if you have not already.

from dockbix-agent-xxl.