Better Kubernetes support about oms-agent-for-linux HOT 23 CLOSED

@edevil, See the superproject, it has detailed build instructions for the OMS agent.

from oms-agent-for-linux.

I managed to find the fluentd installation inside the OMS Agent, however I could not install the plugin due to an old version of Ruby:

ERROR:  Error installing fluent-plugin-kubernetes_metadata_filter:
    activesupport requires Ruby version >= 2.2.2.

Can I upgrade the Ruby version?

from oms-agent-for-linux.

Hi @edevil, We are looking to upgrade the version [2.2.2+] of Ruby in the OMS Agent for Linux in the next couple of months.

Today you can change the git module in the OMS Agent for Linux source to reference to Ruby v2.2.2+.

Thanks,
Anurag

from oms-agent-for-linux.

Are there any build instructions for the OMS agent?

from oms-agent-for-linux.

@jeffaco The instructions mention that if I don't have access to the "OMS TestConfig" repo I should only run the first git clone. However, even there I get denied access to another repository:

$git clone --recursive [email protected]:Microsoft/Build-OMS-Agent-for-Linux.git bld-omsagent
Cloning into 'bld-omsagent'...
...
Checking connectivity... done.
Submodule 'auoms' ([email protected]:Microsoft/OMS-Auditd-Plugin.git) registered for path 'auoms'
Submodule 'dsc' ([email protected]:Microsoft/PowerShell-DSC-for-Linux.git) registered for path 'dsc'
Submodule 'omi' ([email protected]:Microsoft/omi.git) registered for path 'omi'
Submodule 'omsagent' ([email protected]:Microsoft/OMS-Agent-for-Linux.git) registered for path 'omsagent'
Submodule 'opsmgr' ([email protected]:Microsoft/SCXcore.git) registered for path 'opsmgr'
Submodule 'opsmgr-kits' ([email protected]:Microsoft/SCXcore-osskits.git) registered for path 'opsmgr-kits'
Submodule 'pal' ([email protected]:Microsoft/pal.git) registered for path 'pal'
Cloning into '/Users/andre/work/vc/bld-omsagent/auoms'...
ERROR: Repository not found.
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.
fatal: clone of '[email protected]:Microsoft/OMS-Auditd-Plugin.git' into submodule path '/Users/andre/work/vc/bld-omsagent/auoms' failed

from oms-agent-for-linux.

@edevil Sorry, this change was made recently, and I was unaware of it. I'm actually not on the OMS project anymore. Thus, I'm not sure what OMS-Auditd-Plugin is, and why it's private.

@robbiezhang Can you give guidance here please?

from oms-agent-for-linux.

Hi @edevil,

this method has changed. You no longer need to set the --log-driver anymore.
Please check our latest version. You will see the instruction has changed.

from oms-agent-for-linux.

@keikhara Ok, that's good to know. What about the upgraded ruby version? I would like to be able to use the fluent-plugin-kubernetes_metadata_filter plugin in order to augment the log lines with Kubernetes specific information. However, it requires ruby >= 2.2.2.

from oms-agent-for-linux.

Hi @edevil,

for the ruby version, my colleague, @robbiezhang can provide more guidance.
We are looking to support Kubernetes in future in addition to the Mesosphere DC/OS we have just supported.

regards,

Keiko

from oms-agent-for-linux.

@edevil, for monitoring the containers in the cluster, you can deploy the OMS agent running as a container to Kubernetes using this DaemonSet:

https://gist.github.com/OguzPastirmaci/bba85a47c7c5fb71dc6e6f2acdd13249

from oms-agent-for-linux.

@OguzPastirmaci Yes, that is what I'm planning to do. But I still need to be able to use the fluentd plugin that retrieves additional data from the Kubernetes API.

from oms-agent-for-linux.

@edevil @OguzPastirmaci

I will consider this an enhancement which we will be working on.
regards,

Keiko

from oms-agent-for-linux.

I've noticed that there's a commit 210ccc2 from October 2016 that upgrades the Ruby version of the OMS agent, however I've just tried the ruby version on the latest Microsoft/OMS docker image and it's still 2.2.0:

root@631c05c91553:/opt# ./microsoft/omsagent/ruby/bin/ruby -v
ruby 2.2.0p0 (2014-12-25) [x86_64-linux]

When will this commit reach a release?

from oms-agent-for-linux.

@edevil We're looking to release a version this month that contains the update to Ruby 2.3.3, originating from commit 210ccc2

from oms-agent-for-linux.

@keikhara can speak more to better Kubernetes support.

As for using Ruby 2.3.3, the latest agent release does include Ruby 2.3.3.

from oms-agent-for-linux.

@edevil kubernetes support is there as of 2weeks ago. We are capturing k8s events.

from oms-agent-for-linux.

@keikhara Which tag should I be using of these? https://hub.docker.com/r/microsoft/oms/tags/

Is there any additional configuration that I have to provide to the agent?

Thanks!

from oms-agent-for-linux.

ping @keikhara

is there some documentation about what the agent is actually capturing? I don't see this additional information on the OMS portal. On another note, how does the OMS agent know it is running on a Kubernetes cluster? Does it assume from the computer name? https://github.com/Microsoft/Docker-Provider/blob/c79a123b4f579176bc7ff000a2a69752a49e4679/source/code/providers/Container_HostInventory_Class_Provider.cpp#L145 I have tried this but still no additional info on OMS.

from oms-agent-for-linux.

from oms-agent-for-linux.

Anyone?

from oms-agent-for-linux.

I haven't tried this myself, but I noticed there's a helm chart to install the OMS daemonset (https://kubeapps.com/charts/stable/msoms). @edevil, did you already try this? You can see from the volume mounts that it's grabbing data from the docker socket and /var/log.

from oms-agent-for-linux.

I haven’t tried the helm chart, but the daemonset already mounts those dirs.

from oms-agent-for-linux.

@here Can someone help me with the below issue ?
I am installing the omsagent as a daemonset kubernetes hosts. I was able to install successfully with no error at the time of installation but it is not turning in green(green tick mark in the portal stating it is being monitored). And I see below error in the this path

Error:Unsupported Operation system: COREOS 1632.2.1.
I am installing the OMSagent version(1.6.0-42) on COREOS version VERSION=1576.5.0
VERSION_ID=1576.5.0
BUILD_ID=2018-01-05-1121
PRETTY_NAME="Container Linux by CoreOS 1576.5.0 (Ladybug)"
Any help is appreciated. Thanks in advance

from oms-agent-for-linux.