This is issue is based on AWS support case with ID 6901474011. It was advised I created an issue here to follow up the progress.
I have an issue with the cloudwatch-agent pods that crash because concourse containers starts containers by itself, this is causing a panic in the cloudwatch agent. Error printed is:
panic: metric being merged has conflict in fields, src: {map[container_memory_cache:6590095360 container_memory_failcnt:0 container_memory_mapped_file:7602176 container_memory_max_usage:7279558656 container_memory_rss:257601536 container_memory_swap:0 container_memory_usage:7102160896 container_memory_working_set:1936506880] map[ContainerId:f13df96d6d02d3a0db9dd7c9fc0df7f1071728a1250ebaeb4e8fa6afab9d3e44 ContainerName:yad-helm-concourse-cicd-worker K8sPodName:yad-helm-concourse-cicd-worker-0 Namespace:concourse PodId:a16f894b-5f28-459a-a5b5-ad5e379d86a3 Timestamp:1585550390956] Container}, dest: {map[container_memory_cache:0 container_memory_failcnt:0 container_memory_mapped_file:0 container_memory_max_usage:0 container_memory_rss:0 container_memory_swap:0 container_memory_usage:0 container_memory_working_set:0] map[ContainerId:f13df96d6d02d3a0db9dd7c9fc0df7f1071728a1250ebaeb4e8fa6afab9d3e44 ContainerName:yad-helm-concourse-cicd-worker K8sPodName:yad-helm-concourse-cicd-worker-0 Namespace:concourse PodId:a16f894b-5f28-459a-a5b5-ad5e379d86a3 Timestamp:1585550391456] Container}
goroutine 21 [running]:
github.com/influxdata/telegraf/plugins/inputs/cadvisor/extractors.(*CAdvisorMetric).Merge(0xc00000d640, 0xc00000d6c0)
/local/p4clients/pkgbuild-bwz9v/workspace/src/CWAgent/src/github.com/influxdata/telegraf/plugins/inputs/cadvisor/extractors/extractor.go:70 +0x2a4
github.com/influxdata/telegraf/plugins/inputs/cadvisor.mergeMetrics(0xc000ab4c00, 0x21, 0x40, 0x1f, 0x0, 0x0)
/local/p4clients/pkgbuild-bwz9v/workspace/src/CWAgent/src/github.com/influxdata/telegraf/plugins/inputs/cadvisor/merger.go:15 +0x1df
github.com/influxdata/telegraf/plugins/inputs/cadvisor.processContainers(0xc0000d3d40, 0x32, 0x32, 0x1, 0xc0002e3c19, 0x3, 0x32, 0x0, 0x0)
/local/p4clients/pkgbuild-bwz9v/workspace/src/CWAgent/src/github.com/influxdata/telegraf/plugins/inputs/cadvisor/container_info_processor.go:60 +0x4e5
github.com/influxdata/telegraf/plugins/inputs/cadvisor.(*Cadvisor).Gather(0xc00050ee40, 0x25dc340, 0xc0002f8a40, 0x0, 0x0)
/local/p4clients/pkgbuild-bwz9v/workspace/src/CWAgent/src/github.com/influxdata/telegraf/plugins/inputs/cadvisor/cadvisor_linux.go:71 +0x1cb
github.com/influxdata/telegraf/agent.gatherWithTimeout.func1(0xc00009e240, 0xc00007e1c0, 0xc0002f8a40)
/local/p4clients/pkgbuild-bwz9v/workspace/src/CWAgent/src/github.com/influxdata/telegraf/agent/agent.go:186 +0x49
created by github.com/influxdata/telegraf/agent.gatherWithTimeout
/local/p4clients/pkgbuild-bwz9v/workspace/src/CWAgent/src/github.com/influxdata/telegraf/agent/agent.go:185 +0xc7
I was told by support a fix will be available in the next release, but they couldn't tell me when this would be. can anyone here tell me when the fix will be ready?