why can't get service map about coroot HOT 11 CLOSED

@tripitakav

• Which Coroot and coroot-node-agent versions are you using?
• Are there any errors in the logs?

from coroot.

@tripitakav

• Which Coroot and coroot-node-agent versions are you using?
• Are there any errors in the logs?

1. Coroot: v0.16.2 Node-agent:v1.7.6

There are no errors in the logs

from coroot.

Can you please share the output of the following Prometheus query?

node_info

from coroot.

Can you please share the output of the following Prometheus query?

node_info

from coroot.

We suspect that there are some issues with the way metrics are being relabeled, such as incorrect or missing labels.

Is this the right data source? The number of nodes doesn't match:

versus

from coroot.

I also think it should be due to incorrect or missing labels, because I deployed Coroot two months ago and everything was normal at that time. Then I deleted the namespace, and recently I had this issue when I was redeploying to demonstrate to the leader。

The data source is right,I'm just checking for node_info when selecting the metric, I chose staging-eks because the labels for both staging-eks and prod-hk metric are similar. Because I have deleted the prod-hk metric, only staging-eks have

from coroot.

@tripitakav
Let's check some other metric labels. One or two samples of each query will be enough:

1. kube_node_info
2. kube_pod_info
3. container_info

from coroot.

@tripitakav
We guess that the metrics from kube-state-metrics (e.g., kube_pod_info, kube_pod_labels) no longer include the uid label after the relabeling process. Coroot needs this label to load application instances.

from coroot.

@tripitakav Let's check some other metric labels. One or two samples of each query will be enough:

1. kube_node_info
2. kube_pod_info
3. container_info

2.

3.

from coroot.

@tripitakav We guess that the metrics from kube-state-metrics (e.g., kube_pod_info, kube_pod_labels) no longer include the uid label after the relabeling process. Coroot needs this label load application instances.

Yes,it don't has label include uid

from coroot.

Consider removing the rule that drops the uid label.

from coroot.