Comments (7)
github-actions
commented on May 28, 2024
1
This issue has been automatically marked as stale because it has not
had recent activity. It will be closed if no further activity occurs.
from cilium.
cjvirtucio87
commented on May 28, 2024
cilium-health output on the cilium pod:
# cilium-health status
Error: Cannot get status: Get "http://localhost/v1beta/status": dial unix /var/run/cilium/health.sock: connect: connection refused
# ls /var/run/cilium/health.sock
/var/run/cilium/health.sock
# cilium-health get
Error: Cannot get health for local instance: Get "http://localhost/v1beta/healthz": dial unix /var/run/cilium/health.sock: connect: connection refused
# cilium-health ping
Error: Cannot ping: Get "http://localhost/v1beta/healthz": dial unix /var/run/cilium/health.sock: connect: connection refused
#
logs for the cilium-agent:
# head -n 10 /var/run/cilium/cilium-cni.log
level=warning msg="Failed to connect to agent socket at unix:///var/run/cilium/cilium.sock." containerID=e17b53b982615c21fc0c8e237d8cdc9e2a4bd2854e625881f94108a3edfa0427 error="failed to create cilium agent client after 10.000000 seconds timeout: Get \"http://localhost/v1/config\": dial unix /var/run/cilium/cilium.sock: connect: no such file or directory" eventUUID=f3cfc3e8-8545-4484-b85d-2c8139b9635b subsys=cilium-cni
level=info msg="Agent is down, falling back to deletion queue directory" containerID=e17b53b982615c21fc0c8e237d8cdc9e2a4bd2854e625881f94108a3edfa0427 eventUUID=f3cfc3e8-8545-4484-b85d-2c8139b9635b subsys=cilium-cni
level=info msg="Queueing deletion request for endpoint" containerID=e17b53b982615c21fc0c8e237d8cdc9e2a4bd2854e625881f94108a3edfa0427 endpointID="container-id:e17b53b982615c21fc0c8e237d8cdc9e2a4bd2854e625881f94108a3edfa0427" eventUUID=f3cfc3e8-8545-4484-b85d-2c8139b9635b subsys=cilium-cni
level=info msg="wrote queued deletion file" containerID=e17b53b982615c21fc0c8e237d8cdc9e2a4bd2854e625881f94108a3edfa0427 eventUUID=f3cfc3e8-8545-4484-b85d-2c8139b9635b subsys=cilium-cni
level=warning msg="Unable to enter namespace \"\", will not delete interface" error="failed to Statfs \"\": no such file or directory" subsys=cilium-cni
ni
level=warning msg="Failed to connect to agent socket at unix:///var/run/cilium/cilium.sock." containerID=7a3b6e777240b176f2d29f7a5f9fdfb77bdb20fec6ac46134516de6677965705 error="failed to create cilium agent client after 10.000000 seconds timeout: Get \"http://localhost/v1/config\": dial unix /var/run/cilium/cilium.sock: connect: no such file or directory" eventUUID=c35bc925-7b68-41c5-9ca1-ae377f5464e0 subsys=cilium-cni
level=warning msg="Failed to connect to agent socket at unix:///var/run/cilium/cilium.sock." containerID=7dcc2635cb82719ed9f30c0a874e08c790aed8d20a4006b3c6df8f805db482fd error="failed to create cilium agent client after 10.000000 seconds timeout: Get \"http://localhost/v1/config\": dial unix /var/run/cilium/cilium.sock: connect: no such file or directory" eventUUID=1432d698-4975-481c-bc92-ec1c3065ab7e subsys=cilium-cni
level=warning msg="Failed to connect to agent socket at unix:///var/run/cilium/cilium.sock." containerID=ed8849f22880d48c56a8847d2a664845ae38ed1239455fc32887d426d0440738 error="failed to create cilium agent client after 10.000000 seconds timeout: Get \"http://localhost/v1/config\": dial unix /var/run/cilium/cilium.sock: connect: no such file or directory" eventUUID=90b09063-001d-42ba-8604-6388ae335819 subsys=cilium-cni
level=warning msg="Failed to connect to agent socket at unix:///var/run/cilium/cilium.sock." containerID=171f3ea4ec69c1b4ea9b7816fa232a6c93b7dbe512157a48fefdcf1b90b503bd error="failed to create cilium agent client after 10.000000 seconds timeout: Get \"http://localhost/v1/config\": dial unix /var/run/cilium/cilium.sock: connect: no such file or directory" eventUUID=98771554-4909-4f8f-b84c-1d8421def76c subsys=cilium-cni
from cilium.
cjvirtucio87
commented on May 28, 2024
this solution fixed it for me. I'm not sure how that file is related; would be nice have some clarification for posterity. I'll leave this open in case any of the maintainers wish to chime in.
from cilium.
squeed
commented on May 28, 2024
Cilium is failing a health check because it is waiting for a CRD to be created:
goroutine 1 [select]:
github.com/cilium/cilium/pkg/k8s/synced.SyncCRDs({0x3fc1600, 0xc000198f50}, {0x3ffe320?, 0xc0000d5ef0}, {0xc0015f2000, 0xc, 0xefd360?}, 0x602aba0?, 0xc001cfe300)
/go/src/github.com/cilium/cilium/pkg/k8s/synced/crd.go:178 +0x650
github.com/cilium/cilium/pkg/k8s/watchers.(*K8sWatcher).WaitForCRDsToRegister(0xc001cfe2c0, {0x3fc1600, 0xc000198f50})
/go/src/github.com/cilium/cilium/pkg/k8s/watchers/watcher.go:411 +0x5a
github.com/cilium/cilium/daemon/cmd.newDaemon({0x3fc1600, 0xc000198f50}, 0xc000cfbf40, 0xc001117c20)
/go/src/github.com/cilium/cilium/daemon/cmd/daemon.go:860 +0x339f
The question: which CRDs? I'm not sure yet!
from cilium.
squeed
commented on May 28, 2024
Aha, we will log this, but the CRD registration timeout is longer than the startup probe. Can you please try setting the configuration field crd-wait-timeout: 30s? That should cause it to output the missing CRD.
from cilium.
cjvirtucio87
commented on May 28, 2024
interesting. nothing stands out.
logs from all pods in the cilium namespace and grepping for (crd|CRD):
though perhaps this is because I'm no longer able to replicate after the fix.
from cilium.
github-actions
commented on May 28, 2024
This issue has not seen any activity since it was marked stale.
Closing.
from cilium.
Related Issues (20)
- What does the output of `cilium bpf lb maglev list` mean? HOT 1
- CFP: Improve KubeProxyReplacement status on cilium status command HOT 2
- CI: K8sDatapathConfig
- Clustermesh connect not working with ArgoCD HOT 24
- error dialing backend: EOF HOT 4
- L2 announcement seems not to work with path mtu discovery
- Getting connectivity disruption after node restart HOT 2
- /var/run/cilium/proxy.sock: connect: no such file or directory HOT 1
- No healthy upstream for kube-prometheus-stack-grafana exposed through gateway
- Cilium LB DSR reply with wrong src ip when syn packet is missed. HOT 5
- Severe network bug on v1.15.4 HOT 9
- CFP: Hubble DNS config option for response IPs
- Cilium Connectivity Tests Failing HOT 1
- k8s ingress network policy does not work with L2 announcement
- lb ip is deleted accidentally in statedb when l2announce, requestip and shardingkeys are used together HOT 2
- Cilium drops traffic without Hubble showing it
- helm: cilium kvstore clustermesh failing without `clustermesh-apiserver-remote-cert` in 1.15 HOT 4
- RFC: Rename bpf host routing options from "legacy / bpf" to "on / off"
- Virtual Machine eth0 is InternalIP, nodeipam cannot access it through the external IP HOT 7
- ipv4-range auto HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from cilium.