Comments (6)
splitice
commented on May 30, 2024
1
It looks resolved after a restart of the daemonset on the new version. Haven't had a crash to test it since.
from core-dump-handler.
No9
commented on May 30, 2024
Strange - There was no work done on cdc as part of 8.0.0, it's still on 7.1.0
Can you look at the composer log?
If you took the default install location you can exec into the agent pod and run
cat /var/mnt/core-dump-handler/composer.log
If there is nothing in there reinstall with --set composer.logLevel="Debug" and recheck the log.
Also there was a patch release so please use 8.0.1
BTW integration tests are ran as part of the release validation and this error didn't come up.
from core-dump-handler.
splitice
commented on May 30, 2024
Thank you for that information - I'm testing something and will get back to you when I have results. It might have been an error during manifest update.
from core-dump-handler.
splitice
commented on May 30, 2024
By the way when doing a kubectl apply to deploy a modified daemonset the first pod got stuck in terminating.
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Killing 111s kubelet Stopping container coredump-container
Warning FailedPreStopHook 110s kubelet Exec lifecycle hook ([/app/core-dump-agent remove]) for Container "coredump-container" in Pod "core-dump-handler-czbsm_default(23ffd715-a00e-4bc2-be70-87f36df7fbe2)" failed - error: command '/app/core-dump-agent remove' exited with 1: [2022-02-09T08:10:19Z INFO core_dump_agent] no .env file found
That's ok if running in kubernetes
[2022-02-09T08:10:19Z INFO core_dump_agent] Removing /var/mnt/core-dump-handler
[2022-02-09T08:10:19Z INFO core_dump_agent] Restoring Backup of core_pattern
[2022-02-09T08:10:20Z INFO core_dump_agent] Restoring Backup of core_pipe_limit
[2022-02-09T08:10:20Z INFO core_dump_agent] Restoring Backup of suid_dumpable
Error: No such file or directory (os error 2)
, message: "kernel.core_pattern = core\nkernel.core_pipe_limit = 0\nfs.suid_dumpable = 0\n[2022-02-09T08:10:19Z INFO core_dump_agent] no .env file found \n That's ok if running in kubernetes\n[2022-02-09T08:10:19Z INFO core_dump_agent] Removing /var/mnt/core-dump-handler\n[2022-02-09T08:10:19Z INFO core_dump_agent] Restoring Backup of core_pattern\n[2022-02-09T08:10:20Z INFO core_dump_agent] Restoring Backup of core_pipe_limit\n[2022-02-09T08:10:20Z INFO core_dump_agent] Restoring Backup of suid_dumpable\nError: No such file or directory (os error 2)\n"
I can workaround.
from core-dump-handler.
No9
commented on May 30, 2024
FYI direct modification of the daemonset isn't currently recommended as it's not a tested scenario.
Updates should be done through uninstalling and reinstalling the chart.
The FailedPreStopHook error is be due to the .env file for the composer not being generated and/or being deleted out of sequence which could also explain the Core dump to |/var/mnt/core-dump-handler/cdc pipe failed in the original error.
from core-dump-handler.
No9
commented on May 30, 2024
Hey @splitice Did you get this resolved?
If so can we close this or is there follow on required?
Thanks
from core-dump-handler.
Related Issues (20)
- Clarify compatibility with Google Kubernetes HOT 4
- got error Bucket Creation Failed: serde_xml: ParseIntError: invalid digit found in string with AWS IAM s3 HOT 8
- pullSecrets is not used inside daemonset.yaml HOT 6
- multi tenant support HOT 6
- latest musl images are not available HOT 3
- Support for application level artifacts HOT 3
- composer.log is missing in agent HOT 5
- Kubernetes 1.23+ does not mount service account token anymore HOT 1
- SELinux blocks cdc from running
- Additional troubleshooting advice? HOT 1
- Deployment error fails to EKS HOT 3
- Duplicate file names in generated zip files HOT 1
- Core dump files housekeeping HOT 2
- Compatibility with Oracle Kubernetes Engine. HOT 11
- Core dump generates random uuid instead of using pod uuid HOT 2
- Memory cleanup after crash dump taken
- configurable priorityClassName for daemonset pods HOT 1
- Using an s3 compatible storage - fails to connect on error upload Failed reqwest: HOT 7
- In Kubernetes: Mounts of the hostdir doubling with every restart HOT 3
- Capture proc data to be able to generate minidump HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from core-dump-handler.