Comments (8)
rfay
commented on May 28, 2024
1
Yes, @abiosoft has promised not to do this again, and DDEV emitted messages about this for more than a month, but you missed them at that time. It was also posted widely here in Discord and on Twitter, etc. But I know you weren't active during that period.
from colima.
vyskoczilova
commented on May 28, 2024
A little update, what we've got with guys from DDEV:
It looks like running docker system df -v shows that the volumes are there and taking up lot of space, the complete list is here: https://gist.github.com/vyskoczilova/6d1cc2780d160ff169f7277dd99f1077
when I inspect one of the volumes docker volume inspect hotelradun-mariadb , I get the following:
❯ docker volume inspect hotelradun-mariadb
[
{
"CreatedAt": "2023-08-29T19:20:07Z",
"Driver": "local",
"Labels": null,
"Mountpoint": "/var/lib/docker/volumes/hotelradun-mariadb/_data",
"Name": "hotelradun-mariadb",
"Options": null,
"Scope": "local"
}
]
but when I start DDEV, the DB is still empty.
Is there a way to restore the DBs? please 🙏
from colima.
rfay
commented on May 28, 2024
Please do a docker system df -v && ddev debug test in the project that is most important to you, after confirming that you haven't changed anything there. You can attach the results as a file here.
We want to know the project name that is most important, and want to see the local volume sizes. Those are the volumes that will be mounted.
Along the way, you can docker run -it --rm -v <volumename>:/tmp/mountpoint busybox sh, for example docker run -it --rm -v d10-mariadb:/tmp/mariadb busybox sh and you'll see the actual content in /tmp/mariadb for example. You still need a way to access it, but if it's actually there (and the database type and version are the same) then you'll already have the right stuff.
If you are going back and forth between mariadb and postgres, for example, you'll get all confused. So be clear about what you want, what project it is, and whether you've changed anything in the project config. If docker system df -v shows local volumes that have nonzero sizes, they're probably fine.
from colima.
vyskoczilova
commented on May 28, 2024
@rfay here you go docker system df -v && ddev debug test: https://gist.github.com/vyskoczilova/3d5c618153f9a7d56927dad29f35dd10 my most important project is "kybernaut" (kybernaut-mariadb 0 265.8MB ), haven't tried to run it yet, but there are others in middle of dev work which I would like to save (but not that crutial).
this works
❯ docker run -it --rm -v kybernaut-mariadb:/tmp/mariadb busybox sh
Unable to find image 'busybox:latest' locally
latest: Pulling from library/busybox
29f4353257d6: Pull complete
Digest: sha256:ba76950ac9eaa407512c9d859cea48114eeff8a6f12ebaa5d32ce79d4a017dd8
Status: Downloaded newer image for busybox:latest
/ # ls
bin dev etc home lib lib64 proc root sys tmp usr var
/ # cd tmp/mariadb
/tmp/mariadb # ls
aria_log.00000001 db ib_buffer_pool ib_logfile1 ibtmp1 mysql test
aria_log_control db_mariadb_version.txt ib_logfile0 ibdata1 multi-master.info performance_schema xtrabackup_info
/tmp/mariadb/db # ls -l
total 41596
-rw-r----- 1 502 20 67 Jul 31 18:04 db.opt
-rw-r----- 1 502 20 38397 Jul 31 18:04 wp_actionscheduler_actions.frm
-rw-r----- 1 502 20 180224 Jul 31 18:07 wp_actionscheduler_actions.ibd
-rw-r----- 1 502 20 1460 Jul 31 18:04 wp_actionscheduler_claims.frm
-rw-r----- 1 502 20 81920 Oct 19 12:58 wp_actionscheduler_claims.ibd
-rw-r----- 1 502 20 2464 Jul 31 18:04 wp_actionscheduler_groups.frm
-rw-r----- 1 502 20 81920 Jul 31 18:04 wp_actionscheduler_groups.ibd
-rw-r----- 1 502 20 2050 Jul 31 18:04 wp_actionscheduler_logs.frm
-rw-r----- 1 502 20 98304 Jul 31 18:07 wp_actionscheduler_logs.ibd
-rw-r----- 1 502 20 3033 Jul 31 18:04 wp_commentmeta.frm
-rw-r----- 1 502 20 98304 Jul 31 18:04 wp_commentmeta.ibd
-rw-r----- 1 502 20 6679 Jul 31 18:04 wp_comments.frm
-rw-r----- 1 502 20 147456 Jul 31 18:04 wp_comments.ibd
-rw-r----- 1 502 20 3204 Jul 31 18:04 wp_icl_background_task.frm
-rw-r----- 1 502 20 65536 Jul 31 18:04 wp_icl_background_task.ibd
-rw-r----- 1 502 20 1626 Jul 31 18:04 wp_icl_content_status.frm
-rw-r----- 1 502 20 81920 Jul 31 18:04 wp_icl_content_status.ibd
-rw-r----- 1 502 20 2193 Jul 31 18:04 wp_icl_core_status.frm
-rw-r----- 1 502 20 81920 Jul 31 18:04 wp_icl_core_status.ibd
-rw-r----- 1 502 20 1661 Jul 31 18:04 wp_icl_flags.frm
-rw-r----- 1 502 20 81920 Jul 31 18:04 wp_icl_flags.ibd
-rw-r----- 1 502 20 2974 Jul 31 18:04 wp_icl_languages.frm
-rw-r----- 1 502 20 98304 Jul 31 18:04 wp_icl_languages.ibd
-rw-r----- 1 502 20 2582 Jul 31 18:04 wp_icl_languages_translations.frm
-rw-r----- 1 502 20 458752 Jul 31 18:04 wp_icl_languages_translations.ibd
-rw-r----- 1 502 20 1113 Jul 31 18:04 wp_icl_locale_map.frm
-rw-r----- 1 502 20 65536 Jul 31 18:04 wp_icl_locale_map.ibd
-rw-r----- 1 502 20 2603 Jul 31 18:04 wp_icl_message_status.frm
-rw-r----- 1 502 20 98304 Jul 31 18:04 wp_icl_message_status.ibd
-rw-r----- 1 502 20 3928 Jul 31 18:04 wp_icl_mo_files_domains.frm
-rw-r----- 1 502 20 81920 Oct 19 12:29 wp_icl_mo_files_domains.ibd
-rw-r----- 1 502 20 1106 Jul 31 18:04 wp_icl_node.frm
-rw-r----- 1 502 20 65536 Jul 31 18:04 wp_icl_node.ibd
-rw-r----- 1 502 20 1043 Jul 31 18:04 wp_icl_reminders.frm
-rw-r----- 1 502 20 65536 Jul 31 18:04 wp_icl_reminders.ibd
-rw-r----- 1 502 20 995 Jul 31 18:04 wp_icl_string_batches.frm
-rw-r----- 1 502 20 65536 Jul 31 18:04 wp_icl_string_batches.ibd
-rw-r----- 1 502 20 11721 Jul 31 18:04 wp_icl_string_packages.frm
-rw-r----- 1 502 20 65536 Jul 31 18:04 wp_icl_string_packages.ibd
-rw-r----- 1 502 20 2529 Jul 31 18:04 wp_icl_string_positions.frm
-rw-r----- 1 502 20 81920 Jul 31 18:04 wp_icl_string_positions.ibd
-rw-r----- 1 502 20 1671 Jul 31 18:04 wp_icl_string_status.frm
-rw-r----- 1 502 20 81920 Jul 31 18:04 wp_icl_string_status.ibd
-rw-r----- 1 502 20 2314 Jul 31 18:04 wp_icl_string_translations.frm
-rw-r----- 1 502 20 98304 Jul 31 18:04 wp_icl_string_translations.ibd
-rw-r----- 1 502 20 7247 Jul 31 18:04 wp_icl_strings.frm
-rw-r----- 1 502 20 524288 Jul 31 18:04 wp_icl_strings.ibd
-rw-r----- 1 502 20 2534 Jul 31 18:04 wp_icl_translate.frm
-rw-r----- 1 502 20 81920 Jul 31 18:04 wp_icl_translate.ibd
-rw-r----- 1 502 20 2540 Jul 31 18:04 wp_icl_translate_job.frm
-rw-r----- 1 502 20 81920 Jul 31 18:04 wp_icl_translate_job.ibd
-rw-r----- 1 502 20 1055 Jul 31 18:04 wp_icl_translation_batches.frm
-rw-r----- 1 502 20 65536 Jul 31 18:04 wp_icl_translation_batches.ibd
-rw-r----- 1 502 20 9005 Jul 31 18:04 wp_icl_translation_downloads.frm
-rw-r----- 1 502 20 65536 Jul 31 18:04 wp_icl_translation_downloads.ibd
-rw-r----- 1 502 20 2353 Jul 31 18:04 wp_icl_translation_status.frm
-rw-r----- 1 502 20 81920 Jul 31 18:04 wp_icl_translation_status.ibd
-rw-r----- 1 502 20 3358 Jul 31 18:04 wp_icl_translations.frm
-rw-r----- 1 502 20 360448 Jul 31 18:04 wp_icl_translations.ibd
-rw-r----- 1 502 20 8102 Jul 31 18:04 wp_links.frm
-rw-r----- 1 502 20 81920 Jul 31 18:04 wp_links.ibd
-rw-r----- 1 502 20 2854 Jul 31 18:04 wp_options.frm
-rw-r----- 1 502 20 11534336 Oct 19 12:58 wp_options.ibd
-rw-r----- 1 502 20 1061 Jul 31 18:04 wp_pmxi_files.frm
-rw-r----- 1 502 20 65536 Jul 31 18:04 wp_pmxi_files.ibd
-rw-r----- 1 502 20 1153 Jul 31 18:04 wp_pmxi_hash.frm
-rw-r----- 1 502 20 65536 Jul 31 18:04 wp_pmxi_hash.ibd
-rw-r----- 1 502 20 1124 Jul 31 18:04 wp_pmxi_history.frm
-rw-r----- 1 502 20 65536 Jul 31 18:04 wp_pmxi_history.ibd
-rw-r----- 1 502 20 1098 Jul 31 18:04 wp_pmxi_images.frm
-rw-r----- 1 502 20 131072 Jul 31 18:04 wp_pmxi_images.ibd
-rw-r----- 1 502 20 4071 Jul 31 18:04 wp_pmxi_imports.frm
-rw-r----- 1 502 20 114688 Jul 31 18:04 wp_pmxi_imports.ibd
-rw-r----- 1 502 20 1134 Jul 31 18:04 wp_pmxi_posts.frm
-rw-r----- 1 502 20 65536 Jul 31 18:04 wp_pmxi_posts.ibd
-rw-r----- 1 502 20 2278 Jul 31 18:04 wp_pmxi_templates.frm
-rw-r----- 1 502 20 65536 Jul 31 18:04 wp_pmxi_templates.ibd
-rw-r----- 1 502 20 3030 Jul 31 18:04 wp_postmeta.frm
-rw-r----- 1 502 20 9437184 Oct 19 12:29 wp_postmeta.ibd
-rw-r----- 1 502 20 7211 Jul 31 18:04 wp_posts.frm
-rw-r----- 1 502 20 14680064 Oct 10 17:42 wp_posts.ibd
-rw-r----- 1 502 20 2585 Jul 31 18:04 wp_rank_math_internal_links.frm
-rw-r----- 1 502 20 163840 Oct 19 12:29 wp_rank_math_internal_links.ibd
-rw-r----- 1 502 20 1056 Jul 31 18:04 wp_rank_math_internal_meta.frm
-rw-r----- 1 502 20 65536 Oct 19 12:29 wp_rank_math_internal_meta.ibd
-rw-rw---- 1 502 20 2209 Jul 31 18:08 wp_snippets.frm
-rw-r----- 1 502 20 98304 Jul 31 18:04 wp_snippets.ibd
-rw-r----- 1 502 20 1496 Jul 31 18:04 wp_term_relationships.frm
-rw-r----- 1 502 20 81920 Jul 31 18:04 wp_term_relationships.ibd
-rw-r----- 1 502 20 2209 Jul 31 18:04 wp_term_taxonomy.frm
-rw-r----- 1 502 20 98304 Jul 31 18:04 wp_term_taxonomy.ibd
-rw-r----- 1 502 20 3030 Jul 31 18:04 wp_termmeta.frm
-rw-r----- 1 502 20 98304 Jul 31 18:04 wp_termmeta.ibd
-rw-r----- 1 502 20 3592 Jul 31 18:04 wp_terms.frm
-rw-r----- 1 502 20 98304 Jul 31 18:04 wp_terms.ibd
-rw-r----- 1 502 20 3031 Jul 31 18:04 wp_usermeta.frm
-rw-r----- 1 502 20 278528 Jul 31 18:07 wp_usermeta.ibd
-rw-r----- 1 502 20 6962 Jul 31 18:04 wp_users.frm
-rw-r----- 1 502 20 114688 Jul 31 18:04 wp_users.ibd
-rw-r----- 1 502 20 9369 Jul 31 18:04 wp_yoast_indexable.frm
-rw-r----- 1 502 20 720896 Jul 31 18:04 wp_yoast_indexable.ibd
-rw-r----- 1 502 20 2492 Jul 31 18:04 wp_yoast_indexable_hierarchy.frm
-rw-r----- 1 502 20 180224 Jul 31 18:04 wp_yoast_indexable_hierarchy.ibd
-rw-r----- 1 502 20 2202 Jul 31 18:04 wp_yoast_migrations.frm
-rw-r----- 1 502 20 81920 Jul 31 18:04 wp_yoast_migrations.ibd
-rw-r----- 1 502 20 2219 Jul 31 18:04 wp_yoast_primary_term.frm
-rw-r----- 1 502 20 98304 Jul 31 18:04 wp_yoast_primary_term.ibd
-rw-r----- 1 502 20 3213 Jul 31 18:04 wp_yoast_seo_links.frm
-rw-r----- 1 502 20 212992 Jul 31 18:04 wp_yoast_seo_links.ibd
so that looks good, I guess.
I've used mariadb only.
from colima.
rfay
commented on May 28, 2024
Now you can ddev ssh -s db to ssh into the database container and look at what's mounted at /var/lib/mysql. It should be the same as what you found.
from colima.
vyskoczilova
commented on May 28, 2024
ddev ssh -s db
ddev ssh failed: service db is not running in project kybernaut (state=doesnotexist)
so I have to run ddev start first, right? I've tested on another less important project and ls doesn print anything (but docker run -it --rm -v wp-mapa-mariadb:/tmp/mariadb busybox sh shows the content of this DB)
from colima.
rfay
commented on May 28, 2024
Yes, you can't go into something that's not running
from colima.
vyskoczilova
commented on May 28, 2024
@rfay Yeah, I now, but running and launching (probably) ended up in clearing the DB, or at least it looks like. But I was able to recover most of the DBs (only the ones that haven't been rewritten with the updated Colima). Thanks for all your help!
It took a lot of time since the containers were corrupted and the server took minutes to get them running with various error messages (if it helps enybody, pasting below). But after several tries I was able to run and export the DB (both ddev snapshot and exporting through mysql worked).
Error getting container to inspect: Get "http://unix.sock/containers/94b8114fc74a8077d5d2ac1db540076f9cae95f81a9e463d873645f12dd5a789/json?": EOF
Failed waiting for web/db containers to become ready: web container failed: log=, err=failed to query container labels=map[com.ddev.site-name:demo com.docker.compose.service:web]: Get "http://unix.sock/containers/json?all=1&filters=%7B%22label%22%3A%5B%22com.ddev.site-name%3Ddemo%22%2C%22com.docker.compose.service%3Dweb%22%5D%7D": EOF
Something is wrong with Docker or Colima and /mnt/ddev_config is not mounted from the project .ddev folder. This can cause all kinds of problems.
Failed to retrieve containers for determining port mappings: Get "http://unix.sock/containers/json?all=1&filters=%7B%22label%22%3A%5B%22com.ddev.site-name%22%5D%7D": EOF
app.FindContainerByType(web) failed
Starting Mutagen sync process...
..........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................Forcing synchronization cycle for session sync_Xiit62b25rAaDmckvZMzzEdJQHIiCKs7Yay-for-payment'. You may be able to resolve this problem using 'ddev mutagen reset' (err=mutagen sync flush wc-pay-for-payment failed, output=
Error: unable to flush session: synchronization failed while waiting for flush response
, err=exit status 1)
Failed to start wc-pay-for-payment: container(s) failed to become healthy before their configured timeout or in 120 seconds. This might be a problem with the healthcheck and not a functional problem. (container /ddev-wc-pay-for-payment-web is unhealthy: [{2024-01-04 10:36:12.864329017 +0000 UTC 2024-01-04 10:36:12.95968235 +0000 UTC 1 /var/www/html:OK mailpit:FAILED phpstatus:FAILED } {2024-01-04 10:36:13.964234268 +0000 UTC 2024-01-04 10:36:14.094212726 +0000 UTC 1 /var/www/html:OK mailpit:FAILED phpstatus:FAILED } {2024-01-04 10:36:15.099033435 +0000 UTC 2024-01-04 10:36:15.200004893 +0000 UTC 1 /var/www/html:OK mailpit:FAILED phpstatus:FAILED } {2024-01-04 10:36:16.205868602 +0000 UTC 2024-01-04 10:36:16.366077394 +0000 UTC 1 /var/www/html:OK mailpit:FAILED phpstatus:FAILED } {2024-01-04 10:36:17.373479811 +0000 UTC 2024-01-04 10:36:17.512440311 +0000 UTC 1 /var/www/html:OK mailpit:FAILED phpstatus:FAILED }])
Now I plan to update the Colima again, ddev poweroff and restore from newly created snapshots and hope everything will be fine. And as well to create a regular backup so it never happens again. Lesson learned.
But what I really would love to see @abiosoft is some notice/warning and consent needed for those kind of breaking updates of Colima - when installed through brew it easily get updated and problems are here.
Thanks everybody for your help!
from colima.
Related Issues (20)
- docker+k3s: no Node available, probably due to `--docker is no longer supported` from k3s HOT 1
- Colima with containerd runtime not exposing docker.sock HOT 2
- brew services start doesn't start colima HOT 3
- colima start error HOT 2
- Containers in emulated x86_64 VM become unreachable after a while (connection refused) HOT 5
- Creating aarch64 instance on intel macOS hangs on starting ... context=docker HOT 4
- colima start --kubernetes: kubernetes cluster unreachable
- Can't start Elasticsearch image HOT 5
- Colima freezes and I have to restart it HOT 4
- Lima v0.20.0 breaks Colima HOT 4
- Colima is failing to do port forwarding after upgrading to Ventura 13.6.4 HOT 4
- Inability to start colima on GitHub macOS-14 runners: "HV_UNSUPPORTED" HOT 2
- colima doesn't start on hosted github runner `macos-14` with M1 arm64 HOT 4
- DNS customizations not applied within kubernetes when vm-type=vz.
- Support for Disk/Memory Units Other Than GiB for --memory and --disk flags HOT 2
- Unable to Launch Colima on Rocky Linux 9.* HOT 1
- Colima should not tell linux users to "brew install" HOT 3
- docker run with --mac-address option fails
- Docker Image for Elastic search version 8.8.0 not connecting with the Application that has same Elasticsearch version
- colima start does not honor default config, but then overwrites it HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from colima.