Comments (14)
dothebart
commented on June 15, 2024
any feedback in docker logs <containerid> ?
from arangodb-docker.
bard
commented on June 15, 2024
None that I could see...
Initializing database...Hang on...
Database initialized...Starting System...
2017-03-09T10:07:57Z [1] INFO ArangoDB 3.1.13 [linux] 64bit, using VPack 0.1.30, ICU 54.1, V8 5.0.71.39, OpenSSL 1.0.1t 3 May 2016
2017-03-09T10:07:57Z [1] INFO using SSL options: SSL_OP_CIPHER_SERVER_PREFERENCE, SSL_OP_TLS_ROLLBACK_BUG
2017-03-09T10:07:57Z [1] INFO Starting up with role SINGLE
2017-03-09T10:07:57Z [1] INFO file-descriptors (nofiles) hard limit is 1048576, soft limit is 1048576
2017-03-09T10:07:57Z [1] INFO JavaScript using startup '/usr/share/arangodb3/js', application '/var/lib/arangodb3-apps'
2017-03-09T10:07:58Z [1] INFO using endpoint 'http+tcp://0.0.0.0:8529' for non-encrypted requests
2017-03-09T10:07:58Z [1] INFO ArangoDB (version 3.1.13 [linux]) is ready for business. Have fun!
(Note, differently than my transcript above this one was started with ARANGO_NO_AUTH=1)
(Edit: was output of docker run; docker logs shows two extra lines at the top)
from arangodb-docker.
dothebart
commented on June 15, 2024
have you tried logging into the webinterface?
from arangodb-docker.
bard
commented on June 15, 2024
Yes, no trace of databases other than _system at http://localhost:8529/_db/_system/_admin/aardvark/index.html#login
from arangodb-docker.
bard
commented on June 15, 2024
I'm now convinced that problem must exist somewhere between keyboard and chair, though not yet sure where, because even restoring /var/lib/docker/volumes from my backups and creating a container from the previous image, databases aren't available.
from arangodb-docker.
dothebart
commented on June 15, 2024
can you revalidate whether any of these /var/lib/docker directories contain structures like...
/var/lib/docker/volumes/ff954fe45bad8c53f5c81f358064c74d139ec930b24eb9218e0252982ba0bd27/_data/SERVER
/var/lib/docker/volumes/ff954fe45bad8c53f5c81f358064c74d139ec930b24eb9218e0252982ba0bd27/_data/databases
/var/lib/docker/volumes/ff954fe45bad8c53f5c81f358064c74d139ec930b24eb9218e0252982ba0bd27/_data/databases/database-1
/var/lib/docker/volumes/ff954fe45bad8c53f5c81f358064c74d139ec930b24eb9218e0252982ba0bd27/_data/databases/database-1/collection-54-2641438639
from arangodb-docker.
bard
commented on June 15, 2024
# pwd
/var/lib/docker/volumes
# find c3adfff834557674644bcd0f96fe9e5d2d69cf2a78074a6c2cc980ecaa53b906/
c3adfff834557674644bcd0f96fe9e5d2d69cf2a78074a6c2cc980ecaa53b906/
c3adfff834557674644bcd0f96fe9e5d2d69cf2a78074a6c2cc980ecaa53b906/_data
c3adfff834557674644bcd0f96fe9e5d2d69cf2a78074a6c2cc980ecaa53b906/_data/databases
c3adfff834557674644bcd0f96fe9e5d2d69cf2a78074a6c2cc980ecaa53b906/_data/databases/database-1
c3adfff834557674644bcd0f96fe9e5d2d69cf2a78074a6c2cc980ecaa53b906/_data/databases/database-1/parameter.json
c3adfff834557674644bcd0f96fe9e5d2d69cf2a78074a6c2cc980ecaa53b906/_data/databases/database-1/collection-4-2229015302
[...]
c3adfff834557674644bcd0f96fe9e5d2d69cf2a78074a6c2cc980ecaa53b906/_data/databases/database-448
c3adfff834557674644bcd0f96fe9e5d2d69cf2a78074a6c2cc980ecaa53b906/_data/databases/database-448/parameter.json
[...]
Data appears to be there, too ("content:table" is a string my app was using):
# grep -ri "content:table" c3adfff834557674644bcd0f96fe9e5d2d69cf2a78074a6c2cc980ecaa53b906/
Binary file c3adfff834557674644bcd0f96fe9e5d2d69cf2a78074a6c2cc980ecaa53b906/_data/databases/database-448/collection-188905-3248645997/journal-197652.db matches
Binary file c3adfff834557674644bcd0f96fe9e5d2d69cf2a78074a6c2cc980ecaa53b906/_data/journals/logfile-185241.db matches
Binary file c3adfff834557674644bcd0f96fe9e5d2d69cf2a78074a6c2cc980ecaa53b906/_data/journals/logfile-411929.db matches
However I just found:
# find c3adfff834557674644bcd0f96fe9e5d2d69cf2a78074a6c2cc980ecaa53b906/ -type f | xargs cat >/dev/null
cat: c3adfff834557674644bcd0f96fe9e5d2d69cf2a78074a6c2cc980ecaa53b906/_data/journals/logfile-411929.db: Input/output error
And:
# dmesg
[...]
[28606.528169] BTRFS info (device sda7): no csum found for inode 6161202 start 20324352
[28606.532684] BTRFS info (device sda7): csum failed ino 6161202 extent 42237259776 csum 1472212044 wanted 0 mirror 0
[28606.549253] BTRFS info (device sda7): no csum found for inode 6161202 start 20324352
[28606.559394] BTRFS info (device sda7): csum failed ino 6161202 extent 42237259776 csum 1472212044 wanted 0 mirror 0
[28606.560180] BTRFS info (device sda7): no csum found for inode 6161202 start 20324352
[28606.590865] BTRFS info (device sda7): csum failed ino 6161202 extent 42237259776 csum 1472212044 wanted 0 mirror 0
Could this be happening because of a corrupt log file?
from arangodb-docker.
dothebart
commented on June 15, 2024
ah, the experimental filesystem - sorry, we don't support btrfs. Its known not to work well with arangodb.
from arangodb-docker.
bard
commented on June 15, 2024
Ok, that's good to know. For what it's worth, removing journals doesn't change the outcome.
Is there a tool that can dump databases for later re-importing without passing through the server?
from arangodb-docker.
dothebart
commented on June 15, 2024
you can try to run arangod with --wal.ignore-logfile-errors true or/and --database.ignore-datafile-errors true
You should then be able to dump the working parts
from arangodb-docker.
bard
commented on June 15, 2024
Unfortunately, the corrupt journal wasn't the culprit, running with those options doesn't expose any data. (Fortunately, it wasn't production data.) I'll keep the databases around in case I can investigate further.
from arangodb-docker.
dothebart
commented on June 15, 2024
Any news on this? or can we close it?
from arangodb-docker.
bard
commented on June 15, 2024
No news, sorry, I wasn't able to recover any data or figure out the problem.
from arangodb-docker.
dothebart
commented on June 15, 2024
meanwhile the documentation got an own chapter dedicated to upgrading - https://docs.arangodb.com/devel/Manual/Upgrading/ - closing this issue.
from arangodb-docker.
Related Issues (20)
- ENV options set to 0 have opposite effect
- Upgrade base image for alpine docker images
- [QUESTION] How to create database with docker-compose ?
- Folder Permission in Alpine images are not root group writeable HOT 2
- signals not handled in entrypoint
- Enabling experimental naming conventions HOT 2
- Docker image 3.8.6 ARANGO_ROOT_PASSWORD HOT 3
- ArangoDB 3.10? HOT 2
- Customize web interface appearance?
- Vulnerabilities in /usr/bin/arangodb HOT 18
- Cannot set tolerations/nodeSelector for temporary arangodb-cluster-id pod HOT 9
- Trivy findings in latest version HOT 3
- Vulnerabilities with image on DockerHub HOT 2
- Run crashes on macOS Ventura 13.5 HOT 10
- ARANGO_NO_AUTH still disables auth if set to 0
- /usr/sbin/arango-init-database failed with invalid value for '--rocksdb.max-background-jobs') = 95 HOT 1
- Let service run as application user instead of root user HOT 2
- [Question] Enter docker container HOT 3
- Can't I put haproxy in front of arangodb? HOT 2
- [QUESTION] Apply database and user creation during container build
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from arangodb-docker.