Comments (20)
dfunckt
commented on July 22, 2024
2
Glad you’re unblocked. Seems newer Docker versions introduced issues, we’ll need to do some investigating from our side.
from open-balena.
ab77
commented on July 22, 2024
Hello, could you please try the new guide here..
from open-balena.
pankalog
commented on July 22, 2024
Hello @ab77 ,
You're doing God's work! Amazing result, super easy to setup. Thank you so much!
I have been able to setup openBalena with no issues, using Cloudflare for automatic CAs. But I now have an issue:
(PS. If you'd rather have this over the balena forum, let me know)
After trying to deploy a new release, I am getting some errors related to the artifact registry. I believe it's missing some stuff that should be there? You should know more. This is on a very fresh deployment of openBalena:
-> % balena deploy --noparent-check myApp --debug
[debug] new argv=[/usr/local/lib/balena-cli/bin/node,/usr/local/lib/balena-cli/bin/run,deploy,--noparent-check,myApp] length=5
[debug] Deprecation check: 0.08539 days since last npm registry query for next major version release date.
[debug] Will not query the registry again until at least 7 days have passed.
[debug] Event tracking error: Timeout awaiting 'response' for 0ms
[Debug] Parsing input...
[Debug] Loading project...
[Debug] Resolving project...
[Debug] docker-compose.yml file found at "/Users/user/GitRepos/test/composetest/balena"
[Debug] Creating project...
[Info] Everything is up to date (use --build to force a rebuild)
[Info] Creating release...
[Debug] Tagging images...
[Debug] Authorizing push...
[Info] Pushing images to registry...
Retrying "registry2.balena.mydomain.com/v2/dc9e53ce6276f6fdaeb7e4b3dac1065e:latest" after 2.0s (1 of 2) due to: Error: missing content: content digest sha256:2589dab053d95c674b46b1fed48f838d087848b3c8d9ac1d9798bc9e17001319: not found
Note: You're trying to push a manifest list/index which references multiple platform specific manifests, but not all of them are available locally or available to the remote repository.
Make sure you have all the referenced content and try again.
Retrying "registry2.balena.mydomain.com/v2/94b51b3e2b2c17b4f0ac8c4a3dbc5681:latest" after 2.0s (1 of 2) due to: Error: missing content: content digest sha256:56eebee15fa468803f1cd72bd18ead37439ef0deb203d55f220e070ab2584101: not found
Note: You're trying to push a manifest list/index which references multiple platform specific manifests, but not all of them are available locally or available to the remote repository.
Make sure you have all the referenced content and try again.
Retrying "registry2.balena.mydomain.com/v2/d10281807470a6b1326c367f3051af74:latest" after 2.0s (1 of 2) due to: Error: missing content: content digest sha256:7c941376d4cab9d9041780e4040aa47b202a20d5b7457179f90dc15181bceb1b: not found
Note: You're trying to push a manifest list/index which references multiple platform specific manifests, but not all of them are available locally or available to the remote repository.
Make sure you have all the referenced content and try again.
Retrying "registry2.balena.mydomain.com/v2/dc9e53ce6276f6fdaeb7e4b3dac1065e:latest" after 2.8s (2 of 2) due to: Error: missing content: content digest sha256:35d57c72b62ca4f756ad0f9bad7aad17699a3255fae11275b038600107ca2e0d: not found
Note: You're trying to push a manifest list/index which references multiple platform specific manifests, but not all of them are available locally or available to the remote repository.
Make sure you have all the referenced content and try again.
Retrying "registry2.balena.mydomain.com/v2/94b51b3e2b2c17b4f0ac8c4a3dbc5681:latest" after 2.8s (2 of 2) due to: Error: missing content: content digest sha256:0dca7f8fdadd6dcc5fcba6d54c0b286c1751365bd2a3c1fa17e41f077611bd6a: not found
Note: You're trying to push a manifest list/index which references multiple platform specific manifests, but not all of them are available locally or available to the remote repository.
Make sure you have all the referenced content and try again.
Retrying "registry2.balena.mydomain.com/v2/d10281807470a6b1326c367f3051af74:latest" after 2.8s (2 of 2) due to: Error: missing content: content digest sha256:ece6fc8dd2f3a2ffd2aa66f565cf287c604aacb28e931a409898003accdb28e1: not found
Note: You're trying to push a manifest list/index which references multiple platform specific manifests, but not all of them are available locally or available to the remote repository.
Make sure you have all the referenced content and try again.
[Debug] Saving image registry2.balena.mydomain.com/v2/dc9e53ce6276f6fdaeb7e4b3dac1065e
[Debug] Saving image registry2.balena.mydomain.com/v2/94b51b3e2b2c17b4f0ac8c4a3dbc5681
[Debug] Saving image registry2.balena.mydomain.com/v2/d10281807470a6b1326c367f3051af74
[Debug] Untagging images... ] 13%
[Info] Saving release...
[Error] Deploy failed
missing content: content digest sha256:35d57c72b62ca4f756ad0f9bad7aad17699a3255fae11275b038600107ca2e0d: not found
Note: You're trying to push a manifest list/index which references multiple platform specific manifests, but not all of them are available locally or available to the remote repository.
Make sure you have all the referenced content and try again.
Error: missing content: content digest sha256:35d57c72b62ca4f756ad0f9bad7aad17699a3255fae11275b038600107ca2e0d: not found
Note: You're trying to push a manifest list/index which references multiple platform specific manifests, but not all of them are available locally or available to the remote repository.
Make sure you have all the referenced content and try again.
at Stream.<anonymous> (/usr/local/lib/balena-cli/node_modules/docker-progress/build/index.js:31:27)
at Stream.emit (node:events:518:28)
at Stream.emit (node:domain:488:12)
at drain (/usr/local/lib/balena-cli/node_modules/through/index.js:36:16)
at stream.queue.stream.push (/usr/local/lib/balena-cli/node_modules/through/index.js:45:5)
at parser.onToken (/usr/local/lib/balena-cli/node_modules/JSONStream/index.js:132:18)
at proto.write (/usr/local/lib/balena-cli/node_modules/jsonparse/jsonparse.js:135:34)
at Stream.<anonymous> (/usr/local/lib/balena-cli/node_modules/JSONStream/index.js:23:12)
at stream.write (/usr/local/lib/balena-cli/node_modules/through/index.js:26:11)
at IncomingMessage.ondata (node:internal/streams/readable:1007:22)
For further help or support, visit:
https://www.balena.io/docs/reference/balena-cli/#support-faq-and-troubleshooting
And I tried to find logs from the registry service, I included one such run:
registry-1 | [ 8201.069550] registry[1156]: 127.0.0.1 - - [02/Jun/2024:15:49:20 +0000] "HEAD / HTTP/1.1" 200 0 "" "curl/7.88.1"
registry-1 | [ 8246.169767] registry[1156]: 127.0.0.1 - - [02/Jun/2024:15:50:05 +0000] "HEAD / HTTP/1.1" 200 0 "" "curl/7.88.1"
registry-1 | [ 8291.268884] registry[1156]: 127.0.0.1 - - [02/Jun/2024:15:50:50 +0000] "HEAD / HTTP/1.1" 200 0 "" "curl/7.88.1"
registry-1 | [ 8336.393053] registry[1156]: 127.0.0.1 - - [02/Jun/2024:15:51:36 +0000] "HEAD / HTTP/1.1" 200 0 "" "curl/7.88.1"
registry-1 | [ 8381.217726] registry[1156]: time="2024-06-02T15:52:20.916790403Z" level=error msg="response completed with error" auth.user.name=admin err.code="blob unknown" err.detail=sha256:df8e22bbaa3c385fb5fe6c69cd43c76ff73e30ac1c301f70d223e88b6bb4172d err.message="blob unknown to registry" go.version=go1.20.8 http.request.host=registry2.balena.mydomain.com http.request.id=41aa0cad-b4b4-4ae4-8083-38dfc9a41573 http.request.method=HEAD http.request.remoteaddr="::ffff:<balena cli remote IP>" http.request.uri="/v2/v2/584b2c41ed49687232cbee9642462502/blobs/sha256:df8e22bbaa3c385fb5fe6c69cd43c76ff73e30ac1c301f70d223e88b6bb4172d" http.request.useragent="docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)" http.response.contenttype="application/json; charset=utf-8" http.response.duration=28.772222ms http.response.status=404 http.response.written=157 vars.digest="sha256:df8e22bbaa3c385fb5fe6c69cd43c76ff73e30ac1c301f70d223e88b6bb4172d" vars.name="v2/584b2c41ed49687232cbee9642462502"
registry-1 | [ 8381.218538] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:20 +0000] "HEAD /v2/v2/584b2c41ed49687232cbee9642462502/blobs/sha256:df8e22bbaa3c385fb5fe6c69cd43c76ff73e30ac1c301f70d223e88b6bb4172d HTTP/1.1" 404 157 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8381.218626] registry[1156]: time="2024-06-02T15:52:20.917051841Z" level=error msg="response completed with error" auth.user.name=admin err.code="blob unknown" err.detail=sha256:0a51431d45f40d42a34243fd91bcb57f6180039528be4d16e27f296c57fbfc24 err.message="blob unknown to registry" go.version=go1.20.8 http.request.host=registry2.balena.mydomain.com http.request.id=8e0da12c-9d1a-4400-ab6f-7c014a4d676a http.request.method=HEAD http.request.remoteaddr="::ffff:<balena cli remote IP>" http.request.uri="/v2/v2/584b2c41ed49687232cbee9642462502/blobs/sha256:0a51431d45f40d42a34243fd91bcb57f6180039528be4d16e27f296c57fbfc24" http.request.useragent="docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)" http.response.contenttype="application/json; charset=utf-8" http.response.duration=31.898601ms http.response.status=404 http.response.written=157 vars.digest="sha256:0a51431d45f40d42a34243fd91bcb57f6180039528be4d16e27f296c57fbfc24" vars.name="v2/584b2c41ed49687232cbee9642462502"
registry-1 | [ 8381.218691] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:20 +0000] "HEAD /v2/v2/584b2c41ed49687232cbee9642462502/blobs/sha256:0a51431d45f40d42a34243fd91bcb57f6180039528be4d16e27f296c57fbfc24 HTTP/1.1" 404 157 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8381.218785] registry[1156]: time="2024-06-02T15:52:20.91715886Z" level=error msg="response completed with error" auth.user.name=admin err.code="blob unknown" err.detail=sha256:1092985e81c2e4628fc64ff9ee15f63cf65e9b3189af8cb8e29386182a85d8cc err.message="blob unknown to registry" go.version=go1.20.8 http.request.host=registry2.balena.mydomain.com http.request.id=6c231552-a92d-4375-a07a-73bb1eb50152 http.request.method=HEAD http.request.remoteaddr="::ffff:<balena cli remote IP>" http.request.uri="/v2/v2/584b2c41ed49687232cbee9642462502/blobs/sha256:1092985e81c2e4628fc64ff9ee15f63cf65e9b3189af8cb8e29386182a85d8cc" http.request.useragent="docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)" http.response.contenttype="application/json; charset=utf-8" http.response.duration=29.335136ms http.response.status=404 http.response.written=157 vars.digest="sha256:1092985e81c2e4628fc64ff9ee15f63cf65e9b3189af8cb8e29386182a85d8cc" vars.name="v2/584b2c41ed49687232cbee9642462502"
registry-1 | [ 8381.218880] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:20 +0000] "HEAD /v2/v2/584b2c41ed49687232cbee9642462502/blobs/sha256:1092985e81c2e4628fc64ff9ee15f63cf65e9b3189af8cb8e29386182a85d8cc HTTP/1.1" 404 157 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8381.218942] registry[1156]: time="2024-06-02T15:52:20.917165813Z" level=error msg="response completed with error" auth.user.name=admin err.code="blob unknown" err.detail=sha256:bfe2f0cfd8e66f6d6e58339ab6050b399e9cec44bff06712aa208e0772fe335d err.message="blob unknown to registry" go.version=go1.20.8 http.request.host=registry2.balena.mydomain.com http.request.id=c846f3bb-5d76-4675-b51b-528b1bce434a http.request.method=HEAD http.request.remoteaddr="::ffff:<balena cli remote IP>" http.request.uri="/v2/v2/584b2c41ed49687232cbee9642462502/blobs/sha256:bfe2f0cfd8e66f6d6e58339ab6050b399e9cec44bff06712aa208e0772fe335d" http.request.useragent="docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)" http.response.contenttype="application/json; charset=utf-8" http.response.duration=35.992297ms http.response.status=404 http.response.written=157 vars.digest="sha256:bfe2f0cfd8e66f6d6e58339ab6050b399e9cec44bff06712aa208e0772fe335d" vars.name="v2/584b2c41ed49687232cbee9642462502"
registry-1 | [ 8381.219037] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:20 +0000] "HEAD /v2/v2/584b2c41ed49687232cbee9642462502/blobs/sha256:bfe2f0cfd8e66f6d6e58339ab6050b399e9cec44bff06712aa208e0772fe335d HTTP/1.1" 404 157 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8381.219155] registry[1156]: time="2024-06-02T15:52:20.917578976Z" level=error msg="response completed with error" auth.user.name=admin err.code="blob unknown" err.detail=sha256:b70cdb37098f86a1ccd1a09b3b94f2610ea0539ce08dfa5fabcc53dcb3bf76d2 err.message="blob unknown to registry" go.version=go1.20.8 http.request.host=registry2.balena.mydomain.com http.request.id=de0fa90e-1acb-4369-ba1b-c15939f83c6f http.request.method=HEAD http.request.remoteaddr="::ffff:<balena cli remote IP>" http.request.uri="/v2/v2/584b2c41ed49687232cbee9642462502/blobs/sha256:b70cdb37098f86a1ccd1a09b3b94f2610ea0539ce08dfa5fabcc53dcb3bf76d2" http.request.useragent="docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)" http.response.contenttype="application/json; charset=utf-8" http.response.duration=37.488327ms http.response.status=404 http.response.written=157 vars.digest="sha256:b70cdb37098f86a1ccd1a09b3b94f2610ea0539ce08dfa5fabcc53dcb3bf76d2" vars.name="v2/584b2c41ed49687232cbee9642462502"
registry-1 | [ 8381.219241] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:20 +0000] "HEAD /v2/v2/584b2c41ed49687232cbee9642462502/blobs/sha256:b70cdb37098f86a1ccd1a09b3b94f2610ea0539ce08dfa5fabcc53dcb3bf76d2 HTTP/1.1" 404 157 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8381.219297] registry[1156]: time="2024-06-02T15:52:20.917802281Z" level=error msg="response completed with error" auth.user.name=admin err.code="blob unknown" err.detail=sha256:903be872261d277c05f94013226d675d74edce180060f34025a113d33d7697e5 err.message="blob unknown to registry" go.version=go1.20.8 http.request.host=registry2.balena.mydomain.com http.request.id=13769cfc-ff15-4c14-b9ba-38124724f7f5 http.request.method=HEAD http.request.remoteaddr="::ffff:<balena cli remote IP>" http.request.uri="/v2/v2/584b2c41ed49687232cbee9642462502/blobs/sha256:903be872261d277c05f94013226d675d74edce180060f34025a113d33d7697e5" http.request.useragent="docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)" http.response.contenttype="application/json; charset=utf-8" http.response.duration=32.121644ms http.response.status=404 http.response.written=157 vars.digest="sha256:903be872261d277c05f94013226d675d74edce180060f34025a113d33d7697e5" vars.name="v2/584b2c41ed49687232cbee9642462502"
registry-1 | [ 8381.219363] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:20 +0000] "HEAD /v2/v2/584b2c41ed49687232cbee9642462502/blobs/sha256:903be872261d277c05f94013226d675d74edce180060f34025a113d33d7697e5 HTTP/1.1" 404 157 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8381.219444] registry[1156]: time="2024-06-02T15:52:20.918055873Z" level=error msg="response completed with error" auth.user.name=admin err.code="blob unknown" err.detail=sha256:32a0526d00e59a10c6eb0e22121fcec1530a666269ed6c644c1f8dfde522d71a err.message="blob unknown to registry" go.version=go1.20.8 http.request.host=registry2.balena.mydomain.com http.request.id=603ee2fa-3722-401b-8939-04cb84b3ac05 http.request.method=HEAD http.request.remoteaddr="::ffff:<balena cli remote IP>" http.request.uri="/v2/v2/584b2c41ed49687232cbee9642462502/blobs/sha256:32a0526d00e59a10c6eb0e22121fcec1530a666269ed6c644c1f8dfde522d71a" http.request.useragent="docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)" http.response.contenttype="application/json; charset=utf-8" http.response.duration=36.78036ms http.response.status=404 http.response.written=157 vars.digest="sha256:32a0526d00e59a10c6eb0e22121fcec1530a666269ed6c644c1f8dfde522d71a" vars.name="v2/584b2c41ed49687232cbee9642462502"
registry-1 | [ 8381.219510] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:20 +0000] "HEAD /v2/v2/584b2c41ed49687232cbee9642462502/blobs/sha256:32a0526d00e59a10c6eb0e22121fcec1530a666269ed6c644c1f8dfde522d71a HTTP/1.1" 404 157 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8381.219556] registry[1156]: time="2024-06-02T15:52:20.918117002Z" level=error msg="response completed with error" auth.user.name=admin err.code="blob unknown" err.detail=sha256:8c6ada28565b2f076fc632395e33c7182eb96a579724f1a81f357b4106b1e65b err.message="blob unknown to registry" go.version=go1.20.8 http.request.host=registry2.balena.mydomain.com http.request.id=5ff0dc19-5be0-49f7-b4c7-d506283ecc95 http.request.method=HEAD http.request.remoteaddr="::ffff:<balena cli remote IP>" http.request.uri="/v2/v2/584b2c41ed49687232cbee9642462502/blobs/sha256:8c6ada28565b2f076fc632395e33c7182eb96a579724f1a81f357b4106b1e65b" http.request.useragent="docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)" http.response.contenttype="application/json; charset=utf-8" http.response.duration=31.743879ms http.response.status=404 http.response.written=157 vars.digest="sha256:8c6ada28565b2f076fc632395e33c7182eb96a579724f1a81f357b4106b1e65b" vars.name="v2/584b2c41ed49687232cbee9642462502"
registry-1 | [ 8381.219609] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:20 +0000] "HEAD /v2/v2/584b2c41ed49687232cbee9642462502/blobs/sha256:8c6ada28565b2f076fc632395e33c7182eb96a579724f1a81f357b4106b1e65b HTTP/1.1" 404 157 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8381.219656] registry[1156]: time="2024-06-02T15:52:20.918268316Z" level=error msg="response completed with error" auth.user.name=admin err.code="blob unknown" err.detail=sha256:6369fd4baf1d56e17df495a5516cbc2ff36f364969ad328e3df27be615090261 err.message="blob unknown to registry" go.version=go1.20.8 http.request.host=registry2.balena.mydomain.com http.request.id=5fc1704a-9fde-434e-b11d-bcf4a06eed90 http.request.method=HEAD http.request.remoteaddr="::ffff:<balena cli remote IP>" http.request.uri="/v2/v2/584b2c41ed49687232cbee9642462502/blobs/sha256:6369fd4baf1d56e17df495a5516cbc2ff36f364969ad328e3df27be615090261" http.request.useragent="docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)" http.response.contenttype="application/json; charset=utf-8" http.response.duration=34.580533ms http.response.status=404 http.response.written=157 vars.digest="sha256:6369fd4baf1d56e17df495a5516cbc2ff36f364969ad328e3df27be615090261" vars.name="v2/584b2c41ed49687232cbee9642462502"
registry-1 | [ 8381.219706] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:20 +0000] "HEAD /v2/v2/584b2c41ed49687232cbee9642462502/blobs/sha256:6369fd4baf1d56e17df495a5516cbc2ff36f364969ad328e3df27be615090261 HTTP/1.1" 404 157 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8381.234262] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:20 +0000] "POST /v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/?mount=sha256:1092985e81c2e4628fc64ff9ee15f63cf65e9b3189af8cb8e29386182a85d8cc&from=v2/d079034d7976ec1b95d10e66235a07c0 HTTP/1.1" 401 366 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8381.235386] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:20 +0000] "POST /v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/?mount=sha256:b70cdb37098f86a1ccd1a09b3b94f2610ea0539ce08dfa5fabcc53dcb3bf76d2&from=v2/d079034d7976ec1b95d10e66235a07c0 HTTP/1.1" 401 366 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8381.239382] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:20 +0000] "POST /v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/?mount=sha256:32a0526d00e59a10c6eb0e22121fcec1530a666269ed6c644c1f8dfde522d71a&from=v2/d079034d7976ec1b95d10e66235a07c0 HTTP/1.1" 401 366 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8381.240035] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:20 +0000] "POST /v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/?mount=sha256:6369fd4baf1d56e17df495a5516cbc2ff36f364969ad328e3df27be615090261&from=v2/d079034d7976ec1b95d10e66235a07c0 HTTP/1.1" 401 366 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8381.240460] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:20 +0000] "POST /v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/?mount=sha256:903be872261d277c05f94013226d675d74edce180060f34025a113d33d7697e5&from=v2/d079034d7976ec1b95d10e66235a07c0 HTTP/1.1" 401 366 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8381.245257] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:20 +0000] "POST /v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/?mount=sha256:0a51431d45f40d42a34243fd91bcb57f6180039528be4d16e27f296c57fbfc24&from=v2/d079034d7976ec1b95d10e66235a07c0 HTTP/1.1" 401 366 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8381.245982] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:20 +0000] "POST /v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/?mount=sha256:8c6ada28565b2f076fc632395e33c7182eb96a579724f1a81f357b4106b1e65b&from=v2/d079034d7976ec1b95d10e66235a07c0 HTTP/1.1" 401 366 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8381.246807] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:20 +0000] "POST /v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/?mount=sha256:df8e22bbaa3c385fb5fe6c69cd43c76ff73e30ac1c301f70d223e88b6bb4172d&from=v2/d079034d7976ec1b95d10e66235a07c0 HTTP/1.1" 401 366 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8381.247906] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:20 +0000] "POST /v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/?mount=sha256:bfe2f0cfd8e66f6d6e58339ab6050b399e9cec44bff06712aa208e0772fe335d&from=v2/d079034d7976ec1b95d10e66235a07c0 HTTP/1.1" 401 366 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8381.309549] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:20 +0000] "POST /v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/ HTTP/1.1" 202 0 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8381.320180] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:20 +0000] "POST /v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/ HTTP/1.1" 202 0 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8381.321257] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:20 +0000] "POST /v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/ HTTP/1.1" 202 0 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8381.323177] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:20 +0000] "POST /v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/ HTTP/1.1" 202 0 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8381.324190] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:21 +0000] "POST /v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/ HTTP/1.1" 202 0 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8381.325537] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:20 +0000] "POST /v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/ HTTP/1.1" 202 0 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8381.326881] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:20 +0000] "POST /v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/ HTTP/1.1" 202 0 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8381.328430] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:21 +0000] "POST /v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/ HTTP/1.1" 202 0 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8381.329097] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:21 +0000] "POST /v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/ HTTP/1.1" 202 0 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8381.392603] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:21 +0000] "PUT /v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/0d7afee7-85c8-41c2-9194-dc89b8a05ef4?_state=BtZm_KZ9PaKoMHGFx8G8QGWfr2qPIce-a1vLB3bTt417Ik5hbWUiOiJ2Mi81ODRiMmM0MWVkNDk2ODcyMzJjYmVlOTY0MjQ2MjUwMiIsIlVVSUQiOiIwZDdhZmVlNy04NWM4LTQxYzItOTE5NC1kYzg5YjhhMDVlZjQiLCJPZmZzZXQiOjAsIlN0YXJ0ZWRBdCI6IjIwMjQtMDYtMDJUMTU6NTI6MjAuOTk3NzI3NzczWiJ9&digest=sha256%3A903be872261d277c05f94013226d675d74edce180060f34025a113d33d7697e5 HTTP/1.1" 201 0 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8381.395541] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:21 +0000] "PUT /v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/2ee6ef49-feda-4c64-8b60-7aeee3223454?_state=VMS_J8X7BkCMNWmFz8dimUoHpyah01W-VTTiFCZ9YjN7Ik5hbWUiOiJ2Mi81ODRiMmM0MWVkNDk2ODcyMzJjYmVlOTY0MjQ2MjUwMiIsIlVVSUQiOiIyZWU2ZWY0OS1mZWRhLTRjNjQtOGI2MC03YWVlZTMyMjM0NTQiLCJPZmZzZXQiOjAsIlN0YXJ0ZWRBdCI6IjIwMjQtMDYtMDJUMTU6NTI6MjEuMDA2NzgzMDU2WiJ9&digest=sha256%3Abfe2f0cfd8e66f6d6e58339ab6050b399e9cec44bff06712aa208e0772fe335d HTTP/1.1" 201 0 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8381.413104] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:21 +0000] "PUT /v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/311124b3-41af-44b8-ac83-f003130c4e7e?_state=PpO-d8BQtPe00HdV5riKqeM0TJf7FWrgGOH0RdQfYCZ7Ik5hbWUiOiJ2Mi81ODRiMmM0MWVkNDk2ODcyMzJjYmVlOTY0MjQ2MjUwMiIsIlVVSUQiOiIzMTExMjRiMy00MWFmLTQ0YjgtYWM4My1mMDAzMTMwYzRlN2UiLCJPZmZzZXQiOjAsIlN0YXJ0ZWRBdCI6IjIwMjQtMDYtMDJUMTU6NTI6MjAuOTg5NTc3NzlaIn0%3D&digest=sha256%3A1092985e81c2e4628fc64ff9ee15f63cf65e9b3189af8cb8e29386182a85d8cc HTTP/1.1" 201 0 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8381.415103] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:21 +0000] "PUT /v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/3f811460-aa51-496a-888b-624f447ac5bb?_state=UgbkfRz8RL9Ohn4YYWBpVb8DFtlUfUcY2-V0Agu7-gt7Ik5hbWUiOiJ2Mi81ODRiMmM0MWVkNDk2ODcyMzJjYmVlOTY0MjQ2MjUwMiIsIlVVSUQiOiIzZjgxMTQ2MC1hYTUxLTQ5NmEtODg4Yi02MjRmNDQ3YWM1YmIiLCJPZmZzZXQiOjAsIlN0YXJ0ZWRBdCI6IjIwMjQtMDYtMDJUMTU6NTI6MjEuMDA3MzExNjM0WiJ9&digest=sha256%3A8c6ada28565b2f076fc632395e33c7182eb96a579724f1a81f357b4106b1e65b HTTP/1.1" 201 0 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8381.504191] registry[1156]: 127.0.0.1 - - [02/Jun/2024:15:52:21 +0000] "HEAD / HTTP/1.1" 200 0 "" "curl/7.88.1"
registry-1 | [ 8388.596889] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:21 +0000] "PUT /v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/0555dda3-2eb7-4ed5-916b-0168a580faf5?_state=sQ5WV5Cq40USwWVNHHBv1HGXukrtnYBPIn-ISAxXJpx7Ik5hbWUiOiJ2Mi81ODRiMmM0MWVkNDk2ODcyMzJjYmVlOTY0MjQ2MjUwMiIsIlVVSUQiOiIwNTU1ZGRhMy0yZWI3LTRlZDUtOTE2Yi0wMTY4YTU4MGZhZjUiLCJPZmZzZXQiOjAsIlN0YXJ0ZWRBdCI6IjIwMjQtMDYtMDJUMTU6NTI6MjEuMDA2MTMxMjRaIn0%3D&digest=sha256%3Adf8e22bbaa3c385fb5fe6c69cd43c76ff73e30ac1c301f70d223e88b6bb4172d HTTP/1.1" 201 0 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8388.653035] registry[1156]: time="2024-06-02T15:52:28.353701811Z" level=error msg="client disconnected during blob PUT" auth.user.name=admin contentLength=196180731 copied=15073280 error="read tcp 172.19.0.12:80->172.19.0.2:50886: read: connection reset by peer" go.version=go1.20.8 http.request.contenttype="application/octet-stream" http.request.host=registry2.balena.mydomain.com http.request.id=40e6ddb8-5a1d-4551-915f-2aa2e3828a0a http.request.method=PUT http.request.remoteaddr="::ffff:<balena cli remote IP>" http.request.uri="/v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/897d7390-72ca-42ae-9e06-8e69d2bca48b?_state=XH5klJborRHkNSNqmjO8DnslyxNWkHqWEWp_ehK5x_l7Ik5hbWUiOiJ2Mi81ODRiMmM0MWVkNDk2ODcyMzJjYmVlOTY0MjQ2MjUwMiIsIlVVSUQiOiI4OTdkNzM5MC03MmNhLTQyYWUtOWUwNi04ZTY5ZDJiY2E0OGIiLCJPZmZzZXQiOjAsIlN0YXJ0ZWRBdCI6IjIwMjQtMDYtMDJUMTU6NTI6MjEuMDAzMTM1OTM2WiJ9&digest=sha256%3A0a51431d45f40d42a34243fd91bcb57f6180039528be4d16e27f296c57fbfc24" http.request.useragent="docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)" vars.name="v2/584b2c41ed49687232cbee9642462502" vars.uuid=897d7390-72ca-42ae-9e06-8e69d2bca48b
registry-1 | [ 8388.663368] registry[1156]: time="2024-06-02T15:52:28.363892481Z" level=error msg="client disconnected during blob PUT" auth.user.name=admin contentLength=19158899 copied=18857984 error="read tcp 172.19.0.12:80->172.19.0.2:50818: read: connection reset by peer" go.version=go1.20.8 http.request.contenttype="application/octet-stream" http.request.host=registry2.balena.mydomain.com http.request.id=01e75502-244c-4823-a018-7d73b3d9fffb http.request.method=PUT http.request.remoteaddr="::ffff:<balena cli remote IP>" http.request.uri="/v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/5a29d7e2-3478-42de-91a1-6c9edd00c583?_state=mjw3uN4HpxsqH47iM_jtNjwlDaRFHnCja9jyHNJSdqt7Ik5hbWUiOiJ2Mi81ODRiMmM0MWVkNDk2ODcyMzJjYmVlOTY0MjQ2MjUwMiIsIlVVSUQiOiI1YTI5ZDdlMi0zNDc4LTQyZGUtOTFhMS02YzllZGQwMGM1ODMiLCJPZmZzZXQiOjAsIlN0YXJ0ZWRBdCI6IjIwMjQtMDYtMDJUMTU6NTI6MjEuMDA0ODQ1NzVaIn0%3D&digest=sha256%3A32a0526d00e59a10c6eb0e22121fcec1530a666269ed6c644c1f8dfde522d71a" http.request.useragent="docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)" vars.name="v2/584b2c41ed49687232cbee9642462502" vars.uuid=5a29d7e2-3478-42de-91a1-6c9edd00c583
registry-1 | [ 8388.875872] registry[1156]: time="2024-06-02T15:52:28.576431223Z" level=error msg="client disconnected during blob PUT" auth.user.name=admin contentLength=91441545 copied=11550720 error="read tcp 172.19.0.12:80->172.19.0.2:50864: read: connection reset by peer" go.version=go1.20.8 http.request.contenttype="application/octet-stream" http.request.host=registry2.balena.mydomain.com http.request.id=b22b3c87-215f-4e95-8ee7-df1f9922d1cd http.request.method=PUT http.request.remoteaddr="::ffff:<balena cli remote IP>" http.request.uri="/v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/83fd40aa-2d41-406c-b6fd-693e77f6c3ec?_state=3yn4-3ksnqtHx5qMCuW6zRnQS3fdaCxR3-Dc3ZmOs5p7Ik5hbWUiOiJ2Mi81ODRiMmM0MWVkNDk2ODcyMzJjYmVlOTY0MjQ2MjUwMiIsIlVVSUQiOiI4M2ZkNDBhYS0yZDQxLTQwNmMtYjZmZC02OTNlNzdmNmMzZWMiLCJPZmZzZXQiOjAsIlN0YXJ0ZWRBdCI6IjIwMjQtMDYtMDJUMTU6NTI6MjAuOTk3MTg5OTU4WiJ9&digest=sha256%3A6369fd4baf1d56e17df495a5516cbc2ff36f364969ad328e3df27be615090261" http.request.useragent="docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)" vars.name="v2/584b2c41ed49687232cbee9642462502" vars.uuid=83fd40aa-2d41-406c-b6fd-693e77f6c3ec
registry-1 | [ 8388.949872] registry[1156]: 2024/06/02 15:52:28 http: superfluous response.WriteHeader call from github.com/docker/distribution/vendor/github.com/gorilla/handlers.(*responseLogger).WriteHeader (handlers.go:125)
registry-1 | [ 8388.949973] registry[1156]: time="2024-06-02T15:52:28.650597548Z" level=error msg="response completed with error" auth.user.name=admin err.code=unknown err.detail="client disconnected" err.message="unknown error" go.version=go1.20.8 http.request.contenttype="application/octet-stream" http.request.host=registry2.balena.mydomain.com http.request.id=40e6ddb8-5a1d-4551-915f-2aa2e3828a0a http.request.method=PUT http.request.remoteaddr="::ffff:<balena cli remote IP>" http.request.uri="/v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/897d7390-72ca-42ae-9e06-8e69d2bca48b?_state=XH5klJborRHkNSNqmjO8DnslyxNWkHqWEWp_ehK5x_l7Ik5hbWUiOiJ2Mi81ODRiMmM0MWVkNDk2ODcyMzJjYmVlOTY0MjQ2MjUwMiIsIlVVSUQiOiI4OTdkNzM5MC03MmNhLTQyYWUtOWUwNi04ZTY5ZDJiY2E0OGIiLCJPZmZzZXQiOjAsIlN0YXJ0ZWRBdCI6IjIwMjQtMDYtMDJUMTU6NTI6MjEuMDAzMTM1OTM2WiJ9&digest=sha256%3A0a51431d45f40d42a34243fd91bcb57f6180039528be4d16e27f296c57fbfc24" http.request.useragent="docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)" http.response.contenttype="application/json; charset=utf-8" http.response.duration=7.604351966s http.response.status=500 http.response.written=89 vars.name="v2/584b2c41ed49687232cbee9642462502" vars.uuid=897d7390-72ca-42ae-9e06-8e69d2bca48b
registry-1 | [ 8388.950284] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:21 +0000] "PUT /v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/897d7390-72ca-42ae-9e06-8e69d2bca48b?_state=XH5klJborRHkNSNqmjO8DnslyxNWkHqWEWp_ehK5x_l7Ik5hbWUiOiJ2Mi81ODRiMmM0MWVkNDk2ODcyMzJjYmVlOTY0MjQ2MjUwMiIsIlVVSUQiOiI4OTdkNzM5MC03MmNhLTQyYWUtOWUwNi04ZTY5ZDJiY2E0OGIiLCJPZmZzZXQiOjAsIlN0YXJ0ZWRBdCI6IjIwMjQtMDYtMDJUMTU6NTI6MjEuMDAzMTM1OTM2WiJ9&digest=sha256%3A0a51431d45f40d42a34243fd91bcb57f6180039528be4d16e27f296c57fbfc24 HTTP/1.1" 500 89 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8389.105229] registry[1156]: 2024/06/02 15:52:28 http: superfluous response.WriteHeader call from github.com/docker/distribution/vendor/github.com/gorilla/handlers.(*responseLogger).WriteHeader (handlers.go:125)
registry-1 | [ 8389.105822] registry[1156]: time="2024-06-02T15:52:28.806080357Z" level=error msg="response completed with error" auth.user.name=admin err.code=unknown err.detail="client disconnected" err.message="unknown error" go.version=go1.20.8 http.request.contenttype="application/octet-stream" http.request.host=registry2.balena.mydomain.com http.request.id=b22b3c87-215f-4e95-8ee7-df1f9922d1cd http.request.method=PUT http.request.remoteaddr="::ffff:<balena cli remote IP>" http.request.uri="/v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/83fd40aa-2d41-406c-b6fd-693e77f6c3ec?_state=3yn4-3ksnqtHx5qMCuW6zRnQS3fdaCxR3-Dc3ZmOs5p7Ik5hbWUiOiJ2Mi81ODRiMmM0MWVkNDk2ODcyMzJjYmVlOTY0MjQ2MjUwMiIsIlVVSUQiOiI4M2ZkNDBhYS0yZDQxLTQwNmMtYjZmZC02OTNlNzdmNmMzZWMiLCJPZmZzZXQiOjAsIlN0YXJ0ZWRBdCI6IjIwMjQtMDYtMDJUMTU6NTI6MjAuOTk3MTg5OTU4WiJ9&digest=sha256%3A6369fd4baf1d56e17df495a5516cbc2ff36f364969ad328e3df27be615090261" http.request.useragent="docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)" http.response.contenttype="application/json; charset=utf-8" http.response.duration=7.764071833s http.response.status=500 http.response.written=89 vars.name="v2/584b2c41ed49687232cbee9642462502" vars.uuid=83fd40aa-2d41-406c-b6fd-693e77f6c3ec
registry-1 | [ 8389.106077] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:21 +0000] "PUT /v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/83fd40aa-2d41-406c-b6fd-693e77f6c3ec?_state=3yn4-3ksnqtHx5qMCuW6zRnQS3fdaCxR3-Dc3ZmOs5p7Ik5hbWUiOiJ2Mi81ODRiMmM0MWVkNDk2ODcyMzJjYmVlOTY0MjQ2MjUwMiIsIlVVSUQiOiI4M2ZkNDBhYS0yZDQxLTQwNmMtYjZmZC02OTNlNzdmNmMzZWMiLCJPZmZzZXQiOjAsIlN0YXJ0ZWRBdCI6IjIwMjQtMDYtMDJUMTU6NTI6MjAuOTk3MTg5OTU4WiJ9&digest=sha256%3A6369fd4baf1d56e17df495a5516cbc2ff36f364969ad328e3df27be615090261 HTTP/1.1" 500 89 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8389.115592] registry[1156]: 2024/06/02 15:52:28 http: superfluous response.WriteHeader call from github.com/docker/distribution/vendor/github.com/gorilla/handlers.(*responseLogger).WriteHeader (handlers.go:125)
registry-1 | [ 8389.115699] registry[1156]: time="2024-06-02T15:52:28.816354168Z" level=error msg="response completed with error" auth.user.name=admin err.code=unknown err.detail="client disconnected" err.message="unknown error" go.version=go1.20.8 http.request.contenttype="application/octet-stream" http.request.host=registry2.balena.mydomain.com http.request.id=01e75502-244c-4823-a018-7d73b3d9fffb http.request.method=PUT http.request.remoteaddr="::ffff:<balena cli remote IP>" http.request.uri="/v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/5a29d7e2-3478-42de-91a1-6c9edd00c583?_state=mjw3uN4HpxsqH47iM_jtNjwlDaRFHnCja9jyHNJSdqt7Ik5hbWUiOiJ2Mi81ODRiMmM0MWVkNDk2ODcyMzJjYmVlOTY0MjQ2MjUwMiIsIlVVSUQiOiI1YTI5ZDdlMi0zNDc4LTQyZGUtOTFhMS02YzllZGQwMGM1ODMiLCJPZmZzZXQiOjAsIlN0YXJ0ZWRBdCI6IjIwMjQtMDYtMDJUMTU6NTI6MjEuMDA0ODQ1NzVaIn0%3D&digest=sha256%3A32a0526d00e59a10c6eb0e22121fcec1530a666269ed6c644c1f8dfde522d71a" http.request.useragent="docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)" http.response.contenttype="application/json; charset=utf-8" http.response.duration=7.769388608s http.response.status=500 http.response.written=89 vars.name="v2/584b2c41ed49687232cbee9642462502" vars.uuid=5a29d7e2-3478-42de-91a1-6c9edd00c583
registry-1 | [ 8389.115827] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:21 +0000] "PUT /v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/5a29d7e2-3478-42de-91a1-6c9edd00c583?_state=mjw3uN4HpxsqH47iM_jtNjwlDaRFHnCja9jyHNJSdqt7Ik5hbWUiOiJ2Mi81ODRiMmM0MWVkNDk2ODcyMzJjYmVlOTY0MjQ2MjUwMiIsIlVVSUQiOiI1YTI5ZDdlMi0zNDc4LTQyZGUtOTFhMS02YzllZGQwMGM1ODMiLCJPZmZzZXQiOjAsIlN0YXJ0ZWRBdCI6IjIwMjQtMDYtMDJUMTU6NTI6MjEuMDA0ODQ1NzVaIn0%3D&digest=sha256%3A32a0526d00e59a10c6eb0e22121fcec1530a666269ed6c644c1f8dfde522d71a HTTP/1.1" 500 89 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8389.432472] registry[1156]: time="2024-06-02T15:52:29.132999145Z" level=error msg="client disconnected during blob PUT" auth.user.name=admin contentLength=37737169 copied=15138816 error="read tcp 172.19.0.12:80->172.19.0.2:50846: read: connection reset by peer" go.version=go1.20.8 http.request.contenttype="application/octet-stream" http.request.host=registry2.balena.mydomain.com http.request.id=1dadb2bd-005a-4a46-bfce-f0df90438805 http.request.method=PUT http.request.remoteaddr="::ffff:<balena cli remote IP>" http.request.uri="/v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/83d46525-9e35-42e8-beed-ebc300a73452?_state=0UcecddhMFdhDb5qzwY5OvEVsxYmpeOt50Mz8CVfd6N7Ik5hbWUiOiJ2Mi81ODRiMmM0MWVkNDk2ODcyMzJjYmVlOTY0MjQ2MjUwMiIsIlVVSUQiOiI4M2Q0NjUyNS05ZTM1LTQyZTgtYmVlZC1lYmMzMDBhNzM0NTIiLCJPZmZzZXQiOjAsIlN0YXJ0ZWRBdCI6IjIwMjQtMDYtMDJUMTU6NTI6MjAuOTkwNDE4NzY1WiJ9&digest=sha256%3Ab70cdb37098f86a1ccd1a09b3b94f2610ea0539ce08dfa5fabcc53dcb3bf76d2" http.request.useragent="docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)" vars.name="v2/584b2c41ed49687232cbee9642462502" vars.uuid=83d46525-9e35-42e8-beed-ebc300a73452
registry-1 | [ 8389.623959] registry[1156]: 2024/06/02 15:52:29 http: superfluous response.WriteHeader call from github.com/docker/distribution/vendor/github.com/gorilla/handlers.(*responseLogger).WriteHeader (handlers.go:125)
registry-1 | [ 8389.624252] registry[1156]: time="2024-06-02T15:52:29.324538824Z" level=error msg="response completed with error" auth.user.name=admin err.code=unknown err.detail="client disconnected" err.message="unknown error" go.version=go1.20.8 http.request.contenttype="application/octet-stream" http.request.host=registry2.balena.mydomain.com http.request.id=1dadb2bd-005a-4a46-bfce-f0df90438805 http.request.method=PUT http.request.remoteaddr="::ffff:<balena cli remote IP>" http.request.uri="/v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/83d46525-9e35-42e8-beed-ebc300a73452?_state=0UcecddhMFdhDb5qzwY5OvEVsxYmpeOt50Mz8CVfd6N7Ik5hbWUiOiJ2Mi81ODRiMmM0MWVkNDk2ODcyMzJjYmVlOTY0MjQ2MjUwMiIsIlVVSUQiOiI4M2Q0NjUyNS05ZTM1LTQyZTgtYmVlZC1lYmMzMDBhNzM0NTIiLCJPZmZzZXQiOjAsIlN0YXJ0ZWRBdCI6IjIwMjQtMDYtMDJUMTU6NTI6MjAuOTkwNDE4NzY1WiJ9&digest=sha256%3Ab70cdb37098f86a1ccd1a09b3b94f2610ea0539ce08dfa5fabcc53dcb3bf76d2" http.request.useragent="docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)" http.response.contenttype="application/json; charset=utf-8" http.response.duration=8.296848734s http.response.status=500 http.response.written=89 vars.name="v2/584b2c41ed49687232cbee9642462502" vars.uuid=83d46525-9e35-42e8-beed-ebc300a73452
registry-1 | [ 8389.624490] registry[1156]: 172.19.0.2 - - [02/Jun/2024:15:52:21 +0000] "PUT /v2/v2/584b2c41ed49687232cbee9642462502/blobs/uploads/83d46525-9e35-42e8-beed-ebc300a73452?_state=0UcecddhMFdhDb5qzwY5OvEVsxYmpeOt50Mz8CVfd6N7Ik5hbWUiOiJ2Mi81ODRiMmM0MWVkNDk2ODcyMzJjYmVlOTY0MjQ2MjUwMiIsIlVVSUQiOiI4M2Q0NjUyNS05ZTM1LTQyZTgtYmVlZC1lYmMzMDBhNzM0NTIiLCJPZmZzZXQiOjAsIlN0YXJ0ZWRBdCI6IjIwMjQtMDYtMDJUMTU6NTI6MjAuOTkwNDE4NzY1WiJ9&digest=sha256%3Ab70cdb37098f86a1ccd1a09b3b94f2610ea0539ce08dfa5fabcc53dcb3bf76d2 HTTP/1.1" 500 89 "" "docker/25.0.3 go/go1.21.6 git-commit/f417435e5f6216828dec57958c490c4f8bae4f98 kernel/6.6.16-linuxkit os/linux arch/arm64 containerd-client/1.7.12+unknown storage-driver/overlayfs UpstreamClient(Go-http-client/1.1)"
registry-1 | [ 8426.610647] registry[1156]: 127.0.0.1 - - [02/Jun/2024:15:53:06 +0000] "HEAD / HTTP/1.1" 200 0 "" "curl/7.88.1"
registry-1 | [ 8471.713921] registry[1156]: 127.0.0.1 - - [02/Jun/2024:15:53:51 +0000] "HEAD / HTTP/1.1" 200 0 "" "curl/7.88.1"
registry-1 | [ 8516.818158] registry[1156]: 127.0.0.1 - - [02/Jun/2024:15:54:36 +0000] "HEAD / HTTP/1.1" 200 0 "" "curl/7.88.1"
And from the API container:
api-1 | [ 8787.011504] api[1944]: 2024-06-02T15:59:06.711Z ::ffff:172.19.0.14 s/vpn PATCH /v6/service_instance(2) 200 14.705ms -
api-1 | [ 8793.108286] api[1944]: 2024-06-02T15:59:12.808Z ::ffff:<balena cli remote IP> - POST /amplitude/2/httpapi 404 0.391ms -
api-1 | [ 8793.109479] api[1944]: 2024-06-02T15:59:12.810Z ::ffff:<balena cli remote IP> a/2 GET /actor/v1/whoami 200 10.043ms balena-sdk/19.4.0
api-1 | [ 8793.194718] api[1944]: 2024-06-02T15:59:12.895Z ::ffff:<balena cli remote IP> a/2 GET /v6/application?$filter=(is_directly_accessible_by__user/any(dau:1 eq 1)) and (app_name eq 'myApp')&$expand=application_type($select=name,slug,supports_multicontainer),is_for__device_type($select=slug;$expand=is_of__cpu_architecture($select=slug)) 200 8.412ms balena-sdk/19.4.0
api-1 | [ 8793.492386] api[1944]: 2024-06-02T15:59:13.193Z ::ffff:<balena cli remote IP> a/2 GET /v6/application(1) 200 9.593ms -
api-1 | [ 8793.495327] api[1944]: 2024-06-02T15:59:13.196Z ::ffff:<balena cli remote IP> a/2 GET /v6/user(2) 200 10.521ms -
api-1 | [ 8793.551711] api[1944]: 2024-06-02T15:59:13.252Z ::ffff:<balena cli remote IP> a/2 POST /v6/release 201 32.501ms -
api-1 | [ 8793.584547] api[1944]: 2024-06-02T15:59:13.285Z ::ffff:<balena cli remote IP> a/2 POST /v6/service 409 9.991ms -
api-1 | [ 8793.585102] api[1944]: 2024-06-02T15:59:13.285Z ::ffff:<balena cli remote IP> a/2 POST /v6/service 409 8.719ms -
api-1 | [ 8793.616551] api[1944]: 2024-06-02T15:59:13.317Z ::ffff:<balena cli remote IP> a/2 GET /v6/service?$filter=(application eq 1) and (service_name eq 'c1') 200 12.075ms -
api-1 | [ 8793.617763] api[1944]: 2024-06-02T15:59:13.318Z ::ffff:<balena cli remote IP> a/2 GET /v6/service?$filter=(application eq 1) and (service_name eq 'c2') 200 11.253ms -
api-1 | [ 8793.630324] api[1944]: 2024-06-02T15:59:13.331Z ::ffff:<balena cli remote IP> a/2 POST /v6/service 409 19.280ms -
api-1 | [ 8793.634056] api[1944]: 2024-06-02T15:59:13.334Z ::ffff:<balena cli remote IP> a/2 POST /v6/service 409 19.695ms -
api-1 | [ 8793.654088] api[1944]: 2024-06-02T15:59:13.354Z ::ffff:<balena cli remote IP> a/2 POST /v6/image 201 19.052ms -
api-1 | [ 8793.654592] api[1944]: 2024-06-02T15:59:13.355Z ::ffff:<balena cli remote IP> a/2 POST /v6/image 201 17.409ms -
api-1 | [ 8793.659526] api[1944]: 2024-06-02T15:59:13.360Z ::ffff:<balena cli remote IP> a/2 GET /v6/service?$filter=(application eq 1) and (service_name eq 'c3') 200 10.759ms -
api-1 | [ 8793.661044] api[1944]: 2024-06-02T15:59:13.361Z ::ffff:<balena cli remote IP> a/2 GET /v6/service?$filter=(application eq 1) and (service_name eq 'c4') 200 9.368ms -
api-1 | [ 8793.690378] api[1944]: 2024-06-02T15:59:13.391Z ::ffff:<balena cli remote IP> a/2 POST /v6/image__is_part_of__release 201 18.160ms -
api-1 | [ 8793.692601] api[1944]: 2024-06-02T15:59:13.393Z ::ffff:<balena cli remote IP> a/2 POST /v6/image__is_part_of__release 201 18.325ms -
api-1 | [ 8793.695509] api[1944]: 2024-06-02T15:59:13.396Z ::ffff:<balena cli remote IP> a/2 POST /v6/image 201 19.043ms -
api-1 | [ 8793.697653] api[1944]: 2024-06-02T15:59:13.398Z ::ffff:<balena cli remote IP> a/2 POST /v6/image 201 16.954ms -
api-1 | [ 8793.725721] api[1944]: 2024-06-02T15:59:13.426Z ::ffff:<balena cli remote IP> a/2 POST /v6/image__is_part_of__release 201 11.747ms -
api-1 | [ 8793.728490] api[1944]: 2024-06-02T15:59:13.429Z ::ffff:<balena cli remote IP> a/2 POST /v6/image__is_part_of__release 201 11.999ms -
api-1 | [ 8793.798563] api[1944]: 2024-06-02T15:59:13.499Z ::ffff:<balena cli remote IP> a/2 GET /v6/release?$select=id&$filter=(belongs_to__application eq 1) and (status eq 'success')&$expand=contains__image($select=image;$expand=image($select=is_stored_at__image_location))&$orderby=id desc&$top=1 200 9.514ms balena-sdk/19.4.0
api-1 | [ 8793.844902] api[1944]: 2024-06-02T15:59:13.545Z ::ffff:<balena cli remote IP> a/2 GET /auth/v1/token?service=registry2.balena.mydomain.com&scope[0]=repository:v2/3ea4e7b5a5e26adcb6fbdfb5f4b49dba:pull,push&scope[1]=repository:v2/bcc84c9210d3aef6e90f8a7b214720e7:pull,push&scope[2]=repository:v2/5906106bfd386107c75c18aadec699f7:pull,push&scope[3]=repository:v2/152bf15308714c462a8315a235bb9e38:pull,push 200 24.968ms balena-sdk/19.4.0
api-1 | [ 8797.032167] api[1944]: 2024-06-02T15:59:16.732Z ::ffff:172.19.0.14 s/vpn PATCH /v6/service_instance(2) 200 8.836ms -
api-1 | [ 8798.832894] api[1944]: 2024-06-02T15:59:18.532Z ::ffff:<balena cli remote IP> a/2 PATCH /v6/image(55) 200 16.844ms -
api-1 | [ 8798.833392] api[1944]: 2024-06-02T15:59:18.534Z ::ffff:<balena cli remote IP> a/2 PATCH /v6/image(54) 200 16.349ms -
api-1 | [ 8798.835266] api[1944]: 2024-06-02T15:59:18.536Z ::ffff:<balena cli remote IP> a/2 PATCH /v6/image(52) 200 15.866ms -
api-1 | [ 8798.836921] api[1944]: 2024-06-02T15:59:18.537Z ::ffff:<balena cli remote IP> a/2 PATCH /v6/image(53) 200 13.696ms -
api-1 | [ 8798.902696] api[1944]: 2024-06-02T15:59:18.603Z ::ffff:<balena cli remote IP> a/2 PATCH /v6/release(13) 200 24.857ms -
api-1 | [ 8807.051188] api[1944]: 2024-06-02T15:59:26.751Z ::ffff:172.19.0.14 s/vpn PATCH /v6/service_instance(2) 200 7.693ms -
api-1 | [ 8817.068182] api[1944]: 2024-06-02T15:59:36.768Z ::ffff:172.19.0.14 s/vpn PATCH /v6/service_instance(2) 200 10.639ms -
api-1 | [ 8827.086993] api[1944]: 2024-06-02T15:59:46.787Z ::ffff:172.19.0.14 s/vpn PATCH /v6/service_instance(2) 200 7.938ms -
api-1 | [ 8837.102269] api[1944]: 2024-06-02T15:59:56.802Z ::ffff:172.19.0.14 s/vpn PATCH /v6/service_instance(2) 200 8.015ms -
api-1 | [ 8840.304883] api[1944]: [Scheduler] Running job: contractSync
api-1 | [ 8842.870980] api[1944]: [Scheduler] Finished job: contractSync, next run at Sun Jun 02 2024 16:05:00 GMT+0000 (Coordinated Universal Time)
api-1 | [ 8844.286534] api[1944]: 2024-06-02T16:00:03.986Z ::ffff:<balena cli remote IP> - POST /amplitude/2/httpapi 404 0.810ms -
api-1 | [ 8844.300065] api[1944]: 2024-06-02T16:00:04.000Z ::ffff:<balena cli remote IP> a/2 GET /actor/v1/whoami 200 13.071ms balena-sdk/19.4.0
api-1 | [ 8844.378208] api[1944]: 2024-06-02T16:00:04.078Z ::ffff:<balena cli remote IP> a/2 GET /v6/application?$filter=(slug eq 'admin/myapp') or (uuid eq 'admin/myapp')&$select=id 200 6.266ms balena-sdk/19.4.0
api-1 | [ 8844.442529] api[1944]: 2024-06-02T16:00:04.143Z ::ffff:<balena cli remote IP> a/2 GET /v6/release?$filter=belongs_to__application eq 1&$orderby=created_at desc&$select=id,commit,created_at,status,semver,is_final 200 8.083ms balena-sdk/19.4.0
api-1 | [ 8847.122735] api[1944]: 2024-06-02T16:00:06.823Z ::ffff:172.19.0.14 s/vpn PATCH /v6/service_instance(2) 200 10.082ms -
I hope this helps, looking forward to your replies!
from open-balena.
ab77
commented on July 22, 2024
@pankalog any chance you are running openBalena on an ARM64 machine? We've only tested it on AMD64 at this stage..
Does pushing a simple hello-world Dockerfile work?
from open-balena.
pankalog
commented on July 22, 2024
@ab77 hey, thanks for the quick response!
openBalena is running on x86 Ubuntu 24.04 LTS, here's the uname -a: Linux openbalena-test 6.8.0-31-generic #31-Ubuntu SMP PREEMPT_DYNAMIC Sat Apr 20 00:40:06 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
I tried pushing the example Dockerfile in the getting started guide and a simple helloworld Dockerfile, and both had the same issue.
Please let me know if there's anything I can help with.
Thank you!
from open-balena.
ab77
commented on July 22, 2024
you are using balena deploy .., try balena push ...; (for .. deploy to work, you would have had to run balena build .. previously.
from open-balena.
pankalog
commented on July 22, 2024
@ab77 thanks for the reply,
same exact error when doing build first and then deploy, and when i use balena push, I get the error
Connecting to builder at https://builder.balena.mydomain.com/v3/build?slug=admin%2Fmyapp&dockerfilePath=&emulated=false&nocache=false&headless=false&isdraft=false Remote builder responded with HTTP error: 404 Not Found, which I think makes sense?
let me know if I can help. Thanks!
from open-balena.
ab77
commented on July 22, 2024
@ab77 thanks for the reply,
same exact error when doing build first and then deploy, and when i use balena push, I get the error
Connecting to builder at https://builder.balena.mydomain.com/v3/build?slug=admin%2Fmyapp&dockerfilePath=&emulated=false&nocache=false&headless=false&isdraft=false Remote builder responded with HTTP error: 404 Not Found, which I think makes sense?let me know if I can help. Thanks!
Yes, apologies, balena push ... requires a builder configured, which isn't the case in openBalena.
What output do you get when you run balena build ... ?
from open-balena.
pankalog
commented on July 22, 2024
@ab77 it works, no issues
-> % balena build --noparent-check -f --debug myApp
[debug] new argv=[/usr/local/lib/balena-cli/bin/node,/usr/local/lib/balena-cli/bin/run,build,--noparent-check,-f,myApp] length=6
[debug] Deprecation check: 1.06367 days since last npm registry query for next major version release date.
[debug] Will not query the registry again until at least 7 days have passed.
[debug] Event tracking error: Timeout awaiting 'response' for 0ms
[Debug] Parsing input...
[Debug] Loading project...
[Debug] Resolving project...
[Info] No "docker-compose.yml" file found at "/Users/user/GitRepos/tests/open-balena"
[Info] Creating default composition with source: "/Users/user/GitRepos/tests/open-balena"
[Debug] Creating project...
[Build] Building services...
[Build] main Preparing...
[Info] Building for aarch64/raspberrypi5
[Info] Docker Desktop detected (daemon architecture: "aarch64")
[Info] Docker itself will determine and enable architecture emulation if required,
[Info] without balena-cli intervention and regardless of the --emulated option.
[Debug] Found build tasks:
[Debug] main: build [.]
[Debug] Resolving services with [raspberrypi5|aarch64]
[Debug] Found project types:
[Debug] main: Standard Dockerfile
[Debug] Prepared tasks; building...
[Build] main Step 1/2 : FROM balenalib/raspberrypi5-alpine
[Build] main ---> 61454e845430
[Build] main Step 2/2 : CMD [ "echo hello" ]
[Build] main ---> Using cache
[Build] main ---> 3845f1c22c75
[Build] main Successfully built 3845f1c22c75
[Build] main Successfully tagged open-balena_main:latest
[Build] main Image size: 17.10 MB
[Build] Built 1 service in 0:01
[Success] Build succeeded!```
from open-balena.
dfunckt
commented on July 22, 2024
The build command doesn’t do any requests to your open balena instance.
What is your setup? You say it’s Linux but the output above says you’re using Docker Desktop on an Arm Mac.
from open-balena.
pankalog
commented on July 22, 2024
Hello @dfunckt,
I am running openBalena in an x86 Ubuntu 24.04 LTS machine, and I am running balena-cli locally on my macos machine. Is this not something that I'm supposed to do?
Thanks for your reply!
from open-balena.
ab77
commented on July 22, 2024
it works with the latest master (from macOS):
$ balena deploy --noparent-check --debug raspberrypi5 --build --source .
[debug] new argv=[/usr/local/lib/balena-cli/bin/node,/usr/local/lib/balena-cli/bin/run,deploy,--noparent-check,raspberry
pi5,--build,--source,.] length=8
...
[Debug] Parsing input...
[Debug] Loading project...
[Debug] Resolving project...
[Info] No "docker-compose.yml" file found at "/tmp"
[Info] Creating default composition with source: "/tmp"
[Debug] Creating project...
[Build] Building services...
[Build] main Preparing...
[Info] Building for aarch64/raspberrypi5
[Info] Docker Desktop detected (daemon architecture: "aarch64")
[Info] Docker itself will determine and enable architecture emulation if required,
[Info] without balena-cli intervention and regardless of the --emulated option.
[Debug] Found build tasks:
[Debug] main: build [.]
[Debug] Resolving services with [raspberrypi5|aarch64]
[Debug] Found project types:
[Debug] main: Standard Dockerfile
[Debug] Prepared tasks; building...
[Build] main Step 1/2 : FROM balenalib/raspberrypi5-alpine
[Build] main ---> 9f388d012695
[Build] main Step 2/2 : CMD [ "echo hello" ]
[Build] main ---> Using cache
[Build] main ---> f1bd5a996719
[Build] main Successfully built f1bd5a996719
[Build] main Successfully tagged temp_main:latest
[Build] main Image size: 47.59 MB
[Build] Built 1 service in 0:02
[Info] Creating release...
[Debug] Tagging images...
[Debug] Authorizing push...
[Debug] Requesting access to previously pushed image repo (v2/6401d74e07ff7736e7571e3ca1babbf8)
[Info] Pushing images to registry...
[Debug] Saving image registry2.ab77.foo-bar.com/v2/7043be28e6f1c596436b11d15b97bd2a
[Debug] Untagging images...
[Info] Saving release...
[Success] Deploy succeeded!
[Success] Release: 2941b1024ab587ad6e32650c01937178
from open-balena.
pankalog
commented on July 22, 2024
@ab77 I just installed the latest balena-cli version (18.2.2), checked with balena -v, then ran balena build and balena deploy, and I am still getting the same error:
-> % balena deploy admin/myApp --noparent-check --build --debug
[debug] new argv=[/usr/local/lib/balena-cli/bin/node,/usr/local/lib/balena-cli/bin/run,deploy,admin/myApp,--noparent-check,--build] length=6
[debug] Deprecation check: 1.08380 days since last npm registry query for next major version release date.
[debug] Will not query the registry again until at least 7 days have passed.
[debug] Event tracking error: Timeout awaiting 'response' for 0ms
[Debug] Parsing input...
[Debug] Loading project...
[Debug] Resolving project...
[Info] No "docker-compose.yml" file found at "/Users/user/GitRepos/balena-test/open-balena"
[Info] Creating default composition with source: "/Users/user/GitRepos/balena-test/open-balena"
[Debug] Creating project...
[Build] Building services...
[Build] main Preparing...
[Info] Building for aarch64/raspberrypi5
[Info] Docker Desktop detected (daemon architecture: "aarch64")
[Info] Docker itself will determine and enable architecture emulation if required,
[Info] without balena-cli intervention and regardless of the --emulated option.
[Debug] Found build tasks:
[Debug] main: build [.]
[Debug] Resolving services with [raspberrypi5|aarch64]
[Debug] Found project types:
[Debug] main: Standard Dockerfile
[Debug] Prepared tasks; building...
[Build] main Step 1/2 : FROM balenalib/raspberrypi5-alpine
[Build] main ---> 61454e845430
[Build] main Step 2/2 : CMD [ "echo hello" ]
[Build] main ---> Using cache
[Build] main ---> e0557f6ae674
[Build] main Successfully built e0557f6ae674
[Build] main Successfully tagged open-balena_main:latest
[Build] main Image size: 17.10 MB
[Build] Built 1 service in 0:01
[Info] Creating release...
[Debug] Tagging images...
[Debug] Authorizing push...
[Info] Pushing images to registry...
[Debug] Saving image registry2.balena.tafftune.dev/v2/75c835b220ea54c93c3c274daf7813ff
[Debug] Untagging images...
[Info] Saving release...
[Error] Deploy failed
Unable to extract image digest (content hash) from image upload progress stream for image:
registry2.balena.tafftune.dev/v2/75c835b220ea54c93c3c274daf7813ff:latest
ExpectedError: Unable to extract image digest (content hash) from image upload progress stream for image:
registry2.balena.tafftune.dev/v2/75c835b220ea54c93c3c274daf7813ff:latest
at pushImage (/usr/local/lib/balena-cli/build/utils/compose_ts.js:696:23)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async Promise.all (index 1)
at async inspectAndPushImage (/usr/local/lib/balena-cli/build/utils/compose_ts.js:708:42)
at async Promise.all (index 0)
at async pushAndUpdateServiceImages (/usr/local/lib/balena-cli/build/utils/compose_ts.js:737:9)
at async pushServiceImages (/usr/local/lib/balena-cli/build/utils/compose_ts.js:746:5)
at async /usr/local/lib/balena-cli/build/utils/compose_ts.js:776:17
at async awaitInterruptibleTask (/usr/local/lib/balena-cli/build/utils/helpers.js:281:16)
at async deployProject (/usr/local/lib/balena-cli/build/utils/compose_ts.js:774:13)
at async DeployCmd.deployProject (/usr/local/lib/balena-cli/build/commands/deploy/index.js:151:27)
at async DeployCmd.run (/usr/local/lib/balena-cli/build/commands/deploy/index.js:50:25)
at async DeployCmd._run (/usr/local/lib/balena-cli/node_modules/@oclif/core/lib/command.js:311:22)
at async Config.runCommand (/usr/local/lib/balena-cli/node_modules/@oclif/core/lib/config/config.js:433:25)
at async run (/usr/local/lib/balena-cli/node_modules/@oclif/core/lib/main.js:92:16)
at async /usr/local/lib/balena-cli/build/app.js:80:13
from open-balena.
pankalog
commented on July 22, 2024
I'm not really sure this helps, but for some reason there is a specific release that is listed as running since yesterday:
-> % balena releases admin/myapp
ID COMMIT CREATED AT STATUS SEMVER IS FINAL
24 e067171861e5e6ffa38297f39b6a2549 2024-06-03T15:46:36.250Z failed 0.0.0 true
23 fb117e64087e0d642656c2578c244502 2024-06-03T15:46:12.290Z failed 0.0.0 true
22 920c4697ba6ed24ce969b922b1561f1d 2024-06-03T15:44:52.759Z failed 0.0.0 true
21 77a336c491ea6cbd665960142f44e237 2024-06-03T15:43:20.091Z failed 0.0.0 true
20 35db710c23f1e7221ebd38a144d2fb20 2024-06-03T15:09:52.411Z failed 0.0.0 true
19 330529105f4055fb98241e99c2699a9e 2024-06-03T15:03:26.526Z failed 0.0.0 true
18 e63ce873d1436122281dd697b0ca2235 2024-06-03T15:02:41.090Z failed 0.0.0 true
17 f7a77333bb478e798567a5dfb40c0426 2024-06-03T15:01:48.980Z failed 0.0.0 true
16 36772e02721c08ac6d9ea4d9e3a4566f 2024-06-03T09:05:32.963Z failed 0.0.0 true
15 4fecf8aac05d5034ea8bc3c51bbb3abc 2024-06-03T09:03:24.395Z failed 0.0.0 true
14 bc61ad69dd54a9ef518ab9602a63efa2 2024-06-02T16:08:08.082Z failed 0.0.0 true
13 dfad84bd74759040150c9a348efe691d 2024-06-02T15:59:13.225Z failed 0.0.0 true
12 a86054cc3e57f9fea81e94c9b237664a 2024-06-02T15:53:56.570Z failed 0.0.0 true
11 6103b2e26d484462ae09d11f050b0e59 2024-06-02T15:52:20.356Z failed 0.0.0 true
10 a1c38854e5d6aead347830ff7daaf57f 2024-06-02T15:48:52.019Z failed 0.0.0 true
9 23787b9d1db57635c9a0c663190a8a19 2024-06-02T15:38:37.539Z failed 0.0.0 true
8 297c1776a802a4d787ae0795401a0e0e 2024-06-02T15:34:15.132Z failed 0.0.0 true
7 eefe41a192824f1c67220cdce0898953 2024-06-02T15:33:23.680Z failed 0.0.0 true
6 c59379d90640919fa4767084c0f71097 2024-06-02T15:25:13.564Z failed 0.0.0 true
5 8451246175d396c44164086450c0db56 2024-06-02T15:24:19.252Z failed 0.0.0 true
4 1f9f3f1a9a18d50ab2d44c63236c6894 2024-06-02T15:24:16.844Z running 0.0.0 true
3 34fbe99f088e9788e4c5bfb77031a05c 2024-06-02T15:14:43.292Z failed 0.0.0 true
2 8d71397e42a8424baf2af6312ac07f44 2024-06-02T15:10:57.098Z failed 0.0.0 true
1 0035ef19ca1155d76af3c303a73dd318 2024-06-02T15:09:33.454Z failed 0.0.0 true
from open-balena.
dfunckt
commented on July 22, 2024
What docker version are you using? The error suggests some incompatibility between docker and the cli trying to extract image information (its digest) from the build stream.
from open-balena.
pankalog
commented on July 22, 2024
What docker version are you using? The error suggests some incompatibility between docker and the cli trying to extract image information (its digest) from the build stream.
-> % docker -v
Docker version 25.0.3, build 4debf41
Is this outdated? I can update to latest and try again
from open-balena.
pankalog
commented on July 22, 2024
Better output of all versions:
Client:
Version: 25.0.3
Context: desktop-linux
Debug Mode: false
Plugins:
buildx: Docker Buildx (Docker Inc.)
Version: v0.12.1-desktop.4
Path: /Users/user/.docker/cli-plugins/docker-buildx
compose: Docker Compose (Docker Inc.)
Version: v2.24.6-desktop.1
Path: /Users/user/.docker/cli-plugins/docker-compose
debug: Get a shell into any image or container. (Docker Inc.)
Version: 0.0.24
Path: /Users/user/.docker/cli-plugins/docker-debug
dev: Docker Dev Environments (Docker Inc.)
Version: v0.1.0
Path: /Users/user/.docker/cli-plugins/docker-dev
extension: Manages Docker extensions (Docker Inc.)
Version: v0.2.22
Path: /Users/user/.docker/cli-plugins/docker-extension
feedback: Provide feedback, right in your terminal! (Docker Inc.)
Version: v1.0.4
Path: /Users/user/.docker/cli-plugins/docker-feedback
init: Creates Docker-related starter files for your project (Docker Inc.)
Version: v1.0.1
Path: /Users/user/.docker/cli-plugins/docker-init
sbom: View the packaged-based Software Bill Of Materials (SBOM) for an image (Anchore Inc.)
Version: 0.6.0
Path: /Users/user/.docker/cli-plugins/docker-sbom
scout: Docker Scout (Docker Inc.)
Version: v1.5.0
Path: /Users/user/.docker/cli-plugins/docker-scout
from open-balena.
dfunckt
commented on July 22, 2024
I don't think our stuff is compatible with buildx (but could be wrong) and if so, I think that's your issue. Try disabling buildx and see if that helps.
from open-balena.
pankalog
commented on July 22, 2024
@dfunckt I'm not sure exactly what the underlying issue is with my Macbook, but I used a device (a rpi5) running balenaOS to do balena deploy using the --dockerHost and --dockerPort parameters:
DOCKER_BUILDKIT=0 balena deploy admin/myApp --noparent-check --build --debug -h 192.168.1.114 -p 2375
And this seems to do the trick! Release was pushed. I wasn't aware of this functionality (being able to use a BalenaOS device for building releases) but this is great! Thank you! Note to self, RTFM...
Thing is, I also tried to disable buildx locally, but I am guessing it didn't exactly work... I'll definitely note it down for future reference.
Ευχαριστώ πολύ!
from open-balena.
ab77
commented on July 22, 2024
Resolved.
from open-balena.
Related Issues (20)
- balena API endpoints for post requests not working HOT 6
- 503 - Service Unavailable HOT 5
- Failed to get device type build data for... HOT 2
- Up to date version of open-balena api requires API_HOST, not HOST env var HOT 1
- device is online=false HOT 1
- deploy multi docker-compose file without replace services HOT 1
- Restricted API keys HOT 2
- I can't connect to device - balena ssh <uuid device> - Host <UUID> not found: 2(SERVFAIL) HOT 1
- Ansible playbook to deploy open balena server and admin dashboard
- haproxy:2.9-alpine can not build HOT 3
- DBUS: Communication with NetworkManager not possible anymore from docker container application HOT 1
- make auto-pki Command Takes Excessively Long Time to Complete HOT 3
- configure and connect minio buckets HOT 1
- API service responds with error 520 and constant AccessDenied error in the logs HOT 8
- 'make up' not working HOT 4
- Steps to Change Domain in OpenBalena v3.8.2 and v4.0.13 HOT 7
- What's new in version 4.x? HOT 6
- OpenVPN Issue with "Bad encapsulated packet length from peer" HOT 1
- `make auto-pki` command waits forever HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from open-balena.