Comments (4)
ningmingxiao
commented on May 28, 2024
1
If I can reproduce stablely I will reopen this issue.
from containerd.
ningmingxiao
commented on May 28, 2024
from containerd.
laurazard
commented on May 28, 2024
Oh no :'( I'll look into it. I definitely can't replicate it on main, but maybe the backport to 1.6.31 missed something.
Edit: I can't replicate on my machine. Do you have some logs?
Screen.Recording.2024-04-10.at.10.19.07.mov
from containerd.
ningmingxiao
commented on May 28, 2024
Oh no :'( I'll look into it. I definitely can't replicate it on
main, but maybe the backport to 1.6.31 missed something.Edit: I can't replicate on my machine. Do you have some logs?
Screen.Recording.2024-04-10.at.10.19.07.mov
I can't reproduce now .it is shim-v2 stack when exec hang. It is odd
time="2024-04-10T16:35:44.855983497+08:00" level=info msg="=== BEGIN goroutine stack dump ===
goroutine 21 [running]:
github.com/containerd/containerd/runtime/v2/shim.dumpStacks(0x0?)
/root/go/src/github.com/containerd/containerd/runtime/v2/shim/shim.go:515 +0x4f
github.com/containerd/containerd/runtime/v2/shim.serve.func2()
/root/go/src/github.com/containerd/containerd/runtime/v2/shim/shim.go:499 +0x38
created by github.com/containerd/containerd/runtime/v2/shim.serve in goroutine 1
/root/go/src/github.com/containerd/containerd/runtime/v2/shim/shim.go:497 +0x3b8
goroutine 1 [select, 1 minutes]:
github.com/containerd/containerd/runtime/v2/shim.reap({0xa3b228, 0xc00007c1e0}, 0x9867ce?, 0xc0000b1620)
/root/go/src/github.com/containerd/containerd/runtime/v2/shim/shim_unix.go:78 +0xf8
github.com/containerd/containerd/runtime/v2/shim.serve({0xa3b228?, 0xc00007c1e0}, 0xc0001e4060, 0x8c12a0?, 0xc0000a2ac8)
/root/go/src/github.com/containerd/containerd/runtime/v2/shim/shim.go:504 +0x44b
github.com/containerd/containerd/runtime/v2/shim.run({0xa3b228, 0xc000155d10}, {0xa38d90, 0xc0000975c0}, 0x0, {0x0, 0x0}, {0x0, 0x0, 0x0})
/root/go/src/github.com/containerd/containerd/runtime/v2/shim/shim.go:450 +0x1e2f
github.com/containerd/containerd/runtime/v2/shim.RunManager({0xa3b1f0, 0xddd520}, {0xa38d90, 0xc0000975c0}, {0x0, 0x0, 0xc0000061a0?})
/root/go/src/github.com/containerd/containerd/runtime/v2/shim/shim.go:241 +0x1dd
main.main()
/root/go/src/github.com/containerd/containerd/cmd/containerd-shim-runc-v2/main.go:31 +0x51
goroutine 18 [chan receive]:
github.com/containerd/containerd/runtime/v2/shim.setRuntime.func1()
/root/go/src/github.com/containerd/containerd/runtime/v2/shim/shim.go:158 +0x5a
created by github.com/containerd/containerd/runtime/v2/shim.setRuntime in goroutine 1
/root/go/src/github.com/containerd/containerd/runtime/v2/shim/shim.go:157 +0x25
goroutine 5 [syscall]:
os/signal.signal_recv()
/usr/local/go/src/runtime/sigqueue.go:152 +0x29
os/signal.loop()
/usr/local/go/src/os/signal/signal_unix.go:23 +0x13
created by os/signal.Notify.func1.1 in goroutine 1
/usr/local/go/src/os/signal/signal.go:151 +0x1f
goroutine 6 [chan receive, 1 minutes]:
github.com/containerd/containerd/runtime/v2/shim.(*RemoteEventsPublisher).processQueue(0xc00007c030)
/root/go/src/github.com/containerd/containerd/runtime/v2/shim/publisher.go:84 +0x45
created by github.com/containerd/containerd/runtime/v2/shim.NewPublisher in goroutine 1
/root/go/src/github.com/containerd/containerd/runtime/v2/shim/publisher.go:57 +0x15b
goroutine 20 [IO wait, 1 minutes]:
internal/poll.runtime_pollWait(0x7fb28c852d30, 0x72)
/usr/local/go/src/runtime/netpoll.go:343 +0x85
internal/poll.(*pollDesc).wait(0xc00031a080?, 0x1005b33b2?, 0x0)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc00031a080)
/usr/local/go/src/internal/poll/fd_unix.go:611 +0x2ac
net.(*netFD).accept(0xc00031a080)
/usr/local/go/src/net/fd_unix.go:172 +0x29
net.(*UnixListener).accept(0x444200?)
/usr/local/go/src/net/unixsock_posix.go:172 +0x16
net.(*UnixListener).Accept(0xc000320000)
/usr/local/go/src/net/unixsock.go:260 +0x30
github.com/containerd/ttrpc.(*Server).Serve(0xc0001e4060, {0xa3b228?, 0xc00007c1e0}, {0xa38df0?, 0xc000320000})
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/ttrpc/server.go:88 +0x124
github.com/containerd/containerd/runtime/v2/shim.serve.func1()
/root/go/src/github.com/containerd/containerd/runtime/v2/shim/shim.go:487 +0x9a
created by github.com/containerd/containerd/runtime/v2/shim.serve in goroutine 1
/root/go/src/github.com/containerd/containerd/runtime/v2/shim/shim.go:485 +0x167
goroutine 9 [syscall, 1 minutes]:
syscall.Syscall6(0x40fd1e?, 0x195?, 0x7f?, 0x984f29?, 0x0?, 0xc00009e8d8?, 0x195?)
/usr/local/go/src/syscall/syscall_linux.go:91 +0x30
golang.org/x/sys/unix.EpollWait(0x1b00?, {0xc00009e990?, 0xc00009e940?, 0xc00009e9d0?}, 0x70bf17?)
/root/go/src/github.com/containerd/containerd/vendor/golang.org/x/sys/unix/zsyscall_linux_amd64.go:55 +0x4f
github.com/containerd/containerd/pkg/oom/v1.(*epoller).Run(0xc00007c4b0, {0xa3b228, 0xc00007c1e0})
/root/go/src/github.com/containerd/containerd/pkg/oom/v1/v1.go:78 +0x8d
created by github.com/containerd/containerd/runtime/v2/runc/task.NewTaskService in goroutine 1
/root/go/src/github.com/containerd/containerd/runtime/v2/runc/task/service.go:73 +0x1b2
goroutine 10 [chan receive, 1 minutes]:
github.com/containerd/containerd/runtime/v2/runc/task.(*service).processExits(0xc000022280)
/root/go/src/github.com/containerd/containerd/runtime/v2/runc/task/service.go:661 +0x66
created by github.com/containerd/containerd/runtime/v2/runc/task.NewTaskService in goroutine 1
/root/go/src/github.com/containerd/containerd/runtime/v2/runc/task/service.go:85 +0x358
goroutine 11 [syscall, 1 minutes]:
syscall.Syscall6(0x0?, 0x0?, 0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/syscall/syscall_linux.go:91 +0x30
golang.org/x/sys/unix.EpollWait(0x0?, {0xc00009a9b0?, 0x0?, 0x0?}, 0x0?)
/root/go/src/github.com/containerd/containerd/vendor/golang.org/x/sys/unix/zsyscall_linux_amd64.go:55 +0x4f
github.com/containerd/console.(*Epoller).Wait(0xc00007c600)
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/console/console_linux.go:111 +0x5d
created by github.com/containerd/containerd/runtime/v2/runc.NewPlatform in goroutine 1
/root/go/src/github.com/containerd/containerd/runtime/v2/runc/platform.go:54 +0xa5
goroutine 12 [chan receive, 1 minutes]:
github.com/containerd/containerd/runtime/v2/runc/task.(*service).forward(0xc000022280, {0xa3b228?, 0xc00007c1e0?}, {0xa382f8, 0xc00007c030})
/root/go/src/github.com/containerd/containerd/runtime/v2/runc/task/service.go:748 +0x9a
created by github.com/containerd/containerd/runtime/v2/runc/task.NewTaskService in goroutine 1
/root/go/src/github.com/containerd/containerd/runtime/v2/runc/task/service.go:90 +0x499
goroutine 22 [select, 1 minutes]:
github.com/containerd/containerd/runtime/v2/shim.handleExitSignals({0xa3b228, 0xc00007c1e0}, 0xa3b228?, 0xc0000a2ac8)
/root/go/src/github.com/containerd/containerd/runtime/v2/shim/shim_unix.go:100 +0x114
created by github.com/containerd/containerd/runtime/v2/shim.serve in goroutine 1
/root/go/src/github.com/containerd/containerd/runtime/v2/shim/shim.go:503 +0x42f
goroutine 35 [select, 1 minutes]:
github.com/containerd/ttrpc.(*serverConn).run(0xc00007a050, {0xa3b228, 0xc00007c1e0})
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/ttrpc/server.go:432 +0x51b
created by github.com/containerd/ttrpc.(*Server).Serve in goroutine 20
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/ttrpc/server.go:128 +0x25b
goroutine 36 [select, 1 minutes]:
context.(*cancelCtx).propagateCancel.func2()
/usr/local/go/src/context/context.go:505 +0x98
created by context.(*cancelCtx).propagateCancel in goroutine 35
/usr/local/go/src/context/context.go:504 +0x395
goroutine 37 [IO wait, 1 minutes]:
internal/poll.runtime_pollWait(0x7fb28c852c38, 0x72)
/usr/local/go/src/runtime/netpoll.go:343 +0x85
internal/poll.(*pollDesc).wait(0xc0000b4900?, 0xc00022e000?, 0x0)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc0000b4900, {0xc00022e000, 0x1000, 0x1000})
/usr/local/go/src/internal/poll/fd_unix.go:164 +0x27a
net.(*netFD).Read(0xc0000b4900, {0xc00022e000?, 0x0?, 0xc000123d00?})
/usr/local/go/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc000206010, {0xc00022e000?, 0xc000123d48?, 0x4091f3?})
/usr/local/go/src/net/net.go:179 +0x45
bufio.(*Reader).Read(0xc0000703c0, {0xc0000b21e0, 0xa, 0xc000123ed4?})
/usr/local/go/src/bufio/bufio.go:244 +0x197
io.ReadAtLeast({0xa372a0, 0xc0000703c0}, {0xc0000b21e0, 0xa, 0xa}, 0xa)
/usr/local/go/src/io/io.go:335 +0x90
io.ReadFull(...)
/usr/local/go/src/io/io.go:354
github.com/containerd/ttrpc.readMessageHeader({0xc0000b21e0, 0xa, 0x18?}, {0xa372a0?, 0xc0000703c0?})
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/ttrpc/channel.go:53 +0x4f
github.com/containerd/ttrpc.(*channel).recv(0xc0000b21c0)
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/ttrpc/channel.go:101 +0x45
github.com/containerd/ttrpc.(*serverConn).run.func1(0xc000070480)
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/ttrpc/server.go:363 +0x13b
created by github.com/containerd/ttrpc.(*serverConn).run in goroutine 35
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/ttrpc/server.go:333 +0x336
goroutine 24 [select, 1 minutes]:
github.com/containerd/ttrpc.(*Client).run(0xc000022880)
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/ttrpc/client.go:330 +0x1ee
created by github.com/containerd/ttrpc.NewClient in goroutine 12
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/ttrpc/client.go:94 +0x1d6
goroutine 1079 [chan receive, 1 minutes]:
github.com/containerd/containerd/pkg/process.(*execProcess).Wait(0xc000022280?)
/root/go/src/github.com/containerd/containerd/pkg/process/exec.go:65 +0x1c
github.com/containerd/containerd/runtime/v2/runc/task.(*service).Wait(0x95a080?, {0xc00022a2c0?, 0x7fb2d33df108?}, 0xc00022a2c0)
/root/go/src/github.com/containerd/containerd/runtime/v2/runc/task/service.go:589 +0x62
github.com/containerd/containerd/runtime/v2/task.RegisterTaskService.func14({0xa3b228, 0xc00022c4b0}, 0xc000228440)
/root/go/src/github.com/containerd/containerd/runtime/v2/task/shim.pb.go:3547 +0x8f
github.com/containerd/ttrpc.defaultServerInterceptor({0xa3b228?, 0xc00022c4b0?}, 0x17?, 0xc0000c6640?, 0x4?)
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/ttrpc/interceptor.go:45 +0x22
github.com/containerd/ttrpc.(*serviceSet).dispatch(0xc0000976b0, {0xa3b228, 0xc00022c4b0}, {0xc00002c4c8, 0x17}, {0xc00021a8e8, 0x4}, {0xc00002c4e0, 0x13, 0x18})
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/ttrpc/services.go:95 +0x1bf
github.com/containerd/ttrpc.(*serviceSet).call(0x1?, {0xa3b228?, 0xc00022c4b0?}, {0xc00002c4c8?, 0x1012b5708?}, {0xc00021a8e8?, 0x7a7385?}, {0xc00002c4e0, 0x13, 0x18})
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/ttrpc/services.go:64 +0x65
github.com/containerd/ttrpc.(*serverConn).run.func2(0x36f)
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/ttrpc/server.go:439 +0xd1
created by github.com/containerd/ttrpc.(*serverConn).run in goroutine 35
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/ttrpc/server.go:435 +0x669
goroutine 69 [IO wait, 1 minutes]:
internal/poll.runtime_pollWait(0x7fb28c852950, 0x72)
/usr/local/go/src/runtime/netpoll.go:343 +0x85
internal/poll.(*pollDesc).wait(0xc0000709c0?, 0xc000000000?, 0x1)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc0000709c0, {0xc000000000, 0x1000, 0x1000})
/usr/local/go/src/internal/poll/fd_unix.go:164 +0x27a
os.(*File).read(...)
/usr/local/go/src/os/file_posix.go:29
os.(*File).Read(0xc0002060b8, {0xc000000000?, 0xc0000b03c0?, 0xc000000000?})
/usr/local/go/src/os/file.go:118 +0x52
io.copyBuffer({0x7fb28c7ca008, 0xc0000b03c0}, {0xa36c80, 0xc0002060b8}, {0xc000000000, 0x1000, 0x1000})
/usr/local/go/src/io/io.go:430 +0x1a6
io.CopyBuffer({0x7fb28c7ca008?, 0xc0000b03c0?}, {0xa36c80?, 0xc0002060b8?}, {0xc000000000?, 0x0?, 0x0?})
/usr/local/go/src/io/io.go:403 +0x36
github.com/containerd/containerd/pkg/process.copyPipes.func1.1()
/root/go/src/github.com/containerd/containerd/pkg/process/io.go:150 +0x185
created by github.com/containerd/containerd/pkg/process.copyPipes.func1 in goroutine 38
/root/go/src/github.com/containerd/containerd/pkg/process/io.go:146 +0x17c
goroutine 26 [IO wait, 1 minutes]:
internal/poll.runtime_pollWait(0x7fb28c852288, 0x72)
/usr/local/go/src/runtime/netpoll.go:343 +0x85
internal/poll.(*pollDesc).wait(0xc000022680?, 0xc0001fc000?, 0x0)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000022680, {0xc0001fc000, 0x1000, 0x1000})
/usr/local/go/src/internal/poll/fd_unix.go:164 +0x27a
net.(*netFD).Read(0xc000022680, {0xc0001fc000?, 0xc0000a44e0?, 0x410485?})
/usr/local/go/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc0000540c0, {0xc0001fc000?, 0x410485?, 0xc000010120?})
/usr/local/go/src/net/net.go:179 +0x45
bufio.(*Reader).Read(0xc000200cc0, {0xc00022a720, 0xa, 0x4090be?})
/usr/local/go/src/bufio/bufio.go:244 +0x197
io.ReadAtLeast({0xa372a0, 0xc000200cc0}, {0xc00022a720, 0xa, 0xa}, 0xa)
/usr/local/go/src/io/io.go:335 +0x90
io.ReadFull(...)
/usr/local/go/src/io/io.go:354
github.com/containerd/ttrpc.readMessageHeader({0xc00022a720, 0xa, 0xc00009be80?}, {0xa372a0?, 0xc000200cc0?})
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/ttrpc/channel.go:53 +0x4f
github.com/containerd/ttrpc.(*channel).recv(0xc00022a700)
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/ttrpc/channel.go:101 +0x45
github.com/containerd/ttrpc.(*Client).run.func2()
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/ttrpc/client.go:294 +0xb5
created by github.com/containerd/ttrpc.(*Client).run in goroutine 24
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/ttrpc/client.go:286 +0x15f
goroutine 25 [select, 1 minutes]:
github.com/containerd/ttrpc.(*Client).run.func1()
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/ttrpc/client.go:265 +0xb6
created by github.com/containerd/ttrpc.(*Client).run in goroutine 24
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/ttrpc/client.go:262 +0xf7
goroutine 74 [IO wait, 1 minutes]:
internal/poll.runtime_pollWait(0x7fb28c852760, 0x72)
/usr/local/go/src/runtime/netpoll.go:343 +0x85
internal/poll.(*pollDesc).wait(0xc000070a80?, 0xc000001000?, 0x1)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000070a80, {0xc000001000, 0x1000, 0x1000})
/usr/local/go/src/internal/poll/fd_unix.go:164 +0x27a
os.(*File).read(...)
/usr/local/go/src/os/file_posix.go:29
os.(*File).Read(0xc0002060c8, {0xc000001000?, 0xc0000b0660?, 0xc000001000?})
/usr/local/go/src/os/file.go:118 +0x52
io.copyBuffer({0x7fb28c7ca008, 0xc0000b0660}, {0xa36c80, 0xc0002060c8}, {0xc000001000, 0x1000, 0x1000})
/usr/local/go/src/io/io.go:430 +0x1a6
io.CopyBuffer({0x7fb28c7ca008?, 0xc0000b0660?}, {0xa36c80?, 0xc0002060c8?}, {0xc000001000?, 0x0?, 0x0?})
/usr/local/go/src/io/io.go:403 +0x36
github.com/containerd/containerd/pkg/process.copyPipes.func2.1()
/root/go/src/github.com/containerd/containerd/pkg/process/io.go:169 +0x185
created by github.com/containerd/containerd/pkg/process.copyPipes.func2 in goroutine 38
/root/go/src/github.com/containerd/containerd/pkg/process/io.go:165 +0x17c
goroutine 77 [IO wait, 1 minutes]:
internal/poll.runtime_pollWait(0x7fb28c852380, 0x72)
/usr/local/go/src/runtime/netpoll.go:343 +0x85
internal/poll.(*pollDesc).wait(0xc0003001e0?, 0xc0002c2000?, 0x1)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc0003001e0, {0xc0002c2000, 0x8000, 0x8000})
/usr/local/go/src/internal/poll/fd_unix.go:164 +0x27a
os.(*File).read(...)
/usr/local/go/src/os/file_posix.go:29
os.(*File).Read(0xc000318008, {0xc0002c2000?, 0x8000?, 0x0?})
/usr/local/go/src/os/file.go:118 +0x52
github.com/containerd/fifo.(*fifo).Read(0xc0000b0900, {0xc0002c2000, 0x8000, 0x8000})
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/fifo/fifo.go:181 +0xcc
io.copyBuffer({0xa36fe0, 0xc0002060a8}, {0x7fb28c7eb6e0, 0xc0000b0900}, {0x0, 0x0, 0x0})
/usr/local/go/src/io/io.go:430 +0x1a6
io.Copy(...)
/usr/local/go/src/io/io.go:389
os.genericReadFrom(0xc0002060a8?, {0x7fb28c7eb6e0?, 0xc0000b0900?})
/usr/local/go/src/os/file.go:161 +0x35
os.(*File).ReadFrom(0xc0002060a8, {0x7fb28c7eb6e0, 0xc0000b0900})
/usr/local/go/src/os/file.go:155 +0x9c
io.copyBuffer({0xa36d40, 0xc0002060a8}, {0x7fb28c7eb6e0, 0xc0000b0900}, {0xc0002c0000, 0x1000, 0x1000})
/usr/local/go/src/io/io.go:416 +0x147
io.CopyBuffer({0xa36d40?, 0xc0002060a8?}, {0x7fb28c7eb6e0?, 0xc0000b0900?}, {0xc0002c0000?, 0x0?, 0x0?})
/usr/local/go/src/io/io.go:403 +0x36
github.com/containerd/containerd/pkg/process.copyPipes.func3()
/root/go/src/github.com/containerd/containerd/pkg/process/io.go:227 +0x12f
created by github.com/containerd/containerd/pkg/process.copyPipes in goroutine 38
/root/go/src/github.com/containerd/containerd/pkg/process/io.go:222 +0x876
goroutine 1153 [chan receive, 1 minutes]:
github.com/containerd/containerd/pkg/process.(*execProcess).Wait(0xc000022280?)
/root/go/src/github.com/containerd/containerd/pkg/process/exec.go:65 +0x1c
github.com/containerd/containerd/runtime/v2/runc/task.(*service).Wait(0x95a080?, {0xc0003fa200?, 0x7fb2d33df5b8?}, 0xc0003fa200)
/root/go/src/github.com/containerd/containerd/runtime/v2/runc/task/service.go:589 +0x62
github.com/containerd/containerd/runtime/v2/task.RegisterTaskService.func14({0xa3b228, 0xc000320210}, 0xc000103380)
/root/go/src/github.com/containerd/containerd/runtime/v2/task/shim.pb.go:3547 +0x8f
github.com/containerd/ttrpc.defaultServerInterceptor({0xa3b228?, 0xc000320210?}, 0x17?, 0xc00002f320?, 0x4?)
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/ttrpc/interceptor.go:45 +0x22
github.com/containerd/ttrpc.(*serviceSet).dispatch(0xc0000976b0, {0xa3b228, 0xc000320210}, {0xc0002a6840, 0x17}, {0xc0003fc018, 0x4}, {0xc0002a6858, 0x14, 0x18})
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/ttrpc/services.go:95 +0x1bf
github.com/containerd/ttrpc.(*serviceSet).call(0x1?, {0xa3b228?, 0xc000320210?}, {0xc0002a6840?, 0x49b05e?}, {0xc0003fc018?, 0xc000387fd0?}, {0xc0002a6858, 0x14, 0x18})
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/ttrpc/services.go:64 +0x65
github.com/containerd/ttrpc.(*serverConn).run.func2(0x3a3)
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/ttrpc/server.go:439 +0xd1
created by github.com/containerd/ttrpc.(*serverConn).run in goroutine 35
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/ttrpc/server.go:435 +0x669
goroutine 1642 [IO wait, 1 minutes]:
internal/poll.runtime_pollWait(0x7fb28c7581d8, 0x72)
/usr/local/go/src/runtime/netpoll.go:343 +0x85
internal/poll.(*pollDesc).wait(0xc000409980?, 0xc00045c000?, 0x1)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000409980, {0xc00045c000, 0x8000, 0x8000})
/usr/local/go/src/internal/poll/fd_unix.go:164 +0x27a
os.(*File).read(...)
/usr/local/go/src/os/file_posix.go:29
os.(*File).Read(0xc000206410, {0xc00045c000?, 0x8000?, 0x0?})
/usr/local/go/src/os/file.go:118 +0x52
github.com/containerd/fifo.(*fifo).Read(0xc000409800, {0xc00045c000, 0x8000, 0x8000})
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/fifo/fifo.go:181 +0xcc
io.copyBuffer({0xa36fe0, 0xc000054230}, {0x7fb28c7eb6e0, 0xc000409800}, {0x0, 0x0, 0x0})
/usr/local/go/src/io/io.go:430 +0x1a6
io.Copy(...)
/usr/local/go/src/io/io.go:389
os.genericReadFrom(0xc000054230?, {0x7fb28c7eb6e0?, 0xc000409800?})
/usr/local/go/src/os/file.go:161 +0x35
os.(*File).ReadFrom(0xc000054230, {0x7fb28c7eb6e0, 0xc000409800})
/usr/local/go/src/os/file.go:155 +0x9c
io.copyBuffer({0xa36d40, 0xc000054230}, {0x7fb28c7eb6e0, 0xc000409800}, {0xc000383000, 0x1000, 0x1000})
/usr/local/go/src/io/io.go:416 +0x147
io.CopyBuffer({0xa36d40?, 0xc000054230?}, {0x7fb28c7eb6e0?, 0xc000409800?}, {0xc000383000?, 0xc00029e500?, 0xc000054001?})
/usr/local/go/src/io/io.go:403 +0x36
github.com/containerd/containerd/pkg/process.copyPipes.func3()
/root/go/src/github.com/containerd/containerd/pkg/process/io.go:227 +0x12f
created by github.com/containerd/containerd/pkg/process.copyPipes in goroutine 1164
/root/go/src/github.com/containerd/containerd/pkg/process/io.go:222 +0x876
goroutine 1148 [chan receive, 1 minutes]:
github.com/containerd/containerd/pkg/process.(*execProcess).Wait(0xc000022280?)
/root/go/src/github.com/containerd/containerd/pkg/process/exec.go:65 +0x1c
github.com/containerd/containerd/runtime/v2/runc/task.(*service).Wait(0x95a080?, {0xc0003140c0?, 0x7fb2d33dfa68?}, 0xc0003140c0)
/root/go/src/github.com/containerd/containerd/runtime/v2/runc/task/service.go:589 +0x62
github.com/containerd/containerd/runtime/v2/task.RegisterTaskService.func14({0xa3b228, 0xc00040a5a0}, 0xc00031e160)
/root/go/src/github.com/containerd/containerd/runtime/v2/task/shim.pb.go:3547 +0x8f
github.com/containerd/ttrpc.defaultServerInterceptor({0xa3b228?, 0xc00040a5a0?}, 0x17?, 0xc0003041c0?, 0x4?)
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/ttrpc/interceptor.go:45 +0x22
github.com/containerd/ttrpc.(*serviceSet).dispatch(0xc0000976b0, {0xa3b228, 0xc00040a5a0}, {0xc00002c408, 0x17}, {0xc00031237c, 0x4}, {0xc00002c420, 0x14, 0x18})
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/ttrpc/services.go:95 +0x1bf
github.com/containerd/ttrpc.(*serviceSet).call(0x7f01ba?, {0xa3b228?, 0xc00040a5a0?}, {0xc00002c408?, 0x0?}, {0xc00031237c?, 0xc0002b6f50?}, {0xc00002c420, 0x14, 0x18})
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/ttrpc/services.go:64 +0x65
github.com/containerd/ttrpc.(*serverConn).run.func2(0x3d9)
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/ttrpc/server.go:439 +0xd1
created by github.com/containerd/ttrpc.(*serverConn).run in goroutine 35
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/ttrpc/server.go:435 +0x669
goroutine 1371 [IO wait, 1 minutes]:
internal/poll.runtime_pollWait(0x7fb28c7583c8, 0x72)
/usr/local/go/src/runtime/netpoll.go:343 +0x85
internal/poll.(*pollDesc).wait(0xc000071980?, 0xc0003e4000?, 0x1)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000071980, {0xc0003e4000, 0x8000, 0x8000})
/usr/local/go/src/internal/poll/fd_unix.go:164 +0x27a
os.(*File).read(...)
/usr/local/go/src/os/file_posix.go:29
os.(*File).Read(0xc000318260, {0xc0003e4000?, 0x8000?, 0x0?})
/usr/local/go/src/os/file.go:118 +0x52
github.com/containerd/fifo.(*fifo).Read(0xc000225260, {0xc0003e4000, 0x8000, 0x8000})
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/fifo/fifo.go:181 +0xcc
io.copyBuffer({0xa36fe0, 0xc0003180a8}, {0x7fb28c7eb6e0, 0xc000225260}, {0x0, 0x0, 0x0})
/usr/local/go/src/io/io.go:430 +0x1a6
io.Copy(...)
/usr/local/go/src/io/io.go:389
os.genericReadFrom(0xc0003180a8?, {0x7fb28c7eb6e0?, 0xc000225260?})
/usr/local/go/src/os/file.go:161 +0x35
os.(*File).ReadFrom(0xc0003180a8, {0x7fb28c7eb6e0, 0xc000225260})
/usr/local/go/src/os/file.go:155 +0x9c
io.copyBuffer({0xa36d40, 0xc0003180a8}, {0x7fb28c7eb6e0, 0xc000225260}, {0xc00049f000, 0x1000, 0x1000})
/usr/local/go/src/io/io.go:416 +0x147
io.CopyBuffer({0xa36d40?, 0xc0003180a8?}, {0x7fb28c7eb6e0?, 0xc000225260?}, {0xc00049f000?, 0xc000226120?, 0xc0003e47e0?})
/usr/local/go/src/io/io.go:403 +0x36
github.com/containerd/containerd/pkg/process.copyPipes.func3()
/root/go/src/github.com/containerd/containerd/pkg/process/io.go:227 +0x12f
created by github.com/containerd/containerd/pkg/process.copyPipes in goroutine 1121
/root/go/src/github.com/containerd/containerd/pkg/process/io.go:222 +0x876
goroutine 1572 [IO wait, 1 minutes]:
internal/poll.runtime_pollWait(0x7fb28c828e88, 0x72)
/usr/local/go/src/runtime/netpoll.go:343 +0x85
internal/poll.(*pollDesc).wait(0xc000416c60?, 0xc0004fa000?, 0x1)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000416c60, {0xc0004fa000, 0x8000, 0x8000})
/usr/local/go/src/internal/poll/fd_unix.go:164 +0x27a
os.(*File).read(...)
/usr/local/go/src/os/file_posix.go:29
os.(*File).Read(0xc0003181d0, {0xc0004fa000?, 0x8000?, 0x0?})
/usr/local/go/src/os/file.go:118 +0x52
github.com/containerd/fifo.(*fifo).Read(0xc0002242a0, {0xc0004fa000, 0x8000, 0x8000})
/root/go/src/github.com/containerd/containerd/vendor/github.com/containerd/fifo/fifo.go:181 +0xcc
io.copyBuffer({0xa36fe0, 0xc000318230}, {0x7fb28c7eb6e0, 0xc0002242a0}, {0x0, 0x0, 0x0})
/usr/local/go/src/io/io.go:430 +0x1a6
io.Copy(...)
/usr/local/go/src/io/io.go:389
os.genericReadFrom(0xc000318230?, {0x7fb28c7eb6e0?, 0xc0002242a0?})
/usr/local/go/src/os/file.go:161 +0x35
os.(*File).ReadFrom(0xc000318230, {0x7fb28c7eb6e0, 0xc0002242a0})
/usr/local/go/src/os/file.go:155 +0x9c
io.copyBuffer({0xa36d40, 0xc000318230}, {0x7fb28c7eb6e0, 0xc0002242a0}, {0xc000232000, 0x1000, 0x1000})
/usr/local/go/src/io/io.go:416 +0x147
io.CopyBuffer({0xa36d40?, 0xc000318230?}, {0x7fb28c7eb6e0?, 0xc0002242a0?}, {0xc000232000?, 0xc000225980?, 0xc000010528?})
/usr/local/go/src/io/io.go:403 +0x36
github.com/containerd/containerd/pkg/process.copyPipes.func3()
/root/go/src/github.com/containerd/containerd/pkg/process/io.go:227 +0x12f
created by github.com/containerd/containerd/pkg/process.copyPipes in goroutine 1136
/root/go/src/github.com/containerd/containerd/pkg/process/io.go:222 +0x876
=== END goroutine stack dump ===" namespace=default path=/run/containerd/io.containerd.runtime.v2.task/default/pause1 pid=29178 runtime=io.containerd.runc.v2
from containerd.
Related Issues (20)
- ctr pull images err archive/tar: invalid tar header: unknown HOT 5
- kubelet and containerd in endless loop for CreateContainer with unexpected media type octet-stream HOT 3
- Support Multiple Images Pinned against a common key
- Better error message, if host.toml contains a syntax error
- Error: no image was built
- Sandbox/Pause containers should run on a configurable cpuset to avoid interfering with low-jitter workloads
- RFC - [content-store] Commit should check first fsync() error HOT 1
- `docker checkpoint rm` does not actually remove the checkpoint files.
- Passing OpenTelemetry (otel) Env Vars to the Shim Runtime
- Support for Wasm OCI Artifacts HOT 2
- container-shim leaks sockets
- Report the use of components with vulnerabilities in containerd HOT 1
- `ctr images pull --all-platforms --local docker.io/library/hello-world:latest` fails: `ctr: mismatched image rootfs and manifest layers` HOT 7
- oss-fuzz integration is split across (at least) 3 repositories and is fragile HOT 4
- When the overlay volatile feature is enabled, creating a pod with an image configured with anonymous volumes will fail
- When the overlay volatile feature is enabled, creating a pod with an image configured with anonymous volumes will fail HOT 1
- containerd crash - containerd[501]: [signal SIGSEGV: segmentation violation code=0x1 addr=0x129a0 pc=0x563a4cdd0d6f] HOT 1
- ImagePull failure - can't unmount tmpmount
- Need test cases for v2 loopback options HOT 2
- runtime options seem to be ignored with v2.0.0-rc.2 HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from containerd.