Crash with multiple whisper states running at the same time CUDA about whisper.cpp HOT 4 CLOSED

@bradmit Could you check if #2182 resolves the issues?

from whisper.cpp.

Doesn't look like it. I downloaded the master branch and used that...

[Current thread is 1 (Thread 0x7fef323f1000 (LWP 3420))]
Missing separate debuginfos, use: yum debuginfo-install boost-date-time-1.66.0-13.el8.x86_64 bzip2-libs-1.0.6-26.el8.x86_64 glibc-2.28-236.0.1.el8_9.12.x86_64 libgcc-8.5.0-20.0.3.el8.x86_64 libstdc++-8.5.0-20.0.3.el8.x86_64 libxml2-2.9.7-18.el8_9.x86_64 xz-libs-5.2.4-4.el8_6.x86_64 zlib-1.2.11-25.el8.x86_64
(gdb) where
#0 0x00007ff10dd25b8f in raise () from /lib64/libc.so.6
#1 0x00007ff10dcf8ea5 in abort () from /lib64/libc.so.6
#2 0x00007ff13787647a in ggml_cuda_pool_vmm::free(void*, unsigned long) () from /opt1/resource/lib/libwhisper.so
#3 0x00007ff13786ef00 in ggml_cuda_op_mul_mat_cublas(ggml_backend_cuda_context&, ggml_tensor const*, ggml_tensor const*, ggml_tensor*, char const*, float const*, char const*, float*, long, long, long, long, CUstream_st*) () from /opt1/resource/lib/libwhisper.so
#4 0x00007ff137871bdc in ggml_cuda_op_mul_mat(ggml_backend_cuda_context&, ggml_tensor const*, ggml_tensor const*, ggml_tensor*, void ()(ggml_backend_cuda_context&, ggml_tensor const, ggml_tensor const*, ggml_tensor*, char const*, float const*, char const*, float*, long, long, long, long, CUstream_st*), bool) () from /opt1/resource/lib/libwhisper.so
#5 0x00007ff137872c79 in ggml_cuda_mul_mat(ggml_backend_cuda_context&, ggml_tensor const*, ggml_tensor const*, ggml_tensor*) () from /opt1/resource/lib/libwhisper.so
#6 0x00007ff137874eee in ggml_backend_cuda_graph_compute(ggml_backend*, ggml_cgraph*) () from /opt1/resource/lib/libwhisper.so
#7 0x00007ff13796fb39 in ggml_backend_graph_compute () from /opt1/resource/lib/libwhisper.so
#8 0x00007ff1379be838 in whisper_encode_internal(whisper_context&, whisper_state&, int, int, bool ()(void), void*) () from /opt1/resource/lib/libwhisper.so
#9 0x00007ff1379be94f in whisper_encode_with_state () from /opt1/resource/lib/libwhisper.so
#10 0x00007ff1379c37f3 in whisper_lang_auto_detect_with_state () from /opt1/resource/lib/libwhisper.so
#11 0x00007ff1379d15d5 in whisper_full_with_state () from /opt1/resource/lib/libwhisper.so

from whisper.cpp.

It's not merged, so you need to use the gg/backend-per-state branch

from whisper.cpp.

My mistake. The branch is good. No crash.

from whisper.cpp.