[ERROR] CUDA runtime error: the provided PTX was compiled with an unsupported toolchain. about fauxpilot HOT 8 CLOSED

me too, how to solve

from fauxpilot.

Which GPU are you using?

from fauxpilot.

NVIDIA GeForce RTX 3060
NVIDIA-SMI 470.141.03 Driver Version: 470.141.03 CUDA Version: 11.4

the docker shows
Using driver version 470.141.03 which has support for CUDA 11.4. This container
triton_1 | was built with CUDA 11.7 and will be run in Minor Version Compatibility mode.

what(): [FT][ERROR] CUDA runtime error: the provided PTX was compiled with an unsupported toolchain. /workspace/build/fastertransformer_backend/build/_deps/repo-ft-src/src/fastertransformer/utils/cuda_utils.h:393

is there any version built by CUDA11.4 ?

from fauxpilot.

me too, how to solve

I tried to upgrade cuda to 11.7 which solved the problem

from fauxpilot.

Great – @neoinmatrix, does that work for you?

from fauxpilot.

yes，at last，I upgraded nvidia-driver to 515.65.01, and upgraded cuda to 11.7, solved the problem .

from fauxpilot.

CUDA runtime error: the provided PTX was compiled with an unsuppo

According to the "the provided PTX was compiled with an unsupported toolchain..." message, It seems that you have to up-to-date CUDA version to avoid the toolchain-related problem like this issue

from fauxpilot.

same issuse. can any one help to solve the problem with nvidia-driver-470?
cuda 11.7 is too new for stable version.
And the lastest stable version for debian is nvidia-driver-470 only support like cuda-11.2

from fauxpilot.