Giter Club home page Giter Club logo

Comments (14)

yoyolin avatar yoyolin commented on June 2, 2024 1

I also met the error message gcc: error:/home/asd/VON/render_module/vtn/vtn/src/vtn_cuda_kernel_generic.cu.o:No such file or directory .

I noticed there this was caused because of a previous mistake /usr/include/c++/5/bits/c++0x_warning.h:32:2: error: #error This file requires compiler and library support for the ISO C++ 2011 standard. This support must be enabled with the -std=c++11 or -std=gnu++11 compiler options.

Having no previous c++ experience, I searched on google and found this answer. For simplicity, the following two lines will make things work:

Changed line 33 in VON/render_module/vtn/setup.sh to
cmd="nvcc -std=c++11 -c -o vtn_cuda_kernel_generic.cu.o vtn_cuda_kernel_generic.cu -x cu -Xcompiler -fPIC -I ${TORCH}/lib/include/TH -I ${TO RCH}/lib/include -I ${TORCH}/lib/include/THC -I ${HERE}

Also line 25 in VON/render_module/calc_prob/setup.sh to
cmd="nvcc -std=c++11 -c -o calc_prob_kernel.cu.o calc_prob_kernel.cu -x cu -Xcompiler -fPIC -I ${TORCH}/lib/include/TH -I ${TORCH}/lib/inclu de -I ${TORCH}/lib/include/THC -I ${HERE} \

from von.

junyanz avatar junyanz commented on June 2, 2024

@ztzhang

from von.

ztzhang avatar ztzhang commented on June 2, 2024

@yoyolin @tang0704 sorry for the late reply!
It seems that for newer versions of GCC, -std=c++11 is automatically set; I'm testing if this addition would break later GCC versions. Thanks so much for pointing out!

from von.

wosecz avatar wosecz commented on June 2, 2024

I tried gcc/6.2.0 and failed with a similar problem:
image

image
image
image

but using gcc/7.2.0 is stopped showing that gcc higher than verion 6 is not supported.
So could you please give us some advice to fix it?

from von.

wosecz avatar wosecz commented on June 2, 2024

@ztzhang ,or could you give us some ideas about the necessary dependencies of the compiling, besides the version of gcc? I tried to build the environment using your pkg_specs.txt and Anaconda, however, the version of glibc needed by torch and py-OpenCV is conflicted (torch needs glibc 2.14 but cv2 doesn't work with it). Now I'm trying to install the packages on my own. There are many packages listed in the pkg_specs.txt, I'm worried about missing something necessary.
Thank you very much!

from von.

ztzhang avatar ztzhang commented on June 2, 2024

@wosecz I'm trying to reproduce this issue using GCC 6.2.0; we only tested it under 6.3.0. Could you provide the pytorch version you are using? Also would you mind posing the error message when building the environment under Anaconda? Currently I can not reproduce this issue. Thanks!
@tang0704 it seems that your issue is more related to the Nvidia GPU model you are using. Would you mind providing that as well? Thanks!

from von.

wosecz avatar wosecz commented on June 2, 2024

of course! I used torch 0.4.1, OpenCV 2.4.3, python 3.7 (Anaconda), I tried gcc/7.2.0/6.2.0/5.4.0, cuda 8.0.44/9.1.85.
image

I used the pkg_specs.txt to build the Anaconda environment,
image
image

but when I tried to import cv2 and torch
image

it seems something wrong with the glibc, so I loaded glibc/2.14, now torch is ok, however, cv2 doesn't work.
image
It looks like a fight between cv2 and torch.....

Besides the error on cv2 and torch, now I use the anaconda environment (gcc 5.4.0, cuda 8.0.44,) to run bash install.sh after adding std=c++11 , the error is:
image

Thank you very much for your help!

If needed, the whole result is
(von) [zche3175@hpc223 VON]$ bash install.sh
Add -gencode to match all the GPU architectures you have.
Check 'https://en.wikipedia.org/wiki/CUDA#GPUs_supported' for list of architecture.
Check 'http://docs.nvidia.com/cuda/cuda-compiler-driver-nvcc/index.html' for GPU compilation based on architecture.
nvcc -std=c++11 -c -o vtn_cuda_kernel_generic.cu.o vtn_cuda_kernel_generic.cu -x cu -Xcompiler -fPIC -I /home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/lib/include/TH -I /home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/lib/include -I /home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/lib/include/THC -I /home/zche3175/gan/VON/render_module/vtn/vtn/src -gencode arch=compute_30,code=sm_30 -gencode arch=compute_35,code=sm_35 -gencode arch=compute_52,code=sm_52 -gencode arch=compute_61,code=sm_61
/home/zche3175/gan/VON/render_module/vtn
Including CUDA code.
generating /tmp/tmpxaj7uy86/_vtn_lib.c
setting the current directory to '/tmp/tmpxaj7uy86'
running build_ext
building '_vtn_lib' extension
creating home
creating home/zche3175
creating home/zche3175/gan
creating home/zche3175/gan/VON
creating home/zche3175/gan/VON/render_module
creating home/zche3175/gan/VON/render_module/vtn
creating home/zche3175/gan/VON/render_module/vtn/vtn
creating home/zche3175/gan/VON/render_module/vtn/vtn/src
gcc -pthread -B /home/zche3175/.conda/envs/von/compiler_compat -Wl,--sysroot=/ -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -I/usr/local/gcc/5.4.0/include -I/usr/local/mpfr/3.1.4/include -I/usr/local/gmp/6.1.0/include -I/usr/local/gcc/5.4.0/include -I/usr/local/mpc/1.0.3/include -I/usr/local/mpfr/3.1.4/include -I/usr/local/gmp/6.1.0/include -I/usr/local/cuda/8.0.44/include -fPIC -DWITH_CUDA -I/home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include -I/home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include/TH -I/home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include/THC -I/home/zche3175/gan/VON/render_module/vtn/vtn/src -I/home/zche3175/.conda/envs/von/include/python3.7m -c _vtn_lib.c -o ./_vtn_lib.o -std=c99 -fopenmp
gcc -pthread -B /home/zche3175/.conda/envs/von/compiler_compat -Wl,--sysroot=/ -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -I/usr/local/gcc/5.4.0/include -I/usr/local/mpfr/3.1.4/include -I/usr/local/gmp/6.1.0/include -I/usr/local/gcc/5.4.0/include -I/usr/local/mpc/1.0.3/include -I/usr/local/mpfr/3.1.4/include -I/usr/local/gmp/6.1.0/include -I/usr/local/cuda/8.0.44/include -fPIC -DWITH_CUDA -I/home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include -I/home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include/TH -I/home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include/THC -I/home/zche3175/gan/VON/render_module/vtn/vtn/src -I/home/zche3175/.conda/envs/von/include/python3.7m -c /home/zche3175/gan/VON/render_module/vtn/vtn/src/vtn.c -o ./home/zche3175/gan/VON/render_module/vtn/vtn/src/vtn.o -std=c99 -fopenmp
gcc -pthread -B /home/zche3175/.conda/envs/von/compiler_compat -Wl,--sysroot=/ -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -I/usr/local/gcc/5.4.0/include -I/usr/local/mpfr/3.1.4/include -I/usr/local/gmp/6.1.0/include -I/usr/local/gcc/5.4.0/include -I/usr/local/mpc/1.0.3/include -I/usr/local/mpfr/3.1.4/include -I/usr/local/gmp/6.1.0/include -I/usr/local/cuda/8.0.44/include -fPIC -DWITH_CUDA -I/home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include -I/home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include/TH -I/home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include/THC -I/home/zche3175/gan/VON/render_module/vtn/vtn/src -I/home/zche3175/.conda/envs/von/include/python3.7m -c /home/zche3175/gan/VON/render_module/vtn/vtn/src/vtn_cuda_generic.c -o ./home/zche3175/gan/VON/render_module/vtn/vtn/src/vtn_cuda_generic.o -std=c99 -fopenmp
gcc -pthread -shared -B /home/zche3175/.conda/envs/von/compiler_compat -L/home/zche3175/.conda/envs/von/lib -Wl,-rpath=/home/zche3175/.conda/envs/von/lib -Wl,--no-as-needed -Wl,--sysroot=/ -L/usr/local/gcc/5.4.0/lib64 -L/usr/local/mpc/1.0.3/lib -L/usr/local/mpfr/3.1.4/lib -L/usr/local/gmp/6.1.0/lib -L/usr/local/cuda/8.0.44/lib64/stubs -L/usr/local/cuda/8.0.44/lib -L/usr/local/cuda/8.0.44/lib64 -I/usr/local/gcc/5.4.0/include -I/usr/local/mpfr/3.1.4/include -I/usr/local/gmp/6.1.0/include -I/usr/local/gcc/5.4.0/include -I/usr/local/mpc/1.0.3/include -I/usr/local/mpfr/3.1.4/include -I/usr/local/gmp/6.1.0/include -I/usr/local/cuda/8.0.44/include ./_vtn_lib.o ./home/zche3175/gan/VON/render_module/vtn/vtn/src/vtn.o ./home/zche3175/gan/VON/render_module/vtn/vtn/src/vtn_cuda_generic.o /home/zche3175/gan/VON/render_module/vtn/vtn/src/vtn_cuda_kernel_generic.cu.o -o ./_vtn_lib.so
Add -gencode to match all the GPU architectures you have.
Check 'https://en.wikipedia.org/wiki/CUDA#GPUs_supported' for list of architecture.
Check 'http://docs.nvidia.com/cuda/cuda-compiler-driver-nvcc/index.html' for GPU compilation based on architecture.
nvcc -std=c++11 -c -o calc_prob_kernel.cu.o calc_prob_kernel.cu -x cu -Xcompiler -fPIC -I /home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/lib/include/TH -I /home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/lib/include -I /home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/lib/include/THC -I /home/zche3175/gan/VON/render_module/calc_prob/calc_prob/src -gencode arch=compute_30,code=sm_30 -gencode arch=compute_35,code=sm_35 -gencode arch=compute_52,code=sm_52 -gencode arch=compute_61,code=sm_61 -gencode arch=compute_70,code=sm_70
nvcc fatal : Unsupported gpu architecture 'compute_70'
/home/zche3175/gan/VON/render_module/calc_prob
generating /tmp/tmpht08nb9k/_calc_prob_lib.c
setting the current directory to '/tmp/tmpht08nb9k'
running build_ext
building '_calc_prob_lib' extension
creating home
creating home/zche3175
creating home/zche3175/gan
creating home/zche3175/gan/VON
creating home/zche3175/gan/VON/render_module
creating home/zche3175/gan/VON/render_module/calc_prob
creating home/zche3175/gan/VON/render_module/calc_prob/calc_prob
creating home/zche3175/gan/VON/render_module/calc_prob/calc_prob/src
gcc -pthread -B /home/zche3175/.conda/envs/von/compiler_compat -Wl,--sysroot=/ -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -I/usr/local/gcc/5.4.0/include -I/usr/local/mpfr/3.1.4/include -I/usr/local/gmp/6.1.0/include -I/usr/local/gcc/5.4.0/include -I/usr/local/mpc/1.0.3/include -I/usr/local/mpfr/3.1.4/include -I/usr/local/gmp/6.1.0/include -I/usr/local/cuda/8.0.44/include -fPIC -DWITH_CUDA=True -I/home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include -I/home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include/TH -I/home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include/THC -I/home/zche3175/gan/VON/render_module/calc_prob/calc_prob/src -I/home/zche3175/.conda/envs/von/include/python3.7m -c _calc_prob_lib.c -o ./_calc_prob_lib.o -std=c99
gcc -pthread -B /home/zche3175/.conda/envs/von/compiler_compat -Wl,--sysroot=/ -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -I/usr/local/gcc/5.4.0/include -I/usr/local/mpfr/3.1.4/include -I/usr/local/gmp/6.1.0/include -I/usr/local/gcc/5.4.0/include -I/usr/local/mpc/1.0.3/include -I/usr/local/mpfr/3.1.4/include -I/usr/local/gmp/6.1.0/include -I/usr/local/cuda/8.0.44/include -fPIC -DWITH_CUDA=True -I/home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include -I/home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include/TH -I/home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include/THC -I/home/zche3175/gan/VON/render_module/calc_prob/calc_prob/src -I/home/zche3175/.conda/envs/von/include/python3.7m -c /home/zche3175/gan/VON/render_module/calc_prob/calc_prob/src/calc_prob.c -o ./home/zche3175/gan/VON/render_module/calc_prob/calc_prob/src/calc_prob.o -std=c99
gcc -pthread -shared -B /home/zche3175/.conda/envs/von/compiler_compat -L/home/zche3175/.conda/envs/von/lib -Wl,-rpath=/home/zche3175/.conda/envs/von/lib -Wl,--no-as-needed -Wl,--sysroot=/ -L/usr/local/gcc/5.4.0/lib64 -L/usr/local/mpc/1.0.3/lib -L/usr/local/mpfr/3.1.4/lib -L/usr/local/gmp/6.1.0/lib -L/usr/local/cuda/8.0.44/lib64/stubs -L/usr/local/cuda/8.0.44/lib -L/usr/local/cuda/8.0.44/lib64 -I/usr/local/gcc/5.4.0/include -I/usr/local/mpfr/3.1.4/include -I/usr/local/gmp/6.1.0/include -I/usr/local/gcc/5.4.0/include -I/usr/local/mpc/1.0.3/include -I/usr/local/mpfr/3.1.4/include -I/usr/local/gmp/6.1.0/include -I/usr/local/cuda/8.0.44/include ./_calc_prob_lib.o ./home/zche3175/gan/VON/render_module/calc_prob/calc_prob/src/calc_prob.o /home/zche3175/gan/VON/render_module/calc_prob/calc_prob/src/calc_prob_kernel.cu.o -o ./_calc_prob_lib.so
/home/zche3175/gan/VON
(von) [zche3175@hpc223 VON]$ ^C

from von.

ztzhang avatar ztzhang commented on June 2, 2024

@wosecz
The install.sh error might be related to your GPU type. Can you also share that information as well? A quick test is to remove -gencode arch=compute_70,code=sm_70 from VON/render_module/calc_prob/calc_prob/src/install.sh and see if it fix the compiling problem.

As for the torch/cv2 conflict, I'll try to see if I can reproduce this issue.

Thanks!

from von.

wosecz avatar wosecz commented on June 2, 2024

I used one V100(Tesla V100-SXM2-16GB).
I follow your advice removing -gencode arch=compute_70,code=sm_70 in VON/render_module/calc_prob/setup.sh , I guss what you mean is that file. Now there is now explicit error, but also no completion inform. Should there be a report like "successfule compling!" in the end?

--------------whole result if needed----------------
(von) [zche3175@hpc223 VON]$ bash install.sh
Add -gencode to match all the GPU architectures you have.
Check 'https://en.wikipedia.org/wiki/CUDA#GPUs_supported' for list of architecture.
Check 'http://docs.nvidia.com/cuda/cuda-compiler-driver-nvcc/index.html' for GPU compilation based on architecture.
nvcc -std=c++11 -c -o vtn_cuda_kernel_generic.cu.o vtn_cuda_kernel_generic.cu -x cu -Xcompiler -fPIC -I /home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/lib/include/TH -I /home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/lib/include -I /home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/lib/include/THC -I /home/zche3175/gan/VON/render_module/vtn/vtn/src -gencode arch=compute_30,code=sm_30 -gencode arch=compute_35,code=sm_35 -gencode arch=compute_52,code=sm_52 -gencode arch=compute_61,code=sm_61
/home/zche3175/gan/VON/render_module/vtn
Including CUDA code.
generating /tmp/tmpgl7i66tf/_vtn_lib.c
setting the current directory to '/tmp/tmpgl7i66tf'
running build_ext
building '_vtn_lib' extension
creating home
creating home/zche3175
creating home/zche3175/gan
creating home/zche3175/gan/VON
creating home/zche3175/gan/VON/render_module
creating home/zche3175/gan/VON/render_module/vtn
creating home/zche3175/gan/VON/render_module/vtn/vtn
creating home/zche3175/gan/VON/render_module/vtn/vtn/src
gcc -pthread -B /home/zche3175/.conda/envs/von/compiler_compat -Wl,--sysroot=/ -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -I/usr/local/gcc/5.4.0/include -I/usr/local/mpfr/3.1.4/include -I/usr/local/gmp/6.1.0/include -I/usr/local/gcc/5.4.0/include -I/usr/local/mpc/1.0.3/include -I/usr/local/mpfr/3.1.4/include -I/usr/local/gmp/6.1.0/include -I/usr/local/cuda/8.0.44/include -fPIC -DWITH_CUDA -I/home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include -I/home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include/TH -I/home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include/THC -I/home/zche3175/gan/VON/render_module/vtn/vtn/src -I/home/zche3175/.conda/envs/von/include/python3.7m -c _vtn_lib.c -o ./_vtn_lib.o -std=c99 -fopenmp
gcc -pthread -B /home/zche3175/.conda/envs/von/compiler_compat -Wl,--sysroot=/ -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -I/usr/local/gcc/5.4.0/include -I/usr/local/mpfr/3.1.4/include -I/usr/local/gmp/6.1.0/include -I/usr/local/gcc/5.4.0/include -I/usr/local/mpc/1.0.3/include -I/usr/local/mpfr/3.1.4/include -I/usr/local/gmp/6.1.0/include -I/usr/local/cuda/8.0.44/include -fPIC -DWITH_CUDA -I/home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include -I/home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include/TH -I/home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include/THC -I/home/zche3175/gan/VON/render_module/vtn/vtn/src -I/home/zche3175/.conda/envs/von/include/python3.7m -c /home/zche3175/gan/VON/render_module/vtn/vtn/src/vtn.c -o ./home/zche3175/gan/VON/render_module/vtn/vtn/src/vtn.o -std=c99 -fopenmp
gcc -pthread -B /home/zche3175/.conda/envs/von/compiler_compat -Wl,--sysroot=/ -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -I/usr/local/gcc/5.4.0/include -I/usr/local/mpfr/3.1.4/include -I/usr/local/gmp/6.1.0/include -I/usr/local/gcc/5.4.0/include -I/usr/local/mpc/1.0.3/include -I/usr/local/mpfr/3.1.4/include -I/usr/local/gmp/6.1.0/include -I/usr/local/cuda/8.0.44/include -fPIC -DWITH_CUDA -I/home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include -I/home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include/TH -I/home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include/THC -I/home/zche3175/gan/VON/render_module/vtn/vtn/src -I/home/zche3175/.conda/envs/von/include/python3.7m -c /home/zche3175/gan/VON/render_module/vtn/vtn/src/vtn_cuda_generic.c -o ./home/zche3175/gan/VON/render_module/vtn/vtn/src/vtn_cuda_generic.o -std=c99 -fopenmp
gcc -pthread -shared -B /home/zche3175/.conda/envs/von/compiler_compat -L/home/zche3175/.conda/envs/von/lib -Wl,-rpath=/home/zche3175/.conda/envs/von/lib -Wl,--no-as-needed -Wl,--sysroot=/ -L/usr/local/gcc/5.4.0/lib64 -L/usr/local/mpc/1.0.3/lib -L/usr/local/mpfr/3.1.4/lib -L/usr/local/gmp/6.1.0/lib -L/usr/local/cuda/8.0.44/lib64/stubs -L/usr/local/cuda/8.0.44/lib -L/usr/local/cuda/8.0.44/lib64 -I/usr/local/gcc/5.4.0/include -I/usr/local/mpfr/3.1.4/include -I/usr/local/gmp/6.1.0/include -I/usr/local/gcc/5.4.0/include -I/usr/local/mpc/1.0.3/include -I/usr/local/mpfr/3.1.4/include -I/usr/local/gmp/6.1.0/include -I/usr/local/cuda/8.0.44/include ./_vtn_lib.o ./home/zche3175/gan/VON/render_module/vtn/vtn/src/vtn.o ./home/zche3175/gan/VON/render_module/vtn/vtn/src/vtn_cuda_generic.o /home/zche3175/gan/VON/render_module/vtn/vtn/src/vtn_cuda_kernel_generic.cu.o -o ./_vtn_lib.so
Add -gencode to match all the GPU architectures you have.
Check 'https://en.wikipedia.org/wiki/CUDA#GPUs_supported' for list of architecture.
Check 'http://docs.nvidia.com/cuda/cuda-compiler-driver-nvcc/index.html' for GPU compilation based on architecture.
nvcc -std=c++11 -c -o calc_prob_kernel.cu.o calc_prob_kernel.cu -x cu -Xcompiler -fPIC -I /home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/lib/include/TH -I /home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/lib/include -I /home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/lib/include/THC -I /home/zche3175/gan/VON/render_module/calc_prob/calc_prob/src -gencode arch=compute_30,code=sm_30 -gencode arch=compute_35,code=sm_35 -gencode arch=compute_52,code=sm_52 -gencode arch=compute_61,code=sm_61
/home/zche3175/gan/VON/render_module/calc_prob
generating /tmp/tmp0zxeqr8j/_calc_prob_lib.c
setting the current directory to '/tmp/tmp0zxeqr8j'
running build_ext
building '_calc_prob_lib' extension
creating home
creating home/zche3175
creating home/zche3175/gan
creating home/zche3175/gan/VON
creating home/zche3175/gan/VON/render_module
creating home/zche3175/gan/VON/render_module/calc_prob
creating home/zche3175/gan/VON/render_module/calc_prob/calc_prob
creating home/zche3175/gan/VON/render_module/calc_prob/calc_prob/src
gcc -pthread -B /home/zche3175/.conda/envs/von/compiler_compat -Wl,--sysroot=/ -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -I/usr/local/gcc/5.4.0/include -I/usr/local/mpfr/3.1.4/include -I/usr/local/gmp/6.1.0/include -I/usr/local/gcc/5.4.0/include -I/usr/local/mpc/1.0.3/include -I/usr/local/mpfr/3.1.4/include -I/usr/local/gmp/6.1.0/include -I/usr/local/cuda/8.0.44/include -fPIC -DWITH_CUDA=True -I/home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include -I/home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include/TH -I/home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include/THC -I/home/zche3175/gan/VON/render_module/calc_prob/calc_prob/src -I/home/zche3175/.conda/envs/von/include/python3.7m -c _calc_prob_lib.c -o ./_calc_prob_lib.o -std=c99
gcc -pthread -B /home/zche3175/.conda/envs/von/compiler_compat -Wl,--sysroot=/ -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -I/usr/local/gcc/5.4.0/include -I/usr/local/mpfr/3.1.4/include -I/usr/local/gmp/6.1.0/include -I/usr/local/gcc/5.4.0/include -I/usr/local/mpc/1.0.3/include -I/usr/local/mpfr/3.1.4/include -I/usr/local/gmp/6.1.0/include -I/usr/local/cuda/8.0.44/include -fPIC -DWITH_CUDA=True -I/home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include -I/home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include/TH -I/home/zche3175/.conda/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include/THC -I/home/zche3175/gan/VON/render_module/calc_prob/calc_prob/src -I/home/zche3175/.conda/envs/von/include/python3.7m -c /home/zche3175/gan/VON/render_module/calc_prob/calc_prob/src/calc_prob.c -o ./home/zche3175/gan/VON/render_module/calc_prob/calc_prob/src/calc_prob.o -std=c99
gcc -pthread -shared -B /home/zche3175/.conda/envs/von/compiler_compat -L/home/zche3175/.conda/envs/von/lib -Wl,-rpath=/home/zche3175/.conda/envs/von/lib -Wl,--no-as-needed -Wl,--sysroot=/ -L/usr/local/gcc/5.4.0/lib64 -L/usr/local/mpc/1.0.3/lib -L/usr/local/mpfr/3.1.4/lib -L/usr/local/gmp/6.1.0/lib -L/usr/local/cuda/8.0.44/lib64/stubs -L/usr/local/cuda/8.0.44/lib -L/usr/local/cuda/8.0.44/lib64 -I/usr/local/gcc/5.4.0/include -I/usr/local/mpfr/3.1.4/include -I/usr/local/gmp/6.1.0/include -I/usr/local/gcc/5.4.0/include -I/usr/local/mpc/1.0.3/include -I/usr/local/mpfr/3.1.4/include -I/usr/local/gmp/6.1.0/include -I/usr/local/cuda/8.0.44/include ./_calc_prob_lib.o ./home/zche3175/gan/VON/render_module/calc_prob/calc_prob/src/calc_prob.o /home/zche3175/gan/VON/render_module/calc_prob/calc_prob/src/calc_prob_kernel.cu.o -o ./_calc_prob_lib.so
/home/zche3175/gan/VON
(von) [zche3175@hpc223 VON]$

from von.

ztzhang avatar ztzhang commented on June 2, 2024

@wosecz It seems that the compilation is successful. And thanks for your advice! I'll add a success message after looking at the conflict issue.

from von.

wosecz avatar wosecz commented on June 2, 2024

Thank you very much!

from von.

wosecz avatar wosecz commented on June 2, 2024

@ztzhang
Finally, I fix the problem by installing the newest OpenCV-python, load glibc 2.14, it works now.
But when I ran bash ./scripts/figures.sh 0 car df, another problem occurred:
image

image
Can you give me some advice about the Error: Segmentation fault (core dumped)?
I use 9 cpu, 45G memory, 1 gpu (v100).
Thank you for your help!

from von.

fukai001 avatar fukai001 commented on June 2, 2024

I have occur some error. All environments are satisfied with the requirement. GPU is NVIDIA GTX 1080Ti
The information of my environment:
Python 3.6.3 |Anaconda, Inc.| (default, Oct 13 2017, 12:02:49)
[GCC 7.2.0] on linux
Type "help", "copyright", "credits" or "license" for more information.

fukai@Ubuntu16:~/DeepLearning/pytorch_models/GAN-master/VON$ gcc -v
使用内建 specs。
COLLECT_GCC=gcc
COLLECT_LTO_WRAPPER=/usr/local/gcc-6.3/libexec/gcc/x86_64-pc-linux-gnu/6.3.0/lto-wrapper
目标:x86_64-pc-linux-gnu
配置为:../configure --prefix=/usr/local/gcc-6.3 --enable-threads=posix --disable-checking --disable-multilib --enable-languages=c,c++ --with-gmp=/usr/local/gmp-6.1.2 --with-mpfr=/usr/local/mpfr-4.0.2 --with-mpc=/usr/local/mpc-1.1.0
线程模型:posix
gcc 版本 6.3.0 (GCC)

import torch
print(torch.version)
0.4.1

but, when I run "bash install.sh", the error is as follows:
Add -gencode to match all the GPU architectures you have.
Check 'https://en.wikipedia.org/wiki/CUDA#GPUs_supported' for list of architecture.
Check 'http://docs.nvidia.com/cuda/cuda-compiler-driver-nvcc/index.html' for GPU compilation based on architecture.
./setup.sh: 行 37: nvcc -std=c++11 -c -o vtn_cuda_kernel_generic.cu.o vtn_cuda_kernel_generic.cu -x cu -Xcompiler -fPIC -I ${TORCH}/lib/include/TH -I ${TO RCH}/lib/include -I ${TORCH}/lib/include/THC -I ${HERE} -gencode arch=compute_30,code=sm_30 -gencode arch=compute_35,code=sm_35 -gencode arch=compute_52,code=sm_52 -gencode arch=compute_61,code=sm_61 : 错误的替换
python: can't open file 'build.py': [Errno 2] No such file or directory
Add -gencode to match all the GPU architectures you have.
Check 'https://en.wikipedia.org/wiki/CUDA#GPUs_supported' for list of architecture.
Check 'http://docs.nvidia.com/cuda/cuda-compiler-driver-nvcc/index.html' for GPU compilation based on architecture.
nvcc -std=c++11 -c -o calc_prob_kernel.cu.o calc_prob_kernel.cu -x cu -Xcompiler -fPIC -I /home/fukai/Install/anaconda3/envs/von/lib/python3.7/site-packages/torch/lib/include/TH -I /home/fukai/Install/anaconda3/envs/von/lib/python3.7/site-packages/torch/lib/inclu de -I /home/fukai/Install/anaconda3/envs/von/lib/python3.7/site-packages/torch/lib/include/THC -I /home/fukai/DeepLearning/pytorch_models/GAN-master/VON/render_module/calc_prob/calc_prob/src -gencode arch=compute_30,code=sm_30 -gencode arch=compute_35,code=sm_35 -gencode arch=compute_52,code=sm_52 -gencode arch=compute_61,code=sm_61
nvcc fatal : A single input file is required for a non-link phase when an outputfile is specified
/home/fukai/DeepLearning/pytorch_models/GAN-master/VON/render_module/calc_prob
generating /tmp/tmpqu_t1kc3/_calc_prob_lib.c
setting the current directory to '/tmp/tmpqu_t1kc3'
running build_ext
building '_calc_prob_lib' extension
creating home
creating home/fukai
creating home/fukai/DeepLearning
creating home/fukai/DeepLearning/pytorch_models
creating home/fukai/DeepLearning/pytorch_models/GAN-master
creating home/fukai/DeepLearning/pytorch_models/GAN-master/VON
creating home/fukai/DeepLearning/pytorch_models/GAN-master/VON/render_module
creating home/fukai/DeepLearning/pytorch_models/GAN-master/VON/render_module/calc_prob
creating home/fukai/DeepLearning/pytorch_models/GAN-master/VON/render_module/calc_prob/calc_prob
creating home/fukai/DeepLearning/pytorch_models/GAN-master/VON/render_module/calc_prob/calc_prob/src
gcc -pthread -B /home/fukai/Install/anaconda3/envs/von/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DWITH_CUDA=True -I/home/fukai/Install/anaconda3/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include -I/home/fukai/Install/anaconda3/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include/TH -I/home/fukai/Install/anaconda3/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include/THC -I/usr/local/cuda/include -I/home/fukai/DeepLearning/pytorch_models/GAN-master/VON/render_module/calc_prob/calc_prob/src -I/home/fukai/Install/anaconda3/envs/von/include/python3.7m -c _calc_prob_lib.c -o ./_calc_prob_lib.o -std=c99
gcc -pthread -B /home/fukai/Install/anaconda3/envs/von/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DWITH_CUDA=True -I/home/fukai/Install/anaconda3/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include -I/home/fukai/Install/anaconda3/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include/TH -I/home/fukai/Install/anaconda3/envs/von/lib/python3.7/site-packages/torch/utils/ffi/../../lib/include/THC -I/usr/local/cuda/include -I/home/fukai/DeepLearning/pytorch_models/GAN-master/VON/render_module/calc_prob/calc_prob/src -I/home/fukai/Install/anaconda3/envs/von/include/python3.7m -c /home/fukai/DeepLearning/pytorch_models/GAN-master/VON/render_module/calc_prob/calc_prob/src/calc_prob.c -o ./home/fukai/DeepLearning/pytorch_models/GAN-master/VON/render_module/calc_prob/calc_prob/src/calc_prob.o -std=c99
gcc -pthread -shared -B /home/fukai/Install/anaconda3/envs/von/compiler_compat -L/home/fukai/Install/anaconda3/envs/von/lib -Wl,-rpath=/home/fukai/Install/anaconda3/envs/von/lib -Wl,--no-as-needed -Wl,--sysroot=/ ./_calc_prob_lib.o ./home/fukai/DeepLearning/pytorch_models/GAN-master/VON/render_module/calc_prob/calc_prob/src/calc_prob.o /home/fukai/DeepLearning/pytorch_models/GAN-master/VON/render_module/calc_prob/calc_prob/src/calc_prob_kernel.cu.o -o ./_calc_prob_lib.so
gcc: 错误:/home/fukai/DeepLearning/pytorch_models/GAN-master/VON/render_module/calc_prob/calc_prob/src/calc_prob_kernel.cu.o:没有那个文件或目录
Traceback (most recent call last):
File "/home/fukai/Install/anaconda3/envs/von/lib/python3.7/distutils/unixccompiler.py", line 197, in link
self.spawn(linker + ld_args)
File "/home/fukai/Install/anaconda3/envs/von/lib/python3.7/distutils/ccompiler.py", line 909, in spawn
spawn(cmd, dry_run=self.dry_run)
File "/home/fukai/Install/anaconda3/envs/von/lib/python3.7/distutils/spawn.py", line 36, in spawn
_spawn_posix(cmd, search_path, dry_run=dry_run)
File "/home/fukai/Install/anaconda3/envs/von/lib/python3.7/distutils/spawn.py", line 159, in _spawn_posix
% (cmd, exit_status))
distutils.errors.DistutilsExecError: command 'gcc' failed with exit status 1

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/home/fukai/Install/anaconda3/envs/von/lib/python3.7/site-packages/cffi/ffiplatform.py", line 51, in _build
dist.run_command('build_ext')
File "/home/fukai/Install/anaconda3/envs/von/lib/python3.7/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/home/fukai/Install/anaconda3/envs/von/lib/python3.7/distutils/command/build_ext.py", line 339, in run
self.build_extensions()
File "/home/fukai/Install/anaconda3/envs/von/lib/python3.7/distutils/command/build_ext.py", line 448, in build_extensions
self._build_extensions_serial()
File "/home/fukai/Install/anaconda3/envs/von/lib/python3.7/distutils/command/build_ext.py", line 473, in _build_extensions_serial
self.build_extension(ext)
File "/home/fukai/Install/anaconda3/envs/von/lib/python3.7/distutils/command/build_ext.py", line 558, in build_extension
target_lang=language)
File "/home/fukai/Install/anaconda3/envs/von/lib/python3.7/distutils/ccompiler.py", line 717, in link_shared_object
extra_preargs, extra_postargs, build_temp, target_lang)
File "/home/fukai/Install/anaconda3/envs/von/lib/python3.7/distutils/unixccompiler.py", line 199, in link
raise LinkError(msg)
distutils.errors.LinkError: command 'gcc' failed with exit status 1

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "build.py", line 42, in
ffi.build()
File "/home/fukai/Install/anaconda3/envs/von/lib/python3.7/site-packages/torch/utils/ffi/init.py", line 189, in build
_build_extension(ffi, cffi_wrapper_name, target_dir, verbose)
File "/home/fukai/Install/anaconda3/envs/von/lib/python3.7/site-packages/torch/utils/ffi/init.py", line 111, in _build_extension
outfile = ffi.compile(tmpdir=tmpdir, verbose=verbose, target=libname)
File "/home/fukai/Install/anaconda3/envs/von/lib/python3.7/site-packages/cffi/api.py", line 697, in compile
compiler_verbose=verbose, debug=debug, **kwds)
File "/home/fukai/Install/anaconda3/envs/von/lib/python3.7/site-packages/cffi/recompiler.py", line 1520, in recompile
compiler_verbose, debug)
File "/home/fukai/Install/anaconda3/envs/von/lib/python3.7/site-packages/cffi/ffiplatform.py", line 22, in compile
outputfilename = _build(tmpdir, ext, compiler_verbose, debug)
File "/home/fukai/Install/anaconda3/envs/von/lib/python3.7/site-packages/cffi/ffiplatform.py", line 58, in _build
raise VerificationError('%s: %s' % (e.class.name, e))
cffi.error.VerificationError: LinkError: command 'gcc' failed with exit status 1
/home/fukai/DeepLearning/pytorch_models/GAN-master/VON

gcc: 错误:/home/fukai/DeepLearning/pytorch_models/GAN-master/VON/render_module/calc_prob
It seems the gcc error, but there is no problem with the gcc.
fukai@Ubuntu16:/DeepLearning/pytorch_models/GAN-master/VON$ cat /usr/local/cuda/version.txt
CUDA Version 8.0.61
fukai@Ubuntu16:
/DeepLearning/pytorch_models/GAN-master/VON$ cat /usr/local/cuda/include/cudnn.h | grep CUDNN_MAJOR -A 2
#define CUDNN_MAJOR 6
#define CUDNN_MINOR 0
#define CUDNN_PATCHLEVEL 21

#define CUDNN_VERSION (CUDNN_MAJOR * 1000 + CUDNN_MINOR * 100 + CUDNN_PATCHLEVEL)

#include "driver_types.h"
fukai@Ubuntu16:~/DeepLearning/pytorch_models/GAN-master/VON$ nvcc -V
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2016 NVIDIA Corporation
Built on Tue_Jan_10_13:22:03_CST_2017
Cuda compilation tools, release 8.0, V8.0.61

from von.

ztzhang avatar ztzhang commented on June 2, 2024

@wosecz @fukai001 to make the kernel compilation more robust, I've added a dockerfile. It would be great if you could refer to https://github.com/junyanz/VON#installation and test if it works for you.

from von.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.