floydhub / dl-docker Goto Github PK
View Code? Open in Web Editor NEWAn all-in-one Docker image for deep learning. Contains all the popular DL frameworks (TensorFlow, Theano, Torch, Caffe, etc.)
Home Page: https://www.floydhub.com
dl-docker's People
Stargazers
Watchers
Forkers
jeffstokes72 mikhail-m fw1121 ctgushiwei little1tow giserh tdglobalnews logan-lu wombatpm pbamotra wanjinchang dockernuts zhang365947064 bodyk sszzsupersupersupersuper ellerbrock somaticapi cchongxd chagge thomasdic2000 minkvsky fage2016 deviffy shagunsodhani davinirjr carlesm therockstardba jamesbev qdrk kuixu baowenbo arikusu liyong3forever josemarcosrf hedgefair huskyeder jjsong vheaffinitech dev-alex-alex2006hw mercileesb sadeus chenglongchen ml-lab sijoyjoseph caplu neilyaoyww wangxuebin maksim-s yixf-self hpplinux qgzang goodrahstar huleg abhashkumar hmlatapie roshanraj user01 sthysel-freight matrixy emecas aung2phyowai hyzcn appliedml hitluobin bakfoo halisyilboga1 fmfn kostyaev ericeiffel poliflix yanleirex codeaudit shyamsukhamit gyanta bytes256 ana2s007 meadowhb g-wang furyphoenix djoffrey phoenix1796 allankevinrichie rohan0401 dhlee421 sbc clear-datacenter xsongx miguelperalvo jeremy-rutman ringwraith csjunxu shashankg7 quevedin prvn16 mikkab neodyme60 zspasztori anilcs13m mistobaan pinekingdl-docker's Issues
GPU version not building with OpenCV '-DBUILD_EXAMPLES=ON' CMake-option
Hello,
The Dockerfile.gpu build failed at step 29 when building OpenCV with option
-DBUILD_EXAMPLES=ON
When I change line 227 with following option
-DBUILD_EXAMPLES=OFF
, it builds.
I'm getting following error
CMake Error: The following variables are used in this project, but they are set to NOTFOUND.
Please set them or make sure they are set and tested correctly in the CMake files:
CUDA_CUDA_LIBRARY (ADVANCED)
linked by target "example_gpu_alpha_comp" in directory /root/opencv/samples/gpu
linked by target "example_gpu_bgfg_segm" in directory /root/opencv/samples/gpu
linked by target "example_gpu_cascadeclassifier" in directory /root/opencv/samples/gpu
linked by target "example_gpu_cascadeclassifier_nvidia_api" in directory /root/opencv/samples/gpu
linked by target "example_gpu_driver_api_multi" in directory /root/opencv/samples/gpu
linked by target "example_gpu_driver_api_stereo_multi" in directory /root/opencv/samples/gpu
linked by target "example_gpu_farneback_optical_flow" in directory /root/opencv/samples/gpu
linked by target "example_gpu_generalized_hough" in directory /root/opencv/samples/gpu
linked by target "example_gpu_hog" in directory /root/opencv/samples/gpu
linked by target "example_gpu_houghlines" in directory /root/opencv/samples/gpu
linked by target "example_gpu_morphology" in directory /root/opencv/samples/gpu
linked by target "example_gpu_multi" in directory /root/opencv/samples/gpu
linked by target "example_gpu_opengl" in directory /root/opencv/samples/gpu
linked by target "example_gpu_optical_flow" in directory /root/opencv/samples/gpu
linked by target "example_gpu_opticalflow_nvidia_api" in directory /root/opencv/samples/gpu
linked by target "example_gpu_pyrlk_optical_flow" in directory /root/opencv/samples/gpu
linked by target "example_gpu_stereo_match" in directory /root/opencv/samples/gpu
linked by target "example_gpu_stereo_multi" in directory /root/opencv/samples/gpu
linked by target "example_gpu_super_resolution" in directory /root/opencv/samples/gpu
linked by target "example_gpu_surf_keypoint_matcher" in directory /root/opencv/samples/gpu
linked by target "example_gpu_video_reader" in directory /root/opencv/samples/gpu
linked by target "example_gpu_video_writer" in directory /root/opencv/samples/gpu
-- Configuring incomplete, errors occurred!
See also "/root/opencv/build/CMakeFiles/CMakeOutput.log".
See also "/root/opencv/build/CMakeFiles/CMakeError.log".
The command '/bin/sh -c git clone --depth 1 https://github.com/opencv/opencv.git /root/opencv && cd /root/opencv && mkdir build && cd build && cmake -DWITH_QT=ON -DWITH_OPENGL=ON -DFORCE_VTK=ON -DWITH_TBB=ON -DWITH_GDAL=ON -DWITH_XINE=ON -DBUILD_EXAMPLES=ON .. && make -j"$(nproc)" && make install && ldconfig && echo 'ln /dev/null /dev/raw1394' >> ~/.bashrc' returned a non-zero code: 1Tensorboard failed to run. [solved on running container]
Hi all,
I tried to run tensorboard on my docker build (I excluded opencv because it fails and I don't need it).
I came into this exception running tensorboard --logdir foo/
I had the attached Traceback.
I solved the issue, using this solution coursera-dl/coursera-dl#554 and running
pip install --upgrade html5lib==1.0b8So I think I need to update my Dockerfile to include this lib.
Traceback (most recent call last):
File "/usr/local/bin/tensorboard", line 7, in <module>
from tensorflow.tensorboard.tensorboard import main
File "/usr/local/lib/python2.7/dist-packages/tensorflow/tensorboard/tensorboard.py", line 34, in <module>
from tensorflow.tensorboard.backend import server
File "/usr/local/lib/python2.7/dist-packages/tensorflow/tensorboard/backend/server.py", line 37, in <module>
from tensorflow.tensorboard.backend import handler
File "/usr/local/lib/python2.7/dist-packages/tensorflow/tensorboard/backend/handler.py", line 43, in <module>
from tensorflow.tensorboard.plugins import REGISTERED_PLUGINS
File "/usr/local/lib/python2.7/dist-packages/tensorflow/tensorboard/plugins/__init__.py", line 20, in <module>
from tensorflow.tensorboard.plugins.projector.plugin import ProjectorPlugin
File "/usr/local/lib/python2.7/dist-packages/tensorflow/tensorboard/plugins/projector/plugin.py", line 27, in <module>
from tensorflow.contrib.tensorboard.plugins.projector import PROJECTOR_FILENAME
File "/usr/local/lib/python2.7/dist-packages/tensorflow/contrib/__init__.py", line 27, in <module>
from tensorflow.contrib import factorization
File "/usr/local/lib/python2.7/dist-packages/tensorflow/contrib/factorization/__init__.py", line 24, in <module>
from tensorflow.contrib.factorization.python.ops.gmm import *
File "/usr/local/lib/python2.7/dist-packages/tensorflow/contrib/factorization/python/ops/gmm.py", line 30, in <module>
from tensorflow.contrib.learn.python.learn.estimators import estimator
File "/usr/local/lib/python2.7/dist-packages/tensorflow/contrib/learn/__init__.py", line 66, in <module>
from tensorflow.contrib.learn.python.learn import *
File "/usr/local/lib/python2.7/dist-packages/tensorflow/contrib/learn/python/__init__.py", line 23, in <module>
from tensorflow.contrib.learn.python.learn import *
File "/usr/local/lib/python2.7/dist-packages/tensorflow/contrib/learn/python/learn/__init__.py", line 27, in <module>
from tensorflow.contrib.learn.python.learn import estimators
File "/usr/local/lib/python2.7/dist-packages/tensorflow/contrib/learn/python/learn/estimators/__init__.py", line 269, in <module>
from tensorflow.contrib.learn.python.learn.estimators.classifier import Classifier
File "/usr/local/lib/python2.7/dist-packages/tensorflow/contrib/learn/python/learn/estimators/classifier.py", line 25, in <module>
from tensorflow.contrib.learn.python.learn.estimators import estimator
File "/usr/local/lib/python2.7/dist-packages/tensorflow/contrib/learn/python/learn/estimators/estimator.py", line 52, in <module>
from tensorflow.contrib.learn.python.learn.learn_io import data_feeder
File "/usr/local/lib/python2.7/dist-packages/tensorflow/contrib/learn/python/learn/learn_io/__init__.py", line 33, in <module>
from tensorflow.contrib.learn.python.learn.learn_io.pandas_io import extract_pandas_data
File "/usr/local/lib/python2.7/dist-packages/tensorflow/contrib/learn/python/learn/learn_io/pandas_io.py", line 23, in <module>
from tensorflow.contrib.learn.python.learn.dataframe.queues import feeding_functions
File "/usr/local/lib/python2.7/dist-packages/tensorflow/contrib/learn/python/learn/dataframe/__init__.py", line 26, in <module>
from tensorflow.contrib.learn.python.learn.dataframe.tensorflow_dataframe import TensorFlowDataFrame
File "/usr/local/lib/python2.7/dist-packages/tensorflow/contrib/learn/python/learn/dataframe/tensorflow_dataframe.py", line 31, in <module>
from tensorflow.contrib.learn.python.learn.dataframe.transforms import in_memory_source
File "/usr/local/lib/python2.7/dist-packages/tensorflow/contrib/learn/python/learn/dataframe/transforms/in_memory_source.py", line 22, in <module>
from tensorflow.contrib.learn.python.learn.dataframe.queues import feeding_functions
File "/usr/local/lib/python2.7/dist-packages/tensorflow/contrib/learn/python/learn/dataframe/queues/feeding_functions.py", line 38, in <module>
import pandas as pd
File "/usr/lib/python2.7/dist-packages/pandas/__init__.py", line 44, in <module>
from pandas.io.api import *
File "/usr/lib/python2.7/dist-packages/pandas/io/api.py", line 10, in <module>
from pandas.io.html import read_html
File "/usr/lib/python2.7/dist-packages/pandas/io/html.py", line 25, in <module>
import bs4
File "/usr/lib/python2.7/dist-packages/bs4/__init__.py", line 29, in <module>
from .builder import builder_registry
File "/usr/lib/python2.7/dist-packages/bs4/builder/__init__.py", line 306, in <module>
from . import _html5lib
File "/usr/lib/python2.7/dist-packages/bs4/builder/_html5lib.py", line 57, in <module>
class TreeBuilderForHtml5lib(html5lib.treebuilders._base.TreeBuilder):
AttributeError: 'module' object has no attribute '_base'W: Failed to fetch http://ppa.launchpad.net/jtaylor/ipython/ubuntu/dists/trusty/main/binary-amd64/Packages Hash Sum mismatch
้่ฏฏ1๏ผ
Get:3 http://archive.ubuntu.com/ubuntu/ trusty-updates/universe python-software-properties all 0.92.37.7 [19.6 kB]
debconf: unable to initialize frontend: Dialog
debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.)
debconf: falling back to frontend: Readline
debconf: unable to initialize frontend: Readline
debconf: (This frontend requires a controlling tty.)
debconf: falling back to frontend: Teletype
dpkg-preconfigure: unable to re-open stdin:
่งฃๅณๆนๆก๏ผ
ๆๆ่ฎพไบ็ฏๅขๅ้DEBIAN_FRONTEND=noninteractiveๅดๅคฑๆไบ๏ผ่งฃๅณๆนๆณๅฆไธ๏ผ
F1๏ผ sudo apt-get install dialog ๆ sudo apt-get install whiptail๏ผ่ฏไบๆฒก็จ๏ผ
F2๏ผ sudo dpkg-reconfigure debconf ๆๅจ้noninteractive๏ผ็บงๅซ้high
้่ฏฏ2๏ผ
==> Found Ubuntu version 14.xx
gpg: keyring /tmp/tmpjn9rgx44/secring.gpg' created gpg: keyring/tmp/tmpjn9rgx44/pubring.gpg' created
gpg: requesting key 58B80F90 from hkp server keyserver.ubuntu.com
gpg: /tmp/tmpjn9rgx44/trustdb.gpg: trustdb created
gpg: key 58B80F90: public key "Launchpad PPA for Julian Taylor" imported
gpg: Total number processed: 1
gpg: imported: 1 (RSA: 1)
OK
้่ฏฏ3๏ผ
W: Failed to fetch http://ppa.launchpad.net/jtaylor/ipython/ubuntu/dists/trusty/main/binary-amd64/Packages Hash Sum mismatch
E: Some index files failed to download. They have been ignored, or old ones used instead.
Sharedfolder & Notebook
- I've a directory "sharedfolder" created on Windows 7?
- There is TensorFlow Jupyter Notebook content in it.
Unfortunately....
docker run -it -p 192.168.99.100:8888:8888 -p 192.168.99.100:6006:6006 -v /sharedfolder:/root/sharedfolder floydhub/dl-docker:cpu jupyter notebook
...shows an empty "sharedfolder"- directory in the browser under http://192.168.99.100:8888/tree/sharedfolder.
But I know the Notebook is functional.
Please help. What to do?
Turns out Docker on Win needs a special syntax....
docker run -it -p 192.168.99.100:8888:8888 -p 192.168.99.100:6006:6006 -v //c/Users/PornJunky/sharedfolder:/root/sharedfolder floydhub/dl-docker:cpu jupyter notebook
ImportError: libcudart.so.7.5: cannot open shared object file
I received this message when trying to import keras right after launching the container.
I changed the first line of my gpu dockerfile to use cuda 7.5 and it seems to have fixed the problem:
FROM nvidia/cuda:7.5-cudnn5-devel
Maybe related to this?:
building the GPU Version
I get an error when Trying to build the docker container for GPU.
"docker build" requires one argument only .
sudo docker build -t floydhub/dl-docker:gpu -f Dockerfile.gpu
Unable to use GPU with Theano
I built your docker for gpu with the provided info in the README. Then when I use the command to launch the docker, it runs fine.
In a new notebook, I simply type import theano and I get the following error :
ERROR (theano.sandbox.cuda): ERROR: Not using GPU. Initialisation of device gpu failed:
initCnmem: cnmemInit call failed! Reason=CNMEM_STATUS_OUT_OF_MEMORY. numdev=1
What am I doing wrong ?
I then tested the cpu version, theano and Keras are working just fine.
Running on kubernetes?
I want to run it on kubernetes , anyone try?
Jupyter Kernel Restarting
Using the original docker image CPU version, jupyter keep restarting util Status 410 .
if Running
docker run with command "jupyter notebook"
However, no problem if docker run bash and juypter notebook inside.
debug info as:
[D 09:07:02.453 NotebookApp] 200 GET /static/base/images/favicon.ico?v=30780f272ab4aac64aa073a84154
6240 (10.10.1.14) 1.04ms
[D 09:07:02.661 NotebookApp] Initializing websocket connection /api/kernels/aa078a82-80ce-404e-a042
-d55af19ff806/channels
[D 09:07:02.666 NotebookApp] Requesting kernel info from aa078a82-80ce-404e-a042-d55af19ff806
[D 09:07:02.666 NotebookApp] Connecting to: tcp://127.0.0.1:55924
[I 09:07:05.146 NotebookApp] KernelRestarter: restarting kernel (1/5)
[D 09:07:05.147 NotebookApp] Starting kernel: [u'/usr/bin/python', u'-m', u'ipykernel', u'-f', u'/r
oot/.local/share/jupyter/runtime/kernel-aa078a82-80ce-404e-a042-d55af19ff806.json']
[D 09:07:05.151 NotebookApp] Connecting to: tcp://127.0.0.1:51770
[I 09:07:08.154 NotebookApp] KernelRestarter: restarting kernel (2/5)
[D 09:07:08.155 NotebookApp] Starting kernel: [u'/usr/bin/python', u'-m', u'ipykernel', u'-f', u'/r
oot/.local/share/jupyter/runtime/kernel-aa078a82-80ce-404e-a042-d55af19ff806.json']
[D 09:07:08.158 NotebookApp] Connecting to: tcp://127.0.0.1:51770
[I 09:07:11.161 NotebookApp] KernelRestarter: restarting kernel (3/5)
[D 09:07:11.161 NotebookApp] Starting kernel: [u'/usr/bin/python', u'-m', u'ipykernel', u'-f', u'/r
oot/.local/share/jupyter/runtime/kernel-aa078a82-80ce-404e-a042-d55af19ff806.json']
[D 09:07:11.165 NotebookApp] Connecting to: tcp://127.0.0.1:51770
[W 09:07:12.669 NotebookApp] Timeout waiting for kernel_info reply from aa078a82-80ce-404e-a042-d55
af19ff806
[D 09:07:12.670 NotebookApp] Opening websocket /api/kernels/aa078a82-80ce-404e-a042-d55af19ff806/ch
annels
[D 09:07:12.670 NotebookApp] Connecting to: tcp://127.0.0.1:55924
[D 09:07:12.671 NotebookApp] Connecting to: tcp://127.0.0.1:48445
[D 09:07:12.671 NotebookApp] Connecting to: tcp://127.0.0.1:48030
[I 09:07:14.166 NotebookApp] KernelRestarter: restarting kernel (4/5)
WARNING:root:kernel aa078a82-80ce-404e-a042-d55af19ff806 restarted
[D 09:07:14.167 NotebookApp] Starting kernel: [u'/usr/bin/python', u'-m', u'ipykernel', u'-f', u'/r
oot/.local/share/jupyter/runtime/kernel-aa078a82-80ce-404e-a042-d55af19ff806.json']
[D 09:07:14.171 NotebookApp] Connecting to: tcp://127.0.0.1:51770
[W 09:07:17.173 NotebookApp] KernelRestarter: restart failed
[W 09:07:17.173 NotebookApp] Kernel aa078a82-80ce-404e-a042-d55af19ff806 died, removing from map.
ERROR:root:kernel aa078a82-80ce-404e-a042-d55af19ff806 restarted failed!
[D 09:07:17.447 NotebookApp] Websocket closed aa078a82-80ce-404e-a042-d55af19ff806:87779D93702E4247
BD06F3D850663D80
[W 09:07:17.453 NotebookApp] Kernel deleted before session
[W 09:07:17.453 NotebookApp] 410 DELETE /api/sessions/afffdc73-07f9-471d-adfe-2b3504a9f8f1
Restarting Kernel
Hi!
Thank you for your great work.
I have an issue: After running the docker , as soon as i'm opening a new notebook i'm getting -
[I 20:09:17.475 NotebookApp] KernelRestarter: restarting kernel (1/5)
[I 20:09:20.483 NotebookApp] KernelRestarter: restarting kernel (2/5)
[I 20:09:23.492 NotebookApp] KernelRestarter: restarting kernel (3/5)
[W 20:09:24.508 NotebookApp] Timeout waiting for kernel_info reply from 164da2ec-1a99-4c09-9e0e-5f39a9a2ba56
[I 20:09:26.501 NotebookApp] KernelRestarter: restarting kernel (4/5)
WARNING:root:kernel 164da2ec-1a99-4c09-9e0e-5f39a9a2ba56 restarted
[W 20:09:29.506 NotebookApp] KernelRestarter: restart failed
I'm using the CPU mode.
Any idea what went wrong?
Thank you!
Gilad
Missing Theano, Lasagne in the image
Launched Jupyter, can't see Theano, Lasagne, Keras. What did I do wrong?
CPU version, installed via docker pull.
Among unusual stuff during installation was only that several packages already existed:
"mac ~ $ docker pull floydhub/dl-docker:cpu
cpu: Pulling from floydhub/dl-docker
6c953ac5d795: Already exists
3eed5ff20a90: Already exists
f8419ea7c1b5: Already exists
51900bc9e720: Already exists
a3ed95caeb02: Already exists
46bb9e850895: Pull complete
e07079b02cd9: Pull complete
45bd5a47614d: Pull complete
4ba5917b4dc5: Pull complete
e197926eeea3: Pull complete
376f5cc0ea36: Pull complete
590b9a27bdc2: Pull complete
4377eaedc7bc: Pull complete
ed3b9bf2301a: Pull complete
aac3c3ae382f: Pull complete
13397679ef8c: Pull complete
62d30df21bd1: Pull complete
3329da8ba1ff: Pull complete
669806fb3edd: Pull complete
43a371cb28cc: Pull complete
ffa9a85a3cc7: Pull complete "
Python 3 kernel to jupyter
Hi.
Why don't adding Python 3 kernel to jupyter?
In current docker container is installed python3. For use python3 kernel in juputer need execute next commands:
curl -O https://bootstrap.pypa.io/get-pip.py && \
python3 get-pip.py && \
rm get-pip.py
pip3 install jupyter
ipython3 kernelspec install-selfseems to be an error in command string
command like
docker run -it -p 8888:8888 6006:6006 -v /sharedfolder:/root/sharedfolder dl-docker:cpu bash
doesn't work on my PC
docker run -it -p 8888:8888 -p 6006:6006 -v /sharedfolder:/root/sharedfolder dl-docker:cpu bash
works.
Please check this on README.md
Error: unsupported CUDA version: driver 7.5 < image 8.0
Hi,
I am new to Docker. I get the following error message.
nvidia-docker | 2017/01/18 05:11:26 Error: unsupported CUDA version: driver 7.5 < image 8.0
Isn't CUDA 8.0 included in this docker container?
regards
skbhat
CUDA_CUDA_LIBRARY NOTFOUND fix
I had an issue while building from the GPU Dockerfile that CUDA_CUDA_LIBRARY was set to NOTFOUND.
There is a pull request that fixes this (#48), however it is not merged into master yet.
I found the solution in opencv/opencv#6577, which was to add
-DCMAKE_LIBRARY_PATH=/usr/local/cuda/lib64/stubs,
to the cmake command while installing OpenCV.
Specific error:
See also "/root/opencv/build/CMakeFiles/CMakeOutput.log".
See also "/root/opencv/build/CMakeFiles/CMakeError.log".
CMake Error: The following variables are used in this project, but they are set to NOTFOUND.
Please set them or make sure they are set and tested correctly in the CMake files:
CUDA_CUDA_LIBRARY (ADVANCED)
linked by target "example_gpu_alpha_comp" in directory /root/opencv/samples/gpu
linked by target "example_gpu_bgfg_segm" in directory /root/opencv/samples/gpu
linked by target "example_gpu_cascadeclassifier" in directory /root/opencv/samples/gpu
linked by target "example_gpu_cascadeclassifier_nvidia_api" in directory /root/opencv/samples/gpu
linked by target "example_gpu_driver_api_multi" in directory /root/opencv/samples/gpu
linked by target "example_gpu_driver_api_stereo_multi" in directory /root/opencv/samples/gpu
linked by target "example_gpu_farneback_optical_flow" in directory /root/opencv/samples/gpu
linked by target "example_gpu_generalized_hough" in directory /root/opencv/samples/gpu
linked by target "example_gpu_hog" in directory /root/opencv/samples/gpu
linked by target "example_gpu_houghlines" in directory /root/opencv/samples/gpu
linked by target "example_gpu_morphology" in directory /root/opencv/samples/gpu
linked by target "example_gpu_multi" in directory /root/opencv/samples/gpu
linked by target "example_gpu_opengl" in directory /root/opencv/samples/gpu
linked by target "example_gpu_optical_flow" in directory /root/opencv/samples/gpu
linked by target "example_gpu_opticalflow_nvidia_api" in directory /root/opencv/samples/gpu
linked by target "example_gpu_pyrlk_optical_flow" in directory /root/opencv/samples/gpu
linked by target "example_gpu_stereo_match" in directory /root/opencv/samples/gpu
linked by target "example_gpu_stereo_multi" in directory /root/opencv/samples/gpu
linked by target "example_gpu_super_resolution" in directory /root/opencv/samples/gpu
linked by target "example_gpu_surf_keypoint_matcher" in directory /root/opencv/samples/gpu
linked by target "example_gpu_video_reader" in directory /root/opencv/samples/gpu
linked by target "example_gpu_video_writer" in directory /root/opencv/samples/gpu
The command '/bin/sh -c git clone --depth 1 https://github.com/opencv/opencv.git /root/opencv && cd /root/opencv && mkdir build && cd build && cmake -DWITH_QT=ON -DWITH_OPENGL=ON -DFORCE_VTK=ON -DWITH_TBB=ON -DWITH_GDAL=ON -DWITH_XINE=ON -DBUILD_EXAMPLES=ON .. && make -j"$(nproc)" && make install && ldconfig && echo 'ln /dev/null /dev/raw1394' >> ~/.bashrc' returned a non-zero code: 1
Error with torch + cudnn
Hi Sai,
When running the torch/test.sh script torch complains that:
/root/torch/install/bin/luajit: /root/torch/install/share/lua/5.1/cudnn/ffi.lua:1278: 'libcudnn (R4) not found in library path.
Please install CuDNN from https://developer.nvidia.com/cuDNN
Then make sure files named as libcudnn.so.4 or libcudnn.4.dylib are placed in your library load path (for example /usr/local/lib , or manually add a path to LD_LIBRARY_PATH)
stack traceback:
[C]: in function 'error'
/root/torch/install/share/lua/5.1/cudnn/ffi.lua:1278: in main chunk
[C]: in function 'require'
/root/torch/install/share/lua/5.1/cudnn/init.lua:4: in main chunk
[C]: at 0x0046b7a0
[C]: at 0x00406670
I look for libcudnn4 but instead I find libcudnn5:
root@eaf76f3:~/torch# find / -name "libcudnn"
/var/lib/dpkg/info/libcudnn5-dev.postinst
/var/lib/dpkg/info/libcudnn5-dev.md5sums
/var/lib/dpkg/info/libcudnn5-dev.prerm
/var/lib/dpkg/info/libcudnn5-dev.list
/usr/share/lintian/overrides/libcudnn5-dev
/usr/share/doc/libcudnn5-dev
/usr/lib/x86_64-linux-gnu/libcudnn_static_v5.a
/usr/local/cuda-8.0/targets/x86_64-linux/lib/libcudnn.so.5.1.5
/usr/local/cuda-8.0/targets/x86_64-linux/lib/libcudnn.so
/usr/local/cuda-8.0/targets/x86_64-linux/lib/libcudnn_static.a
/usr/local/cuda-8.0/targets/x86_64-linux/lib/libcudnn.so.5*
Maybe this isn't a conflict but when I update by LD_LIBRARY_PATH I still get errors:
cunn loaded succesfully
cudnn loaded succesfully
seed: 1484708833
Running 172 tests
1/172 tan2 ............................................................ [WAIT]THCudaCheck FAIL file=/tmp/luarocks_cutorch-scm-1-5894/cutorch/lib/THC/generated/../generic/THCTensorMathPointwise.cu line=54 error=8 : invalid device function
1/172 tan2 ............................................................ [ERROR]
2/172 cat ............................................................. [ERROR]
3/172 neg1 ............................................................ [ERROR]
4/172 atan2 ........................................................... [ERROR]
5/172 acos1 ........................................................... [ERROR]
6/172 restore_rng ..................................................... [FAIL]
7/172 streamWaitFor ................................................... [ERROR]
8/172 acos2 ........................................................... [ERROR]
9/172 zero ............................................................ [PASS]
10/172 logNormal ....................................................... [ERROR]
11/172 sqrt2 ........................................................... [ERROR]
12/172 pow1 ............................................................ [ERROR]
13/172 permute ......................................................... [PASS]
14/172 cross ........................................................... [PASS]
15/172 tensorToTable ................................................... [PASS]
16/172 inverse ......................................................... [ERROR]
17/172 sinh1 ........................................................... [ERROR]
18/172 sign1 ........................................................... [ERROR]
19/172 min ............................................................. [ERROR]
20/172 clamp4 .......................................................... [ERROR]
21/172 ger ............................................................. [PASS]
22/172 addmm ........................................................... [ERROR]
23/172 addmv ........................................................... [PASS]
24/172 random_seed ..................................................... [FAIL]
25/172 lerp ............................................................ [ERROR]
26/172 sigmoid2 ........................................................ [ERROR]
27/172 log1p1 .......................................................... [ERROR]
28/172 sinh2 ........................................................... [ERROR]
29/172 bernoulli ....................................................... [ERROR]
30/172 cremainder ...................................................... [PASS]
31/172 round1 .......................................................... [ERROR]
32/172 geometric ....................................................... [ERROR]
33/172 maskedCopy ...................................................... [ERROR]
34/172 indexCopy ....................................................... [ERROR]
35/172 frac2 ........................................................... [ERROR]
36/172 baddbmm ......................................................... [ERROR]
37/172 floor2 .......................................................... [ERROR]
38/172 sum ............................................................. [ERROR]
39/172 indexCopy2 ...................................................... [ERROR]
40/172 cudaTypeCopy .................................................... [ERROR]
41/172 cmul ............................................................ [ERROR]
42/172 streamBarrier ................................................... [ERROR]
43/172 cos1 ............................................................ [ERROR]
44/172 indexAdd ........................................................ [ERROR]
45/172 isSetTo ......................................................... [PASS]
46/172 mean ............................................................ [ERROR]
47/172 multinomial_without_replacement_gets_all ........................ [ERROR]
48/172 logicalTensor ................................................... [ERROR]
49/172 cmin ............................................................ [ERROR]
50/172 sin1 ............................................................ [ERROR]
51/172 mm .............................................................. [ERROR]
52/172 ceil2 ........................................................... [ERROR]
53/172 cinv1 ........................................................... [ERROR]
54/172 multinomial_without_replacement ................................. [ERROR]
55/172 triu ............................................................ [ERROR]
56/172 repeatTensor .................................................... [ERROR]
57/172 round2 .......................................................... [ERROR]
58/172 get_device ...................................................... [PASS]
59/172 elementSize ..................................................... [PASS]
60/172 log2 ............................................................ [ERROR]
61/172 cosh1 ........................................................... [ERROR]
62/172 csub ............................................................ [ERROR]
63/172 index ........................................................... [ERROR]
64/172 log1p2 .......................................................... [ERROR]
65/172 viewAs .......................................................... [ERROR]
66/172 add ............................................................. [ERROR]
67/172 std ............................................................. [ERROR]
68/172 log1 ............................................................ [ERROR]
69/172 kernelP2PAccess ................................................. [PASS]
70/172 tril ............................................................ [ERROR]
71/172 maskedSelect .................................................... [ERROR]
72/172 renorm .......................................................... [ERROR]
73/172 rsqrt ........................................................... [PASS]
74/172 scatter ......................................................... [ERROR]
75/172 addbmm .......................................................... [ERROR]
76/172 remainder ....................................................... [ERROR]
77/172 cinv2 ........................................................... [ERROR]
78/172 cudaHostTensor .................................................. [ERROR]
79/172 tanh1 ........................................................... [ERROR]
80/172 zeros ........................................................... [ERROR]
81/172 indexFill2 ...................................................... [ERROR]
82/172 copyNoncontiguous ............................................... [ERROR]
83/172 copyRandomizedTest .............................................. [ERROR]
84/172 streamWaitForMultiDevice ........................................ [PASS]
85/172 exp1 ............................................................ [ERROR]
86/172 copyAsync ....................................................... [ERROR]
87/172 trunc2 .......................................................... [ERROR]
88/172 clamp2 .......................................................... [ERROR]
89/172 dist ............................................................ [ERROR]
90/172 atan1 ........................................................... [ERROR]
91/172 multinomial_vector .............................................. [ERROR]
92/172 cudaStorageTypeCopy ............................................. [ERROR]
93/172 cdiv ............................................................ [ERROR]
94/172 trunc1 .......................................................... [ERROR]
95/172 catArrayBatched ................................................. [ERROR]
96/172 sqrt1 ........................................................... [ERROR]
97/172 clamp1 .......................................................... [ERROR]
98/172 cosh2 ........................................................... [ERROR]
99/172 cudaEvent ....................................................... [ERROR]
100/172 multi_gpu_copy_noncontig ........................................ [ERROR]
101/172 sign3 ........................................................... [ERROR]
102/172 equal ........................................................... [ERROR]
103/172 bmm ............................................................. [ERROR]
104/172 scatterFill ..................................................... [ERROR]
105/172 storageToTable .................................................. [ERROR]
106/172 pow2 ............................................................ [ERROR]
107/172 bmmTransposed ................................................... [ERROR]
108/172 sigmoid1 ........................................................ [ERROR]
109/172 normal .......................................................... [ERROR]
110/172 maskedFill ...................................................... [ERROR]
111/172 exp2 ............................................................ [ERROR]
112/172 topk ............................................................ [ERROR]
113/172 allAndAny ....................................................... [ERROR]
114/172 var ............................................................. [ERROR]
115/172 trace ........................................................... [ERROR]
116/172 catArray ........................................................ [ERROR]
117/172 cumsum .......................................................... [ERROR]
118/172 cauchy .......................................................... [ERROR]
119/172 chunk ........................................................... [ERROR]
120/172 abs2 ............................................................ [ERROR]
121/172 multi_gpu_random ................................................ [ERROR]
122/172 indexFill ....................................................... [ERROR]
123/172 sin2 ............................................................ [ERROR]
124/172 squeeze ......................................................... [ERROR]
125/172 abs1 ............................................................ [ERROR]
126/172 floor1 .......................................................... [ERROR]
127/172 cdiv3 ........................................................... [ERROR]
128/172 reshape ......................................................... [ERROR]
129/172 addcmul ......................................................... [ERROR]
130/172 uniform ......................................................... [ERROR]
131/172 isSize .......................................................... [PASS]
132/172 baddbmmTransposed ............................................... [ERROR]
133/172 logicalValue .................................................... [ERROR]
134/172 tan1 ............................................................ [ERROR]
135/172 asin2 ........................................................... [ERROR]
136/172 norm ............................................................ [ERROR]
137/172 prod ............................................................ [ERROR]
138/172 largeNoncontiguous .............................................. [ERROR]
139/172 isSameSizeAs .................................................... [PASS]
140/172 powExponentTensor ............................................... [ERROR]
141/172 gather .......................................................... [ERROR]
142/172 cumprod ......................................................... [ERROR]
143/172 cpow ............................................................ [ERROR]
144/172 clamp3 .......................................................... [ERROR]
145/172 max ............................................................. [ERROR]
146/172 nonzero ......................................................... [ERROR]
147/172 cmax ............................................................ [ERROR]
148/172 fmod ............................................................ [ERROR]
149/172 expand .......................................................... [ERROR]
150/172 asin1 ........................................................... [ERROR]
151/172 neg2 ............................................................ [ERROR]
152/172 cos2 ............................................................ [ERROR]
153/172 frac1 ........................................................... [ERROR]
154/172 sign2 ........................................................... [ERROR]
155/172 view ............................................................ [ERROR]
156/172 diag ............................................................ [ERROR]
157/172 fill ............................................................ [ERROR]
158/172 split ........................................................... [ERROR]
159/172 indexSelect2 .................................................... [ERROR]
160/172 addcdiv ......................................................... [ERROR]
161/172 streamBarrierMultiDevice ........................................ [PASS]
162/172 mv .............................................................. [ERROR]
163/172 cfmod ........................................................... [ERROR]
164/172 addr ............................................................ [ERROR]
165/172 tanh2 ........................................................... [ERROR]
166/172 exponential ..................................................... [ERROR]
167/172 ones ............................................................ [ERROR]
168/172 indexAddHalf .................................................... [ERROR]
169/172 sort ............................................................ [ERROR]
170/172 indexAdd2 ....................................................... [ERROR]
171/172 ceil1 ........................................................... [ERROR]
172/172 multinomial_with_replacement .................................... [ERROR]
Completed 344 asserts in 172 tests with 2 failures and 154 errors
Any idea what can be the problem? Your help is greatly appreciated. Thanks.
Tensorflow doesn't work after cuda update for some reason
I try to import tensorflow and it gives me this error:
Do you have any ideas why it searches for the old CUDA library?
Add CNTK
Torch fails to install on Ubuntu 16.04 LTS
When building the GPU image, I get the following error:
/bin/sh: 1: sudo: not found
The command '/bin/sh -c git clone https://github.com/torch/distro.git /root/torch --recursive && sudo cd /root/torch && bash install-deps && ./install.sh' returned a non-zero code: 127
I've checked this against the Torch documentation ezinstall and it appears that the commands are correct but it does not work: http://torch.ch/docs/getting-started.html#_
I commented out all Torch and Lua commands and the build finishes. Since I don't need Torch, this is no big deal, but if someone needs Torch it will prove troublesome.
Missing loadcaffe
module 'loadcaffe' not found:No LuaRocks module found for loadcaffe
ERROR occured when load pre-trained caffe networks.
I suggest we need to add loadcaffe to it.
[Warnings] Outdated Theano and numexpr versions
I have just started using the gpu docker image and receiving a number of warning messages about outdated version numbers.
I have yet to see affected performance, but I wanted to log them for you.
/usr/local/lib/python2.7/dist-packages/theano/sandbox/cuda/init.py:600: UserWarning: Your cuDNN version is more recent than the one Theano officially supports. If you see any problems, try updating Theano or downgrading cuDNN to version 5.
warnings.warn(warn)
/usr/local/lib/python2.7/dist-packages/pandas/core/computation/init.py:18: UserWarning: The installed version of numexpr 2.2.2 is not supported in pandas and will be not be used
The minimum supported version is 2.4.6
when import pandas as pd, there is error msg: importerror: cannot import name hashtable
when import pandas as pd, there is error msg:
importerror: cannot import name hashtable
"no display name and no $DISPLAY environment variable" Ubuntu 16.04
Hey,
I'm running Docker in Ubuntu 16.04. I built our GPU-based container. When I run it with:
sudo nvidia-docker run -it -p 8888:8888 -p 6006:6006 floydhub/dl-docker:gpu bash
and then run any Tensor flow commands in iPython or Jupyter Notebook, for example:
# Import MINST data
from tensorflow.examples.tutorials.mnist import input_data
mnist = input_data.read_data_sets("/tmp/data/", one_hot=True)
I get the error:
TclError: no display name and no $DISPLAY environment variable
I've tried passing the container -e DISPLAY=$DISPLAY, but it says it can't find :0.
Any suggestions?
missing pytorch
pytorch is all the rage these days...
nvidia-docker not found
on linux ubuntu (linux-mint)
gpu build
sudo docker build -t floydhub/dl-docker:gpu -f Dockerfile.gpu .
build is successful
sudo docker build -t floydhub/dl-docker:gpu -f Dockerfile.gpu .
Sending build context to Docker daemon 282.6 kB
Step 1 : FROM nvidia/cuda:7.5-cudnn4-devel
---> 86ef0e729cda
Step 2 : MAINTAINER Sai Soundararaj <[email protected]>
---> Using cache
---> 8cea41f5b411
Step 3 : ARG THEANO_VERSION=rel-0.8.2
---> Using cache
---> ea66ac71b25d
Step 4 : ARG TENSORFLOW_VERSION=0.8.0
---> Using cache
---> d43f4d0c328e
Step 5 : ARG TENSORFLOW_ARCH=gpu
---> Using cache
---> 5ff4178a7248
Step 6 : ARG KERAS_VERSION=1.0.3
---> Using cache
---> b53b8aa6d4b0
Step 7 : ARG LASAGNE_VERSION=v0.1
---> Using cache
---> 424f495fb439
Step 8 : ARG TORCH_VERSION=latest
---> Using cache
---> 9c2b8d50476a
Step 9 : ARG CAFFE_VERSION=master
---> Using cache
---> 07c51d845d4d
Step 10 : RUN apt-get update && apt-get install -y bc build-essential cmake curl g++ gfortran git libffi-dev libfreetype6-dev libhdf5-dev libjpeg-dev liblcms2-dev libopenblas-dev liblapack-dev libopenjpeg2 libpng12-dev libssl-dev libtiff5-dev libwebp-dev libzmq3-dev nano pkg-config python-dev software-properties-common unzip vim wget zlib1g-dev && apt-get clean && apt-get autoremove && rm -rf /var/lib/apt/lists/* && update-alternatives --set libblas.so.3 /usr/lib/openblas-base/libblas.so.3
---> Using cache
---> f0cf4251dbea
Step 11 : RUN curl -O https://bootstrap.pypa.io/get-pip.py && python get-pip.py && rm get-pip.py
---> Using cache
---> 54c1f116330c
Step 12 : RUN pip --no-cache-dir install pyopenssl ndg-httpsclient pyasn1
---> Using cache
---> 5809e433f945
Step 13 : RUN apt-get update && apt-get install -y python-numpy python-scipy python-nose python-h5py python-skimage python-matplotlib python-pandas python-sklearn python-sympy && apt-get clean && apt-get autoremove && rm -rf /var/lib/apt/lists/*
---> Using cache
---> 2c2b85d277ba
Step 14 : RUN pip --no-cache-dir install --upgrade ipython && pip --no-cache-dir install Cython ipykernel jupyter path.py Pillow pygments six sphinx wheel zmq && python -m ipykernel.kernelspec
---> Using cache
---> 398087ae431b
Step 15 : RUN pip --no-cache-dir install https://storage.googleapis.com/tensorflow/linux/${TENSORFLOW_ARCH}/tensorflow-${TENSORFLOW_VERSION}-cp27-none-linux_x86_64.whl
---> Using cache
---> a17e2ed331e2
Step 16 : RUN apt-get update && apt-get install -y libboost-all-dev libgflags-dev libgoogle-glog-dev libhdf5-serial-dev libleveldb-dev liblmdb-dev libopencv-dev libprotobuf-dev libsnappy-dev protobuf-compiler && apt-get clean && apt-get autoremove && rm -rf /var/lib/apt/lists/*
---> Using cache
---> dfc383b9d30d
Step 17 : RUN git clone -b ${CAFFE_VERSION} --depth 1 https://github.com/BVLC/caffe.git /root/caffe && cd /root/caffe && cat python/requirements.txt | xargs -n1 pip install && mkdir build && cd build && cmake -DUSE_CUDNN=1 -DBLAS=Open .. && make -j"$(nproc)" all && make install
---> Using cache
---> 2026f5066caf
Step 18 : ENV CAFFE_ROOT /root/caffe
---> Using cache
---> 31e437fc98c6
Step 19 : ENV PYCAFFE_ROOT $CAFFE_ROOT/python
---> Using cache
---> d248d88f107f
Step 20 : ENV PYTHONPATH $PYCAFFE_ROOT:$PYTHONPATH PATH $CAFFE_ROOT/build/tools:$PYCAFFE_ROOT:$PATH
---> Using cache
---> e8fdd3d738d0
Step 21 : RUN echo "$CAFFE_ROOT/build/lib" >> /etc/ld.so.conf.d/caffe.conf && ldconfig
---> Using cache
---> 6079662e13a0
Step 22 : RUN pip --no-cache-dir install git+git://github.com/Theano/Theano.git@${THEANO_VERSION} && echo "[global]\ndevice=gpu\nfloatX=float32\noptimizer_including=cudnn\nmode=FAST_RUN \n[lib]\ncnmem=0.95 \n[nvcc]\nfastmath=True \n[blas]\nldflag = -L/usr/lib/openblas-base -lopenblas \n[DebugMode]\ncheck_finite=1" > /root/.theanorc
---> Using cache
---> aafc9ad664fe
Step 23 : RUN pip --no-cache-dir install git+git://github.com/fchollet/keras.git@${KERAS_VERSION}
---> Using cache
---> 9acafd663408
Step 24 : RUN pip --no-cache-dir install git+git://github.com/Lasagne/Lasagne.git@${LASAGNE_VERSION}
---> Using cache
---> 05df28c4f892
Step 25 : RUN git clone https://github.com/torch/distro.git /root/torch --recursive && cd /root/torch && bash install-deps && yes no | ./install.sh
---> Using cache
---> 69629e30f2b7
Step 26 : ENV LUA_PATH '/root/.luarocks/share/lua/5.1/?.lua;/root/.luarocks/share/lua/5.1/?/init.lua;/root/torch/install/share/lua/5.1/?.lua;/root/torch/install/share/lua/5.1/?/init.lua;./?.lua;/root/torch/install/share/luajit-2.1.0-beta1/?.lua;/usr/local/share/lua/5.1/?.lua;/usr/local/share/lua/5.1/?/init.lua' LUA_CPATH '/root/.luarocks/lib/lua/5.1/?.so;/root/torch/install/lib/lua/5.1/?.so;./?.so;/usr/local/lib/lua/5.1/?.so;/usr/local/lib/lua/5.1/loadall.so' PATH /root/torch/install/bin:$PATH LD_LIBRARY_PATH /root/torch/install/lib:$LD_LIBRARY_PATH DYLD_LIBRARY_PATH /root/torch/install/lib:$DYLD_LIBRARY_PATH
---> Using cache
---> 69ccd7e2486d
Step 27 : ENV LUA_CPATH '/root/torch/install/lib/?.so;'$LUA_CPATH
---> Using cache
---> a260921b541f
Step 28 : RUN luarocks install nn && luarocks install cutorch && luarocks install cunn && cd /root && git clone https://github.com/soumith/cudnn.torch.git && cd cudnn.torch && git checkout R4 && luarocks make && cd /root && git clone https://github.com/facebook/iTorch.git && cd iTorch && luarocks make
---> Using cache
---> 1284e34add77
Step 29 : COPY jupyter_notebook_config.py /root/.jupyter/
---> Using cache
---> 4f392face607
Step 30 : COPY run_jupyter.sh /root/
---> Using cache
---> 9c1e4a5a9fb0
Step 31 : EXPOSE 6006 8888
---> Using cache
---> 65564411cbaf
Step 32 : WORKDIR "/root"
---> Using cache
---> 78bae8af2123
Step 33 : CMD /bin/bash
---> Using cache
---> df3aa65f748a
Successfully built df3aa65f748a
but trying to start
sudo nvidia-docker run -it -p 8888:8888 -p 6006:6006 -v /sharedfolder:/root/sharedfolder floydhub/dl-docker:gpu bash
gives following error
nvidia-docker: command not found
cpu version works
The Docker Image in Docker Hub is no more automatically build
The ready to use Docker Image on https://hub.docker.com/r/floydhub/dl-docker/ is no more automatically build.
Is it related to the fact that the Source Repository is https://github.com/saiprashanths/dl-docker (instead of https://github.com/floydhub/dl-docker/ )?
Error: Manifest for floydhub/dl-docker:gpu not found
Hi - looks like the perfect docker build!
I followed your steps, but after the build, when I came to run it:
$ nvidia-docker run -it -p 8888:8888 -p 6006:6006 -v /media/data1:/root/sharedfolder floydhub/dl-docker:gpu bash
I got
nvidia-docker | 2017/04/12 11:35:25 Error: Error response from daemon: manifest for floydhub/dl-docker:gpu not found
I'm not sure if this is a docker / nvidia-docker / your build issue. But any steer you might have very much welcomed!
I notice that floydhub/dl-docker is not appearing as a repository when I run nvidia-docker images, but there is 'something' there, following the build. Rep and Tag = <none>
REPOSITORY TAG IMAGE ID CREATED SIZE
<none> <none> 9970b532e83a 55 minutes ago 10.5 GB nvidia/cuda 8.0-cudnn5-devel-ubuntu14.04 2b185ca91cd9 11 days ago 1.79 GB
Could the build have failed to 'register' the repository in some way?
Use DockerHub automated build to provide official docker image
Now we can build the new docker image from Dockerfile in this repo. Is that possible to provide the official one so that we don't need to build by ourselves and just docker pull saiprashanths/dl-docker?
'import theano' in Jupyter gives "ERROR: ... =CNMEM_STATUS_OUT_OF_MEMORY"
Hey,
I've now tried several different approaches to get the dl-docker to work, but none of them seem to cut the deal. So, here's one of the attempts I made, maybe it points to a common problem in all of the attempts.
I installed the dl-docker the way shown here:
https://github.com/saiprashanths/dl-docker
on top of a fresh Ubuntu 16.04.1, with a cpu i7 and gpu GTX 660 Ti.
Tried to use jupyter with the following commands:
sudo nvidia-docker run -it -p 8888:8888 -p 6006:6006 -v /sharedfolder:/root/sharedfolder floydhub/dl-docker:gpu bash
-> in the bash:
jupyter notebook
-> in firefox, opened a python2 and there:
import theano
Then I got the following error report:
ERROR (theano.sandbox.cuda): ERROR: Not using GPU. Initialisation of device gpu failed:
initCnmem: cnmemInit call failed! Reason=CNMEM_STATUS_OUT_OF_MEMORY. numdev=1
RuntimeError Traceback (most recent call last)
in ()
----> 1 import theano
/usr/local/lib/python2.7/dist-packages/theano/init.pyc in ()
109
110 if config.enable_initial_driver_test:
--> 111 theano.sandbox.cuda.tests.test_driver.test_nvidia_driver1()
112
113 if (config.device.startswith('cuda') or
/usr/local/lib/python2.7/dist-packages/theano/sandbox/cuda/tests/test_driver.pyc in test_nvidia_driver1()
36 'but got:']+[str(app) for app in topo])
37 raise AssertionError(msg)
---> 38 if not numpy.allclose(f(), a.sum()):
39 raise Exception("The nvidia driver version installed with this OS "
40 "does not give good results for reduction."
/usr/local/lib/python2.7/dist-packages/theano/compile/function_module.pyc in call(self, *args, **kwargs)
869 node=self.fn.nodes[self.fn.position_of_error],
870 thunk=thunk,
--> 871 storage_map=getattr(self.fn, 'storage_map', None))
872 else:
873 # old-style linkers raise their own exceptions
/usr/local/lib/python2.7/dist-packages/theano/gof/link.pyc in raise_with_op(node, thunk, exc_info, storage_map)
312 # extra long error message in that case.
313 pass
--> 314 reraise(exc_type, exc_value, exc_trace)
315
316
/usr/local/lib/python2.7/dist-packages/theano/compile/function_module.pyc in call(self, *args, **kwargs)
857 t0_fn = time.time()
858 try:
--> 859 outputs = self.fn()
860 except Exception:
861 if hasattr(self.fn, 'position_of_error'):
RuntimeError: Cuda error: kernel_reduce_ccontig_node_97496c4d3cf9a06dc4082cc141f918d2_0: out of memory. (grid: 1 x 1; block: 256 x 1 x 1)
Apply node that caused the error: GpuCAReduce{add}{1}(<CudaNdarrayType(float32, vector)>)
Toposort index: 0
Inputs types: [CudaNdarrayType(float32, vector)]
Inputs shapes: [(10000,)]
Inputs strides: [(1,)]
Inputs values: ['not shown']
Outputs clients: [[HostFromGpu(GpuCAReduce{add}{1}.0)]]
HINT: Re-running with most Theano optimization disabled could give you a back-trace of when this node was created. This can be done with by setting the Theano flag 'optimizer=fast_compile'. If that does not work, Theano optimizations can be disabled with 'optimizer=None'.
HINT: Use the Theano flag 'exception_verbosity=high' for a debugprint and storage map footprint of this apply node.
Any help would be appreciated, thanks before hand!
libopenjpeg2 in ubuntu xenial not exist
Step 10/33 : RUN apt-get update && apt-get install -y bc build-essential cmake curl g++ gfortran git libffi-dev libfreetype6-dev libhdf5-dev libjpeg-dev liblcms2-dev libopenblas-dev liblapack-dev libopenjpeg2 libpng12-dev libssl-dev libtiff5-dev libwebp-dev libzmq3-dev nano pkg-config python-dev software-properties-common unzip vim wget zlib1g-dev && apt-get clean && apt-get autoremove && rm -rf /var/lib/apt/lists/* && update-alternatives --set libblas.so.3 /usr/lib/openblas-base/libblas.so.3
---> Running in 20afcdaeed4d
Ign:1 http://developer.download.nvidia.com/compute/cuda/repos/ubuntu1604/x86_64 InRelease
Get:2 http://developer.download.nvidia.com/compute/cuda/repos/ubuntu1604/x86_64 Release [564 B]
Get:3 http://developer.download.nvidia.com/compute/cuda/repos/ubuntu1604/x86_64 Release.gpg [819 B]
Get:4 http://archive.ubuntu.com/ubuntu xenial InRelease [247 kB]
Get:5 http://developer.download.nvidia.com/compute/cuda/repos/ubuntu1604/x86_64 Packages [22.5 kB]
Get:6 http://archive.ubuntu.com/ubuntu xenial-updates InRelease [102 kB]
Get:7 http://archive.ubuntu.com/ubuntu xenial-security InRelease [102 kB]
Get:8 http://archive.ubuntu.com/ubuntu xenial/main Sources [1103 kB]
Get:9 http://archive.ubuntu.com/ubuntu xenial/restricted Sources [5179 B]
Get:10 http://archive.ubuntu.com/ubuntu xenial/universe Sources [9802 kB]
Get:11 http://archive.ubuntu.com/ubuntu xenial/main amd64 Packages [1558 kB]
Get:12 http://archive.ubuntu.com/ubuntu xenial/restricted amd64 Packages [14.1 kB]
Get:13 http://archive.ubuntu.com/ubuntu xenial/universe amd64 Packages [9827 kB]
Get:14 http://archive.ubuntu.com/ubuntu xenial-updates/main Sources [272 kB]
Get:15 http://archive.ubuntu.com/ubuntu xenial-updates/restricted Sources [1866 B]
Get:16 http://archive.ubuntu.com/ubuntu xenial-updates/universe Sources [147 kB]
Get:17 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 Packages [578 kB]
Get:18 http://archive.ubuntu.com/ubuntu xenial-updates/restricted amd64 Packages [11.7 kB]
Get:19 http://archive.ubuntu.com/ubuntu xenial-updates/universe amd64 Packages [479 kB]
Get:20 http://archive.ubuntu.com/ubuntu xenial-security/main Sources [65.4 kB]
Get:21 http://archive.ubuntu.com/ubuntu xenial-security/restricted Sources [1866 B]
Get:22 http://archive.ubuntu.com/ubuntu xenial-security/universe Sources [18.6 kB]
Get:23 http://archive.ubuntu.com/ubuntu xenial-security/main amd64 Packages [251 kB]
Get:24 http://archive.ubuntu.com/ubuntu xenial-security/restricted amd64 Packages [11.7 kB]
Get:25 http://archive.ubuntu.com/ubuntu xenial-security/universe amd64 Packages [83.4 kB]
Fetched 24.7 MB in 8s (2909 kB/s)
Reading package lists...
Reading package lists...
Building dependency tree...
Reading state information...
E: Unable to locate package libopenjpeg2
The command '/bin/sh -c apt-get update && apt-get install -y bc build-essential cmake curl g++ gfortran git libffi-dev libfreetype6-dev libhdf5-dev libjpeg-dev liblcms2-dev libopenblas-dev liblapack-dev libopenjpeg2 libpng12-dev libssl-dev libtiff5-dev libwebp-dev libzmq3-dev nano pkg-config python-dev software-properties-common unzip vim wget zlib1g-dev && apt-get clean && apt-get autoremove && rm -rf /var/lib/apt/lists/* && update-alternatives --set libblas.so.3 /usr/lib/openblas-base/libblas.so.3' returned a non-zero code: 100
Suggestion : Also add dlib library
build failed - failed to fetch & unable to locate package
Hello when running
docker build -t floydhub/dl-docker:gpu -f Dockerfile.gpu .
I get the following errors
Sending build context to Docker daemon 128 kB
Step 1/34 : FROM nvidia/cuda:8.0-cudnn5-devel-ubuntu14.04
---> c635a6722abd
Step 2/34 : MAINTAINER Sai Soundararaj [email protected]
---> Using cache
---> 13178d11a760
Step 3/34 : ARG THEANO_VERSION=rel-0.8.2
---> Using cache
---> 3cc333a18c08
Step 4/34 : ARG TENSORFLOW_VERSION=0.12.1
---> Using cache
---> a4e77ddb8bb5
Step 5/34 : ARG TENSORFLOW_ARCH=gpu
---> Using cache
---> ca78b0733ed2
Step 6/34 : ARG KERAS_VERSION=1.2.0
---> Using cache
---> 0dfd155b4adc
Step 7/34 : ARG LASAGNE_VERSION=v0.1
---> Using cache
---> 63ae159c1a9e
Step 8/34 : ARG TORCH_VERSION=latest
---> Using cache
---> ae217e15bc25
Step 9/34 : ARG CAFFE_VERSION=master
---> Using cache
---> fd930f1e6f9b
Step 10/34 : RUN apt-get update && apt-get install -y bc build-essential cmake curl g++ gfortran git libffi-dev libfreetype6-dev libhdf5-dev libjpeg-dev liblcms2-dev libopenblas-dev liblapack-dev libopenjpeg2 libpng12-dev libssl-dev libtiff5-dev libwebp-dev libzmq3-dev nano pkg-config python-dev software-properties-common unzip vim wget zlib1g-dev qt5-default libvtk6-dev zlib1g-dev libjpeg-dev libwebp-dev libpng-dev libtiff5-dev libjasper-dev libopenexr-dev libgdal-dev libdc1394-22-dev libavcodec-dev libavformat-dev libswscale-dev libtheora-dev libvorbis-dev libxvidcore-dev libx264-dev yasm libopencore-amrnb-dev libopencore-amrwb-dev libv4l-dev libxine2-dev libtbb-dev libeigen3-dev python-dev python-tk python-numpy python3-dev python3-tk python3-numpy ant default-jdk doxygen && apt-get clean && apt-get autoremove && rm -rf /var/lib/apt/lists/* && update-alternatives --set libblas.so.3 /usr/lib/openblas-base/libblas.so.3
---> Running in b020db809bdf
Err http://developer.download.nvidia.com InRelease
Err http://developer.download.nvidia.com InRelease
Err http://developer.download.nvidia.com Release.gpg
Could not resolve 'developer.download.nvidia.com'
Err http://developer.download.nvidia.com Release.gpg
Could not resolve 'developer.download.nvidia.com'
Err http://archive.ubuntu.com trusty InRelease
Err http://archive.ubuntu.com trusty-updates InRelease
Err http://archive.ubuntu.com trusty-security InRelease
Err http://archive.ubuntu.com trusty Release.gpg
Could not resolve 'archive.ubuntu.com'
Err http://archive.ubuntu.com trusty-updates Release.gpg
Could not resolve 'archive.ubuntu.com'
Err http://archive.ubuntu.com trusty-security Release.gpg
Could not resolve 'archive.ubuntu.com'
Reading package lists...
W: Failed to fetch http://archive.ubuntu.com/ubuntu/dists/trusty/InRelease
W: Failed to fetch http://archive.ubuntu.com/ubuntu/dists/trusty-updates/InRelease
W: Failed to fetch http://archive.ubuntu.com/ubuntu/dists/trusty-security/InRelease
W: Failed to fetch http://developer.download.nvidia.com/compute/cuda/repos/ubuntu1404/x86_64/InRelease
W: Failed to fetch http://developer.download.nvidia.com/compute/machine-learning/repos/ubuntu1404/x86_64/InRelease
W: Failed to fetch http://developer.download.nvidia.com/compute/cuda/repos/ubuntu1404/x86_64/Release.gpg Could not resolve 'developer.download.nvidia.com'
W: Failed to fetch http://developer.download.nvidia.com/compute/machine-learning/repos/ubuntu1404/x86_64/Release.gpg Could not resolve 'developer.download.nvidia.com'
W: Failed to fetch http://archive.ubuntu.com/ubuntu/dists/trusty/Release.gpg Could not resolve 'archive.ubuntu.com'
W: Failed to fetch http://archive.ubuntu.com/ubuntu/dists/trusty-updates/Release.gpg Could not resolve 'archive.ubuntu.com'
W: Failed to fetch http://archive.ubuntu.com/ubuntu/dists/trusty-security/Release.gpg Could not resolve 'archive.ubuntu.com'
W: Some index files failed to download. They have been ignored, or old ones used instead.
Reading package lists...
Building dependency tree...
Reading state information...
Package cmake is not available, but is referred to by another package.
This may mean that the package is missing, has been obsoleted, or
is only available from another source
Package pkg-config is not available, but is referred to by another package.
This may mean that the package is missing, has been obsoleted, or
is only available from another source
Package vim is not available, but is referred to by another package.
This may mean that the package is missing, has been obsoleted, or
is only available from another source
Package python3-dev is not available, but is referred to by another package.
This may mean that the package is missing, has been obsoleted, or
is only available from another source
Package python3-tk is not available, but is referred to by another package.
This may mean that the package is missing, has been obsoleted, or
is only available from another source
Package libpng12-dev is not available, but is referred to by another package.
This may mean that the package is missing, has been obsoleted, or
is only available from another source
However the following packages replace it:
libpng12-0
E: Unable to locate package bc
E: Package 'cmake' has no installation candidate
E: Unable to locate package curl
E: Unable to locate package gfortran
E: Unable to locate package git
E: Unable to locate package libffi-dev
E: Unable to locate package libfreetype6-dev
E: Unable to locate package libhdf5-dev
E: Unable to locate package libjpeg-dev
E: Unable to locate package liblcms2-dev
E: Unable to locate package libopenblas-dev
E: Unable to locate package liblapack-dev
E: Unable to locate package libopenjpeg2
E: Package 'libpng12-dev' has no installation candidate
E: Unable to locate package libssl-dev
E: Unable to locate package libtiff5-dev
E: Unable to locate package libwebp-dev
E: Unable to locate package libzmq3-dev
E: Unable to locate package nano
E: Package 'pkg-config' has no installation candidate
E: Unable to locate package python-dev
E: Unable to locate package software-properties-common
E: Unable to locate package unzip
E: Package 'vim' has no installation candidate
E: Unable to locate package wget
E: Unable to locate package zlib1g-dev
E: Unable to locate package qt5-default
E: Unable to locate package libvtk6-dev
E: Unable to locate package zlib1g-dev
E: Unable to locate package libjpeg-dev
E: Unable to locate package libwebp-dev
E: Unable to locate package libpng-dev
E: Unable to locate package libtiff5-dev
E: Unable to locate package libjasper-dev
E: Unable to locate package libopenexr-dev
E: Unable to locate package libgdal-dev
E: Unable to locate package libdc1394-22-dev
E: Unable to locate package libavcodec-dev
E: Unable to locate package libavformat-dev
E: Unable to locate package libswscale-dev
E: Unable to locate package libtheora-dev
E: Unable to locate package libvorbis-dev
E: Unable to locate package libxvidcore-dev
E: Unable to locate package libx264-dev
E: Unable to locate package yasm
E: Unable to locate package libopencore-amrnb-dev
E: Unable to locate package libopencore-amrwb-dev
E: Unable to locate package libv4l-dev
E: Unable to locate package libxine2-dev
E: Unable to locate package libtbb-dev
E: Unable to locate package libeigen3-dev
E: Unable to locate package python-dev
E: Unable to locate package python-tk
E: Unable to locate package python-numpy
E: Package 'python3-dev' has no installation candidate
E: Package 'python3-tk' has no installation candidate
E: Unable to locate package python3-numpy
E: Unable to locate package ant
E: Unable to locate package default-jdk
E: Unable to locate package doxygen
The command '/bin/sh -c apt-get update && apt-get install -y bc build-essential cmake curl g++ gfortran git libffi-dev libfreetype6-dev libhdf5-dev libjpeg-dev liblcms2-dev libopenblas-dev liblapack-dev libopenjpeg2 libpng12-dev libssl-dev libtiff5-dev libwebp-dev libzmq3-dev nano pkg-config python-dev software-properties-common unzip vim wget zlib1g-dev qt5-default libvtk6-dev zlib1g-dev libjpeg-dev libwebp-dev libpng-dev libtiff5-dev libjasper-dev libopenexr-dev libgdal-dev libdc1394-22-dev libavcodec-dev libavformat-dev libswscale-dev libtheora-dev libvorbis-dev libxvidcore-dev libx264-dev yasm libopencore-amrnb-dev libopencore-amrwb-dev libv4l-dev libxine2-dev libtbb-dev libeigen3-dev python-dev python-tk python-numpy python3-dev python3-tk python3-numpy ant default-jdk doxygen && apt-get clean && apt-get autoremove && rm -rf /var/lib/apt/lists/* && update-alternatives --set libblas.so.3 /usr/lib/openblas-base/libblas.so.3' returned a non-zero code: 100
and when i run
nvidia-docker run -it -p 8888:8888 -p 6006:6006 -v /sharedfolder:/root/sharedfolder floydhub/dl-docker:gpu bash
I get
nvidia-docker | 2017/05/20 19:06:12 Error: Error response from daemon: manifest for floydhub/dl-docker:gpu not found
I've tried re-running the build multiple times, and still get the same error. what could be the problem?
docker build -t floydhub/dl-docker:gpu -f Dockerfile.gpu not working.
I run the following command:
docker build -t floydhub/dl-docker:gpu -f Dockerfile.gpu
I am getting an error message:
"docker build" requires exactly 1 argument(s).
Usage: docker build [OPTIONS] PATH | URL | -
"No space left on device"
The building of the image stopped because of this error, and I don't understand where it comes from, since I'm installing everything in a AWS p2 instance with 61GB of ram and 100GB of storage (only 15% of which occupied after the crash). Any guess?
I was building the gpu image, after the execution of all the preliminary steps (Nvidia drivers and Docker)
[ 81%] Building NVCC (Device) object lib/THC/CMakeFiles/THC.dir/generated/./THC_generated_THCTensorMaskedDouble.cu.o
/usr/local/cuda/include/driver_functions.h(133): catastrophic error: error while writing generated C++ file: No space left on device1 catastrophic error detected in the compilation of "/tmp/tmpxft_00002201_00000000-8_THCTensorMaskedFloat.cpp4.ii".
Compilation terminated.
/usr/local/cuda/include/texture_fetch_functions.hpp(7739): catastrophic error: error while writing generated C++ file: No space left on device1 catastrophic error detected in the compilation of "/tmp/tmpxft_00002208_00000000-8_THCTensorMaskedDouble.cpp4.ii".
Compilation terminated.
:0:0: fatal error: when writing output to : No space left on device
compilation terminated.
CMake Error at THC_generated_THCTensorMaskedFloat.cu.o.cmake:267 (message):
Error generating file
/root/torch/extra/cutorch/build/lib/THC/CMakeFiles/THC.dir/generated/./THC_generated_THCTensorMaskedFloat.cu.omake[2]: *** [lib/THC/CMakeFiles/THC.dir/generated/./THC_generated_THCTensorMaskedFloat.cu.o] Error 1
make[2]: *** Waiting for unfinished jobs....
CMake Error at THC_generated_THCTensorMaskedDouble.cu.o.cmake:267 (message):
Error generating file
/root/torch/extra/cutorch/build/lib/THC/CMakeFiles/THC.dir/generated/./THC_generated_THCTensorMaskedDouble.cu.omake[2]: *** [lib/THC/CMakeFiles/THC.dir/generated/./THC_generated_THCTensorMaskedDouble.cu.o] Error 1
CMake Error at THC_generated_THCTensorSortDouble.cu.o.cmake:267 (message):
Error generating file
/root/torch/extra/cutorch/build/lib/THC/CMakeFiles/THC.dir/generated/./THC_generated_THCTensorSortDouble.cu.omake[2]: *** [lib/THC/CMakeFiles/THC.dir/generated/./THC_generated_THCTensorSortDouble.cu.o] Error 1
:0:0: fatal error: when writing output to : No such file or directory
compilation terminated.
CMake Error at THC_generated_THCTensorTopK.cu.o.cmake:267 (message):
Error generating file
/root/torch/extra/cutorch/build/lib/THC/CMakeFiles/THC.dir//./THC_generated_THCTensorTopK.cu.omake[2]: *** [lib/THC/CMakeFiles/THC.dir/./THC_generated_THCTensorTopK.cu.o] Error 1
make[1]: *** [lib/THC/CMakeFiles/THC.dir/all] Error 2
make: *** [all] Error 2!Error: Build error: Failed building.
Script appears to freeze at 65% at cutorch
Installing https://raw.githubusercontent.com/torch/rocks/master/cutorch-scm-1.rockspec...
Using https://raw.githubusercontent.com/torch/rocks/master/cutorch-scm-1.rockspec... switching to 'build' mode
Cloning into 'cutorch'...
-- The C compiler identification is GNU 4.8.4
-- The CXX compiler identification is GNU 4.8.4
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Found Torch7 in /root/torch/install
-- Found CUDA: /usr/local/cuda (found suitable version "7.5", minimum required is "6.5")
-- MAGMA not found. Compiling without MAGMA support
-- Automatic GPU detection failed. Building for common architectures.
-- Autodetected CUDA architecture(s):
-- got cuda version 7.5
-- Found CUDA with FP16 support, compiling with torch.CudaHalfTensor
-- Configuring done
-- Generating done
-- Build files have been written to: /tmp/luarocks_cutorch-scm-1-2897/cutorch/build
[ 2%] [ 10%] [ 10%] [ 10%] [ 13%] [ 15%] [ 18%] [ 21%] Building NVCC (Device) object lib/THC/CMakeFiles/THC.dir//./THC_generated_THCHalf.cu.o
Building NVCC (Device) object lib/THC/CMakeFiles/THC.dir//./THC_generated_THCReduceApplyUtils.cu.o
Building NVCC (Device) object lib/THC/CMakeFiles/THC.dir//./THC_generated_THCBlas.cu.o
Building NVCC (Device) object lib/THC/CMakeFiles/THC.dir//./THC_generated_THCStorage.cu.o
Building NVCC (Device) object lib/THC/CMakeFiles/THC.dir//./THC_generated_THCTensor.cu.o
Building NVCC (Device) object lib/THC/CMakeFiles/THC.dir//./THC_generated_THCTensorCopy.cu.o
Building NVCC (Device) object lib/THC/CMakeFiles/THC.dir//./THC_generated_THCTensorMath.cu.o
Building NVCC (Device) object lib/THC/CMakeFiles/THC.dir//./THC_generated_THCStorageCopy.cu.o
[ 23%] Building NVCC (Device) object lib/THC/CMakeFiles/THC.dir//./THC_generated_THCTensorMath2.cu.o
[ 26%] Building NVCC (Device) object lib/THC/CMakeFiles/THC.dir//./THC_generated_THCTensorMathBlas.cu.o
[ 28%] Building NVCC (Device) object lib/THC/CMakeFiles/THC.dir//./THC_generated_THCTensorMathCompare.cu.o
[ 31%] Building NVCC (Device) object lib/THC/CMakeFiles/THC.dir//./THC_generated_THCTensorMathCompareT.cu.o
[ 34%] Building NVCC (Device) object lib/THC/CMakeFiles/THC.dir//./THC_generated_THCTensorMathMagma.cu.o
[ 36%] Building NVCC (Device) object lib/THC/CMakeFiles/THC.dir//./THC_generated_THCTensorMathPairwise.cu.o
[ 39%] Building NVCC (Device) object lib/THC/CMakeFiles/THC.dir//./THC_generated_THCTensorMathPointwise.cu.o
[ 42%] Building NVCC (Device) object lib/THC/CMakeFiles/THC.dir//./THC_generated_THCTensorMathScan.cu.o
[ 44%] Building NVCC (Device) object lib/THC/CMakeFiles/THC.dir//./THC_generated_THCTensorMathTransformReduce.cu.o
[ 47%] Building NVCC (Device) object lib/THC/CMakeFiles/THC.dir//./THC_generated_THCTensorMasked.cu.o
[ 50%] Building NVCC (Device) object lib/THC/CMakeFiles/THC.dir//./THC_generated_THCTensorIndex.cu.o
[ 52%] Building NVCC (Device) object lib/THC/CMakeFiles/THC.dir//./THC_generated_THCTensorConv.cu.o
[ 55%] Building NVCC (Device) object lib/THC/CMakeFiles/THC.dir//./THC_generated_THCTensorRandom.cu.o
[ 57%] Building NVCC (Device) object lib/THC/CMakeFiles/THC.dir//./THC_generated_THCTensorScatterGather.cu.o
[ 60%] Building NVCC (Device) object lib/THC/CMakeFiles/THC.dir//./THC_generated_THCTensorSort.cu.o
[ 63%] Building NVCC (Device) object lib/THC/CMakeFiles/THC.dir//./THC_generated_THCTensorTopK.cu.o
[ 65%] Building NVCC (Device) object lib/THC/CMakeFiles/THC.dir//./THC_generated_THCTensorTypeUtils.cu.o
tags
docker tags are typically tied to a version e.g. 1.1, latest, ... etc (sometimes called version tags), it would be worth revisiting CPU/GPU tags and try to follow common pattern and use tags for versioning
It will also help you release updated versions and let users upgrade after testing (they can switch between version easily), the easiest option is to tie your git tags to docker tags
for example
# for version 1.1
floydhub/dl-docker-cpu:1.1
floydhub/dl-docker-gpu:1.1
# for latest stable version
floydhub/dl-docker-cpu:latest
floydhub/dl-docker-gpu:latest
# for beta release
floydhub/dl-docker-cpu:edge
floydhub/dl-docker-gpu:edge
Tensorflow 1.0?
Hi,
Thanks for this great image, it is a lot of help!
Is there any reason not to update tensorflow from 0.8 to 1.0?
Thanks,
Dusan
Not importing openCV
I tried import cv2 in python but it is not working.
I check for opencv in the machine with
$ pkg-config opencv --cflags
And got a confirmation, such as
-I/usr/include/opencv
What can I to fix this issue?
Thanks
Building GPU version problem - Tag gpu not found in repository docker.io/floydhub/dl-docker - Build error (returned a non-zero code: 2)
Hey, trying to run GPU version on AWS
(the CPU version built ok I think - it runs anyway)
I installed the nvidia driver (according to the PPA page, nvidia-361 is the recommended version)
And nvidia-docker seems to be working fine.
Is there anything I've missed? Thanks :)
tried
sudo docker build -t floydhub/dl-docker:gpu -f Dockerfile.gpu .
and
sudo nvidia-docker build -t floydhub/dl-docker:gpu -f Dockerfile.gpu .
Always terminates on error
nvcc fatal : Unsupported gpu architecture 'compute_60'
CMake Error at cuda_compile_generated_adagrad_solver.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/solvers/./cuda_compile_generated_adagrad_solver.cu.o
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/solvers/./cuda_compile_generated_adagrad_solver.cu.o] Error 1
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_exp_layer.cu.o] Error 1
make[1]: *** [src/caffe/CMakeFiles/caffe.dir/all] Error 2
make: *** [all] Error 2
The command '/bin/sh -c git clone -b ${CAFFE_VERSION} --depth 1 https://github.com/BVLC/caffe.git /root/caffe && cd /root/caffe && cat python/requirements.txt | xargs -n1 pip install && mkdir build && cd build && cmake -DUSE_CUDNN=1 -DBLAS=Open .. && make -j"$(nproc)" all && make install' returned a non-zero code: 2
And then when trying to run it I get
nvidia-docker | 2017/01/10 19:24:41 Error: Tag gpu not found in repository docker.io/floydhub/dl-docker
If I run
sudo nvidia-docker run --rm nvidia/cuda nvidia-smi
I get
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 361.45.18 Driver Version: 361.45.18 |
|-------------------------------+----------------------+----------------------+
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
|===============================+======================+======================|
| 0 GRID K520 Off | 0000:00:03.0 Off | N/A |
| N/A 31C P8 18W / 125W | 11MiB / 4095MiB | 0% Default |
+-------------------------------+----------------------+----------------------+
+-----------------------------------------------------------------------------+
| Processes: GPU Memory |
| GPU PID Type Process name Usage |
|=============================================================================|
| No running processes found |
+-----------------------------------------------------------------------------+
And I managed to get kaixhin's cuda-keras docker working
sudo nvidia-docker run -it kaixhin/cuda-keras
Downloaded the Docker image from Docker Hub and then "Unable to find image 'dl-docker:cpu' locally"
I am unable to get the docker image downloaded from Docker Hub to run on my Windows 7 machine. I opened Docker Quickstart Terminal, downloaded the docker image from Docker Hub via
docker pull floydhub/dl-docker:cpu
but when I try to run the docker image using
docker run -it -p 8888:8888 -p 6006:6006 -v /sharedfolder:/root/sharedfolder
I get error messages
Unable to find image 'dl-docker:cpu' locally
Pulling repository docker.io/library/dl-docker
C:\Program Files\Docker Toolbox\docker.exe: Error: image library/dl-docker not found.
See 'C:\Program Files\Docker Toolbox\docker.exe run --help'.
that I do not know how to resolve. As someone who is new to Docker, I appreciate any help you can provide. The log of the Docker Quickstart Terminal is below in case it helps with troubleshooting.
Thank you!
From Docker Quickstart Terminal
Creating CA: C:\Users\sumloan.docker\machine\certs\ca.pem
Creating client certificate: C:\Users\sumloan.docker\machine\certs\cert.pem
Running pre-create checks...
Creating machine...
(default) Copying C:\Users\sumloan.docker\machine\cache\boot2docker.iso to C:\U
sers\sumloan.docker\machine\machines\default\boot2docker.iso...
(default) Creating VirtualBox VM...
(default) Creating SSH key...
(default) Starting the VM...
(default) Check network to re-create if needed...
(default) Windows might ask for the permission to create a network adapter. Some
times, such confirmation window is minimized in the taskbar.
(default) Found a new host-only adapter: "VirtualBox Host-Only Ethernet Adapter
#2"
(default) Windows might ask for the permission to configure a network adapter. S
ometimes, such confirmation window is minimized in the taskbar.
(default) Windows might ask for the permission to configure a dhcp server. Somet
imes, such confirmation window is minimized in the taskbar.
(default) Waiting for an IP...
Waiting for machine to be running, this may take a few minutes...
Detecting operating system of created instance...
Waiting for SSH to be available...
Detecting the provisioner...
Provisioning with boot2docker...
Copying certs to the local machine directory...
Copying certs to the remote machine...
Setting Docker configuration on the remote daemon...
Checking connection to Docker...
Docker is up and running!
To see how to connect your Docker Client to the Docker Engine running on this vi
rtual machine, run: C:\Program Files\Docker Toolbox\docker-machine.exe env defau
lt
## .
## ## ## ==
## ## ## ## ## ===
/"""""""""""""""""\___/ ===
~~~ {~~ ~~~~ ~~~ ~~~~ ~~~ ~ / ===- ~~~
\______ o __/
\ \ __/
\____\_______/
docker is configured to use the default machine with IP 192.168.99.100
For help getting started, check out the docs at https://docs.docker.com
Start interactive shell
sumloan@SUMLOAN02 MINGW64 ~
$ docker pull floydhub/dl-docker:cpu
cpu: Pulling from floydhub/dl-docker
6c953ac5d795: Pull complete
3eed5ff20a90: Pull complete
f8419ea7c1b5: Pull complete
51900bc9e720: Pull complete
a3ed95caeb02: Pull complete
ea4d432a81d9: Pull complete
4b76eadf67da: Pull complete
25dc96fefbf0: Pull complete
dc1a046fded2: Pull complete
887580a15226: Pull complete
2c451332fccf: Pull complete
ab2009e7ad9e: Pull complete
48eb8f380019: Pull complete
d17800e4c264: Pull complete
18d662f15986: Pull complete
1ef83d1b7232: Pull complete
c913c41e5e86: Pull complete
e7870eb751ec: Pull complete
93a1800a0c5e: Pull complete
1394f32c5367: Pull complete
9ab3142d7018: Pull complete
Digest: sha256:796ce6a1e862b5a80cac7896da6cbb22c2532432674beec98753453f67b030b8
Status: Downloaded newer image for floydhub/dl-docker:cpu
sumloan@SUMLOAN02 MINGW64 ~
$ docker run -it -p 8888:8888 -p 6006:6006 -v /sharedfolder:/root/sharedfolder
dl-docker:cpu bash
Unable to find image 'dl-docker:cpu' locally
Pulling repository docker.io/library/dl-docker
C:\Program Files\Docker Toolbox\docker.exe: Error: image library/dl-docker not found.
See 'C:\Program Files\Docker Toolbox\docker.exe run --help'.
gtx1070 caffe train digit error (error == cudaSuccess (8 vs. 0) invalid device function)
โญโroot at 5420e0794e25 in ~ using
โฐโโ ls -al /dev | grep nvidia
crw-rw-rw- 1 root root 243, 0 Aug 4 06:01 nvidia-uvm
crw-rw-rw- 1 root root 243, 1 Aug 4 06:07 nvidia-uvm-tools
crw-rw-rw- 1 root root 195, 0 Aug 4 06:01 nvidia0
crw-rw-rw- 1 root root 195, 255 Aug 4 06:01 nvidiactl
โญโroot at 5420e0794e25 in ~ using
โฐโโ nvidia-smi
Thu Aug 4 07:09:57 2016
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 367.35 Driver Version: 367.35 |
|-------------------------------+----------------------+----------------------+
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
|===============================+======================+======================|
| 0 GeForce GTX 1070 Off | 0000:01:00.0 On | N/A |
| 0% 34C P8 10W / 230W | 514MiB / 8105MiB | 0% Default |
+-------------------------------+----------------------+----------------------+
+-----------------------------------------------------------------------------+
| Processes: GPU Memory |
| GPU PID Type Process name Usage |
|=============================================================================|
+-----------------------------------------------------------------------------+
โญโroot at 5420e0794e25 in ~ using
โฐโโ nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2016 NVIDIA Corporation
Built on Wed_May__4_21:01:56_CDT_2016
Cuda compilation tools, release 8.0, V8.0.26
F0804 07:20:57.251991 961 pooling_layer.cu:212] Check failed: error == cudaSuccess (8 vs. 0) invalid device function
*** Check failure stack trace: ***
@ 0x7f8b75c42daa (unknown)
@ 0x7f8b75c42ce4 (unknown)
@ 0x7f8b75c426e6 (unknown)
@ 0x7f8b75c45687 (unknown)
@ 0x7f8b76344410 caffe::PoolingLayer<>::Forward_gpu()
@ 0x7f8b7619b748 caffe::Net<>::ForwardFromTo()
@ 0x7f8b7619bac7 caffe::Net<>::Forward()
@ 0x7f8b7633bfdc caffe::Solver<>::Test()
@ 0x7f8b7633ca4e caffe::Solver<>::TestAll()
@ 0x7f8b7633cb40 caffe::Solver<>::Step()
@ 0x7f8b7633d4f9 caffe::Solver<>::Solve()
@ 0x40b545 train()
@ 0x40897c main
@ 0x7f8b74440f45 (unknown)
@ 0x409283 (unknown)
@ (nil) (unknown)
Aborted (core dumped)
Build issue GPU
Getting this when trying to build today.
[100%] Building C object lib/THNN/CMakeFiles/THNN.dir/init.c.o
In file included from generic/SparseLinear.c:1:0,
from /tmp/luarocks_nn-scm-1-303/nn/lib/THNN/init.c:153:
/tmp/luarocks_nn-scm-1-303/nn/lib/THNN/generic/SparseLinear.c: In function 'THNN_FloatSparseLinear_accGradParameters':
/tmp/luarocks_nn-scm-1-303/nn/lib/THNN/generic/SparseLinear.c:237:3: error: too many arguments to function 'THFloatTensor_sum'
THTensor_(sum)(buf, gradOutput, 0, 1);
^
In file included from /root/torch/install/include/TH/TH.h:4:0,
from /tmp/luarocks_nn-scm-1-303/nn/lib/THNN/init.c:1:
/root/torch/install/include/TH/THTensor.h:8:39: note: declared here
#define THTensor_(NAME) TH_CONCAT_4(TH,Real,Tensor_,NAME)
^
/root/torch/install/include/TH/THGeneral.h:108:37: note: in definition of macro 'TH_CONCAT_4_EXPAND'
#define TH_CONCAT_4_EXPAND(x,y,z,w) x ## y ## z ## w
^
/root/torch/install/include/TH/THTensor.h:8:27: note: in expansion of macro 'TH_CONCAT_4'
#define THTensor_(NAME) TH_CONCAT_4(TH,Real,Tensor_,NAME)
^
/root/torch/install/include/TH/generic/THTensorMath.h:77:13: note: in expansion of macro 'THTensor_'
TH_API void THTensor_(sum)(THTensor *r_, THTensor *t, int dimension);
^
In file included from generic/SparseLinear.c:1:0,
from /tmp/luarocks_nn-scm-1-303/nn/lib/THNN/init.c:153:
/tmp/luarocks_nn-scm-1-303/nn/lib/THNN/generic/SparseLinear.c: In function 'THNN_DoubleSparseLinear_accGradParameters':
/tmp/luarocks_nn-scm-1-303/nn/lib/THNN/generic/SparseLinear.c:237:3: error: too many arguments to function 'THDoubleTensor_sum'
THTensor_(sum)(buf, gradOutput, 0, 1);
^
In file included from /root/torch/install/include/TH/TH.h:4:0,
from /tmp/luarocks_nn-scm-1-303/nn/lib/THNN/init.c:1:
/root/torch/install/include/TH/THTensor.h:8:39: note: declared here
#define THTensor_(NAME) TH_CONCAT_4(TH,Real,Tensor_,NAME)
^
/root/torch/install/include/TH/THGeneral.h:108:37: note: in definition of macro 'TH_CONCAT_4_EXPAND'
#define TH_CONCAT_4_EXPAND(x,y,z,w) x ## y ## z ## w
^
/root/torch/install/include/TH/THTensor.h:8:27: note: in expansion of macro 'TH_CONCAT_4'
#define THTensor_(NAME) TH_CONCAT_4(TH,Real,Tensor_,NAME)
^
/root/torch/install/include/TH/generic/THTensorMath.h:77:13: note: in expansion of macro 'THTensor_'
TH_API void THTensor_(sum)(THTensor *r_, THTensor *t, int dimension);
^
In file included from generic/TemporalSubSampling.c:1:0,
from /tmp/luarocks_nn-scm-1-303/nn/lib/THNN/init.c:174:
/tmp/luarocks_nn-scm-1-303/nn/lib/THNN/generic/TemporalSubSampling.c: In function 'THNN_FloatTemporalSubSampling_updateOutput':
/tmp/luarocks_nn-scm-1-303/nn/lib/THNN/generic/TemporalSubSampling.c:73:5: error: too many arguments to function 'THFloatTensor_sum'
THTensor_(sum)(outputFrame, inputWindow, 0, 1);
^
In file included from /root/torch/install/include/TH/TH.h:4:0,
from /tmp/luarocks_nn-scm-1-303/nn/lib/THNN/init.c:1:
/root/torch/install/include/TH/THTensor.h:8:39: note: declared here
#define THTensor_(NAME) TH_CONCAT_4(TH,Real,Tensor_,NAME)
^
/root/torch/install/include/TH/THGeneral.h:108:37: note: in definition of macro 'TH_CONCAT_4_EXPAND'
#define TH_CONCAT_4_EXPAND(x,y,z,w) x ## y ## z ## w
^
/root/torch/install/include/TH/THTensor.h:8:27: note: in expansion of macro 'TH_CONCAT_4'
#define THTensor_(NAME) TH_CONCAT_4(TH,Real,Tensor_,NAME)
^
/root/torch/install/include/TH/generic/THTensorMath.h:77:13: note: in expansion of macro 'THTensor_'
TH_API void THTensor_(sum)(THTensor *r_, THTensor *t, int dimension);
^
In file included from generic/TemporalSubSampling.c:1:0,
from /tmp/luarocks_nn-scm-1-303/nn/lib/THNN/init.c:174:
/tmp/luarocks_nn-scm-1-303/nn/lib/THNN/generic/TemporalSubSampling.c: In function 'THNN_FloatTemporalSubSampling_accGradParameters':
/tmp/luarocks_nn-scm-1-303/nn/lib/THNN/generic/TemporalSubSampling.c:146:5: error: too many arguments to function 'THFloatTensor_sum'
THTensor_(sum)(buffer, inputWindow, 0, 1);
^
In file included from /root/torch/install/include/TH/TH.h:4:0,
from /tmp/luarocks_nn-scm-1-303/nn/lib/THNN/init.c:1:
/root/torch/install/include/TH/THTensor.h:8:39: note: declared here
#define THTensor_(NAME) TH_CONCAT_4(TH,Real,Tensor_,NAME)
^
/root/torch/install/include/TH/THGeneral.h:108:37: note: in definition of macro 'TH_CONCAT_4_EXPAND'
#define TH_CONCAT_4_EXPAND(x,y,z,w) x ## y ## z ## w
^
/root/torch/install/include/TH/THTensor.h:8:27: note: in expansion of macro 'TH_CONCAT_4'
#define THTensor_(NAME) TH_CONCAT_4(TH,Real,Tensor_,NAME)
^
/root/torch/install/include/TH/generic/THTensorMath.h:77:13: note: in expansion of macro 'THTensor_'
TH_API void THTensor_(sum)(THTensor *r_, THTensor *t, int dimension);
^
In file included from generic/TemporalSubSampling.c:1:0,
from /tmp/luarocks_nn-scm-1-303/nn/lib/THNN/init.c:174:
/tmp/luarocks_nn-scm-1-303/nn/lib/THNN/generic/TemporalSubSampling.c: In function 'THNN_DoubleTemporalSubSampling_updateOutput':
/tmp/luarocks_nn-scm-1-303/nn/lib/THNN/generic/TemporalSubSampling.c:73:5: error: too many arguments to function 'THDoubleTensor_sum'
THTensor_(sum)(outputFrame, inputWindow, 0, 1);
^
In file included from /root/torch/install/include/TH/TH.h:4:0,
from /tmp/luarocks_nn-scm-1-303/nn/lib/THNN/init.c:1:
/root/torch/install/include/TH/THTensor.h:8:39: note: declared here
#define THTensor_(NAME) TH_CONCAT_4(TH,Real,Tensor_,NAME)
^
/root/torch/install/include/TH/THGeneral.h:108:37: note: in definition of macro 'TH_CONCAT_4_EXPAND'
#define TH_CONCAT_4_EXPAND(x,y,z,w) x ## y ## z ## w
^
/root/torch/install/include/TH/THTensor.h:8:27: note: in expansion of macro 'TH_CONCAT_4'
#define THTensor_(NAME) TH_CONCAT_4(TH,Real,Tensor_,NAME)
^
/root/torch/install/include/TH/generic/THTensorMath.h:77:13: note: in expansion of macro 'THTensor_'
TH_API void THTensor_(sum)(THTensor *r_, THTensor *t, int dimension);
^
In file included from generic/TemporalSubSampling.c:1:0,
from /tmp/luarocks_nn-scm-1-303/nn/lib/THNN/init.c:174:
/tmp/luarocks_nn-scm-1-303/nn/lib/THNN/generic/TemporalSubSampling.c: In function 'THNN_DoubleTemporalSubSampling_accGradParameters':
/tmp/luarocks_nn-scm-1-303/nn/lib/THNN/generic/TemporalSubSampling.c:146:5: error: too many arguments to function 'THDoubleTensor_sum'
THTensor_(sum)(buffer, inputWindow, 0, 1);
^
In file included from /root/torch/install/include/TH/TH.h:4:0,
from /tmp/luarocks_nn-scm-1-303/nn/lib/THNN/init.c:1:
/root/torch/install/include/TH/THTensor.h:8:39: note: declared here
#define THTensor_(NAME) TH_CONCAT_4(TH,Real,Tensor_,NAME)
^
/root/torch/install/include/TH/THGeneral.h:108:37: note: in definition of macro 'TH_CONCAT_4_EXPAND'
#define TH_CONCAT_4_EXPAND(x,y,z,w) x ## y ## z ## w
^
/root/torch/install/include/TH/THTensor.h:8:27: note: in expansion of macro 'TH_CONCAT_4'
#define THTensor_(NAME) TH_CONCAT_4(TH,Real,Tensor_,NAME)
^
/root/torch/install/include/TH/generic/THTensorMath.h:77:13: note: in expansion of macro 'THTensor_'
TH_API void THTensor_(sum)(THTensor *r_, THTensor *t, int dimension);
^
make[2]: *** [lib/THNN/CMakeFiles/THNN.dir/init.c.o] Error 1
make[1]: *** [lib/THNN/CMakeFiles/THNN.dir/all] Error 2
make: *** [all] Error 2
Error: Build error: Failed building.
cmake -E make_directory build && cd build && cmake .. -DCMAKE_BUILD_TYPE=Release -DCMAKE_PREFIX_PATH="/root/torch/install/bin/.." -DCMAKE_INSTALL_PREFIX="/root/torch/install/lib/luarocks/rocks/nn/scm-1" && make
The command '/bin/sh -c luarocks install nn && luarocks install cutorch && luarocks install cunn && luarocks install loadcaffe && cd /root && git clone https://github.com/soumith/cudnn.torch.git && cd cudnn.torch && git checkout R4 && luarocks make && cd /root && git clone https://github.com/facebook/iTorch.git && cd iTorch && luarocks make' returned a non-zero code: 1
Couldn't open CUDA library libcuda.so.1.
jupyter kernel dead when I run tflearn, output log shows:
WARNING:root:kernel cd2b7b0f-7190-44a5-9a34-a994a098d416 restarted
I tensorflow/stream_executor/dso_loader.cc:105] successfully opened CUDA library libcublas.so locally
I tensorflow/stream_executor/dso_loader.cc:105] successfully opened CUDA library libcudnn.so locally
I tensorflow/stream_executor/dso_loader.cc:105] successfully opened CUDA library libcufft.so locally
I tensorflow/stream_executor/dso_loader.cc:99] Couldn't open CUDA library libcuda.so.1. LD_LIBRARY_PATH: /usr/ local/nvidia/lib:/usr/local/nvidia/lib64
I tensorflow/stream_executor/cuda/cuda_diagnostics.cc:121] hostname: fcbbfb540d33
I tensorflow/stream_executor/cuda/cuda_diagnostics.cc:146] libcuda reported version is: Not found: was unable to find libcuda.so DSO loaded into this program
I tensorflow/stream_executor/cuda/cuda_diagnostics.cc:257] driver version file contents: """NVRM version: NVID IA UNIX x86_64 Kernel Module 367.44 Wed Aug 17 22:24:07 PDT 2016
GCC version: gcc version 4.8.2 20140120 (Red Hat 4.8.2-16) (GCC)
"""
I tensorflow/stream_executor/cuda/cuda_diagnostics.cc:150] kernel reported version is: 367.44
I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1051] LD_LIBRARY_PATH: /usr/local/nvidia/lib:/usr/local /nvidia/lib64
I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1052] failed to find libcuda.so on this system: Failed precondition: could not dlopen DSO: libcuda.so.1; dlerror: libcuda.so.1: cannot open shared object file: No su ch file or directory
I tensorflow/stream_executor/dso_loader.cc:105] successfully opened CUDA library libcurand.so locally
[I 01:13:34.713 NotebookApp] Saving file at /sharedfolder/test_tflearn.ipynb
E tensorflow/stream_executor/cuda/cuda_driver.cc:481] failed call to cuInit: CUDA_ERROR_NO_DEVICE
I tensorflow/stream_executor/cuda/cuda_diagnostics.cc:109] no NVIDIA GPU device is present: /dev/nvidia0 does not exist
I tensorflow/core/common_runtime/gpu/gpu_init.cc:81] No GPU devices available on machine.
[I 01:13:42.839 NotebookApp] KernelRestarter: restarting kernel (1/5)
Then I tried:
root@fcbbfb540d33:~# echo $LD_LIBRARY_PATH
/usr/local/nvidia/lib:/usr/local/nvidia/lib64
root@fcbbfb540d33:~# ls -al /usr/local/nvidia/lib
ls: cannot access /usr/local/nvidia/lib: No such file or directory
root@fcbbfb540d33:~# ls -al /usr/local/nvidia/lib64
ls: cannot access /usr/local/nvidia/lib64: No such file or directory
What is the problem?
can not build caffe `make[1]: *** [src/caffe/CMakeFiles/caffe.dir/all] Error 2`
Log:
-- The C compiler identification is GNU 4.8.4
-- The CXX compiler identification is GNU 4.8.4
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Boost version: 1.54.0
-- Found the following Boost libraries:
-- system
-- thread
-- filesystem
-- Looking for include file pthread.h
-- Looking for include file pthread.h - found
-- Looking for pthread_create
-- Looking for pthread_create - not found
-- Looking for pthread_create in pthreads
-- Looking for pthread_create in pthreads - not found
-- Looking for pthread_create in pthread
-- Looking for pthread_create in pthread - found
-- Found Threads: TRUE
-- Found GFlags: /usr/include
-- Found gflags (include: /usr/include, library: /usr/lib/x86_64-linux-gnu/libgflags.so)
-- Found Glog: /usr/include
-- Found glog (include: /usr/include, library: /usr/lib/x86_64-linux-gnu/libglog.so)
-- Found PROTOBUF: /usr/lib/x86_64-linux-gnu/libprotobuf.so
-- Found PROTOBUF Compiler: /usr/bin/protoc
-- Found HDF5: /usr/lib/x86_64-linux-gnu/libhdf5_hl.so;/usr/lib/x86_64-linux-gnu/libhdf5.so
-- Found LMDB: /usr/include
-- Found lmdb (include: /usr/include, library: /usr/lib/x86_64-linux-gnu/liblmdb.so)
-- Found LevelDB: /usr/include
-- Found LevelDB (include: /usr/include, library: /usr/lib/x86_64-linux-gnu/libleveldb.so)
-- Found Snappy: /usr/include
-- Found Snappy (include: /usr/include, library: /usr/lib/libsnappy.so)
-- CUDA detected: 7.5
-- Found cuDNN: ver. 4.0.8 found (include: /usr/include, library: /usr/lib/x86_64-linux-gnu/libcudnn.so)
-- Automatic GPU detection failed. Building for all known architectures.
-- Added CUDA NVCC flags for: sm_20 sm_21 sm_30 sm_35 sm_50 sm_60 sm_61
-- OpenCV found (/usr/share/OpenCV)
-- Found OpenBLAS libraries: /usr/lib/libopenblas.so
-- Found OpenBLAS include: /usr/include
-- Found PythonInterp: /usr/bin/python2.7 (found suitable version "2.7.6", minimum required is "2.7")
-- Found PythonLibs: /usr/lib/x86_64-linux-gnu/libpython2.7.so (found suitable version "2.7.6", minimum required is "2.7")
-- Found NumPy: /usr/lib/python2.7/dist-packages/numpy/core/include (found suitable version "1.8.2", minimum required is "1.7.1")
-- NumPy ver. 1.8.2 found (include: /usr/lib/python2.7/dist-packages/numpy/core/include)
-- Boost version: 1.54.0
-- Found the following Boost libraries:
-- python
-- Could NOT find Doxygen (missing: DOXYGEN_EXECUTABLE)
-- Found Git: /usr/bin/git (found version "1.9.1")
--
-- ******************* Caffe Configuration Summary *******************
-- General:
-- Version : 1.0.0-rc3
-- Git : 365ac88
-- System : Linux
-- C++ compiler : /usr/bin/c++
-- Release CXX flags : -O3 -DNDEBUG -fPIC -Wall -Wno-sign-compare -Wno-uninitialized
-- Debug CXX flags : -g -fPIC -Wall -Wno-sign-compare -Wno-uninitialized
-- Build type : Release
--
-- BUILD_SHARED_LIBS : ON
-- BUILD_python : ON
-- BUILD_matlab : OFF
-- BUILD_docs : ON
-- CPU_ONLY : OFF
-- USE_OPENCV : ON
-- USE_LEVELDB : ON
-- USE_LMDB : ON
-- ALLOW_LMDB_NOLOCK : OFF
--
-- Dependencies:
-- BLAS : Yes (Open)
-- Boost : Yes (ver. 1.54)
-- glog : Yes
-- gflags : Yes
-- protobuf : Yes (ver. 2.5.0)
-- lmdb : Yes (ver. 0.9.10)
-- LevelDB : Yes (ver. 1.15)
-- Snappy : Yes (ver. 1.1.0)
-- OpenCV : Yes (ver. 2.4.8)
-- CUDA : Yes (ver. 7.5)
--
-- NVIDIA CUDA:
-- Target GPU(s) : Auto
-- GPU arch(s) : sm_20 sm_21 sm_30 sm_35 sm_50 sm_60 sm_61
-- cuDNN : Yes (ver. 4.0.8)
--
-- Python:
-- Interpreter : /usr/bin/python2.7 (ver. 2.7.6)
-- Libraries : /usr/lib/x86_64-linux-gnu/libpython2.7.so (ver 2.7.6)
-- NumPy : /usr/lib/python2.7/dist-packages/numpy/core/include (ver 1.8.2)
--
-- Documentaion:
-- Doxygen : No
-- config_file :
--
-- Install:
-- Install path : /root/caffe/build/install
--
-- Configuring done
-- Generating done
-- Build files have been written to: /root/caffe/build
[ 1%] Running C++/Python protocol buffer compiler on /root/caffe/src/caffe/proto/caffe.proto
Scanning dependencies of target proto
[ 1%] Building CXX object src/caffe/CMakeFiles/proto.dir/__/__/include/caffe/proto/caffe.pb.cc.o
Linking CXX static library ../../lib/libproto.a
[ 1%] Built target proto
[ 1%] [ 1%] [ 2%] [ 2%] [ 2%] [ 2%] [ 2%] [ 4%] [ 4%] [ 5%] [ 6%] [ 6%] [ 6%] [ 8%] [ 8%] [ 9%] [ 9%] [ 9%] [ 11%] [ 11%] [ 12%] [ 12%] Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/util/./cuda_compile_generated_math_functions.cu.o
[ 13%] Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_absval_layer.cu.o
[ 13%] Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_batch_norm_layer.cu.o
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_batch_reindex_layer.cu.o
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_concat_layer.cu.o
[ 13%] Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_base_data_layer.cu.o
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_cudnn_conv_layer.cu.o
[ 13%] Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_conv_layer.cu.o
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_cudnn_lrn_layer.cu.o
[ 13%] Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_cudnn_pooling_layer.cu.o
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_cudnn_lcn_layer.cu.o
[ 16%] [ 16%] Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_contrastive_loss_layer.cu.o
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_bias_layer.cu.o
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_cudnn_relu_layer.cu.o
[ 18%] Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_crop_layer.cu.o
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_bnll_layer.cu.o
[ 18%] Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_cudnn_softmax_layer.cu.o
[ 18%] Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_cudnn_sigmoid_layer.cu.o
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_deconv_layer.cu.o
[ 18%] [ 18%] Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_eltwise_layer.cu.o
[ 19%] Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_dropout_layer.cu.o
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_embed_layer.cu.o
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_cudnn_tanh_layer.cu.o
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_euclidean_loss_layer.cu.o
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_elu_layer.cu.o
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_exp_layer.cu.o
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_filter_layer.cu.o
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_hdf5_data_layer.cu.o
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_inner_product_layer.cu.o
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_hdf5_output_layer.cu.o
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_im2col_layer.cu.o
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_log_layer.cu.o
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_lstm_unit_layer.cu.o
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_lrn_layer.cu.o
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_mvn_layer.cu.o
[ 19%] [ 20%] [ 20%] [ 22%] [ 22%] [ 22%] [ 23%] [ 25%] [ 25%] [ 25%] nvcc fatal : Unsupported gpu architecture 'compute_60'
[ 26%] [ 26%] CMake Error at cuda_compile_generated_batch_reindex_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_batch_reindex_layer.cu.o
[ 26%] nvcc fatal : Unsupported gpu architecture 'compute_60'
CMake Error at cuda_compile_generated_math_functions.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/util/./cuda_compile_generated_math_functions.cu.o
nvcc fatal : Unsupported gpu architecture 'compute_60'
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_batch_reindex_layer.cu.o] Error 1
make[2]: *** Waiting for unfinished jobs....
nvcc fatal : Unsupported gpu architecture 'compute_60'
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_prelu_layer.cu.o
CMake Error at cuda_compile_generated_concat_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_concat_layer.cu.o
CMake Error at cuda_compile_generated_cudnn_lcn_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_cudnn_lcn_layer.cu.o
nvcc fatal : Unsupported gpu architecture 'compute_60'
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_recurrent_layer.cu.o
CMake Error at cuda_compile_generated_dropout_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_dropout_layer.cu.o
nvcc fatal : Unsupported gpu architecture 'compute_60'
nvcc fatal : Unsupported gpu architecture 'compute_60'
nvcc fatal : Unsupported gpu architecture 'compute_60'
CMake Error at cuda_compile_generated_bnll_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_bnll_layer.cu.o
CMake Error at cuda_compile_generated_conv_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_conv_layer.cu.o
[ 27%] Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_sigmoid_cross_entropy_loss_layer.cu.o
CMake Error at cuda_compile_generated_absval_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_absval_layer.cu.o
nvcc fatal : Unsupported gpu architecture 'compute_60'
[ 29%] [ 29%] make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/util/./cuda_compile_generated_math_functions.cu.o] Error 1
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_concat_layer.cu.o] Error 1nvcc fatal : Unsupported gpu architecture 'compute_60'
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_pooling_layer.cu.o
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_relu_layer.cu.o
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_cudnn_lcn_layer.cu.o] Error 1
CMake Error at cuda_compile_generated_bias_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_bias_layer.cu.o
nvcc fatal : Unsupported gpu architecture 'compute_60'
CMake Error at cuda_compile_generated_crop_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_crop_layer.cu.o
CMake Error at cuda_compile_generated_batch_norm_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_batch_norm_layer.cu.o
nvcc fatal : Unsupported gpu architecture 'compute_60'
make[2]: [ 29%] *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_dropout_layer.cu.o] Error 1nvcc fatal : Unsupported gpu architecture 'compute_60'
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_reduction_layer.cu.o
CMake Error at cuda_compile_generated_cudnn_conv_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_cudnn_conv_layer.cu.o
[ 29%] nvcc fatal : Unsupported gpu architecture 'compute_60'
CMake Error at cuda_compile_generated_base_data_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_base_data_layer.cu.o
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_conv_layer.cu.o] Error 1
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_bnll_layer.cu.o] Error 1
CMake Error at cuda_compile_generated_cudnn_pooling_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_cudnn_pooling_layer.cu.o
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_power_layer.cu.o
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_crop_layer.cu.o] Error 1
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_bias_layer.cu.o] Error 1
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_silence_layer.cu.o
[ 30%] [ 30%] nvcc fatal : Unsupported gpu architecture 'compute_60'
nvcc fatal : Unsupported gpu architecture 'compute_60'
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_absval_layer.cu.o] Error 1
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_batch_norm_layer.cu.o] Error 1
nvcc fatal : Unsupported gpu architecture 'compute_60'
nvcc fatal : Unsupported gpu architecture 'compute_60'
nvcc fatal : Unsupported gpu architecture 'compute_60'
nvcc fatal : Unsupported gpu architecture 'compute_60'
nvcc fatal : Unsupported gpu architecture 'compute_60'
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_sigmoid_layer.cu.o
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_softmax_layer.cu.o
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_scale_layer.cu.o
nvcc fatal : Unsupported gpu architecture 'compute_60'
CMake Error at cuda_compile_generated_cudnn_relu_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_cudnn_relu_layer.cu.o
CMake Error at cuda_compile_generated_embed_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_embed_layer.cu.o
CMake Error at cuda_compile_generated_contrastive_loss_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_contrastive_loss_layer.cu.o
CMake Error at cuda_compile_generated_cudnn_sigmoid_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_cudnn_sigmoid_layer.cu.o
CMake Error at cuda_compile_generated_deconv_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_deconv_layer.cu.o
CMake Error at cuda_compile_generated_elu_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_elu_layer.cu.o
CMake Error at cuda_compile_generated_cudnn_softmax_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_cudnn_softmax_layer.cu.o
CMake Error at cuda_compile_generated_cudnn_lrn_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_cudnn_lrn_layer.cu.o
nvcc fatal : Unsupported gpu architecture 'compute_60'
nvcc fatal : Unsupported gpu architecture 'compute_60'
nvcc fatal : Unsupported gpu architecture 'compute_60'
CMake Error at cuda_compile_generated_exp_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_exp_layer.cu.o
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_base_data_layer.cu.o] Error 1
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_cudnn_conv_layer.cu.o] Error 1
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_contrastive_loss_layer.cu.o] Error 1
[ 31%] Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_slice_layer.cu.o
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_softmax_loss_layer.cu.o
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_cudnn_pooling_layer.cu.o] Error 1
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_cudnn_sigmoid_layer.cu.o] Error 1
CMake Error at cuda_compile_generated_eltwise_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_eltwise_layer.cu.o
CMake Error at cuda_compile_generated_cudnn_tanh_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_cudnn_tanh_layer.cu.o
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_elu_layer.cu.o] Error 1
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_embed_layer.cu.o] Error 1
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_cudnn_relu_layer.cu.o] Error 1
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_deconv_layer.cu.o] Error 1
nvcc fatal : Unsupported gpu architecture 'compute_60'
make[2]: CMake Error at cuda_compile_generated_euclidean_loss_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_euclidean_loss_layer.cu.o
*** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_cudnn_softmax_layer.cu.o] Error 1
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_cudnn_lrn_layer.cu.o] Error 1
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_cudnn_tanh_layer.cu.o] Error 1
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_exp_layer.cu.o] Error 1
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_eltwise_layer.cu.o] Error 1
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_euclidean_loss_layer.cu.o] Error 1
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_split_layer.cu.o
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_threshold_layer.cu.o
nvcc fatal : Unsupported gpu architecture 'compute_60'
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/solvers/./cuda_compile_generated_adadelta_solver.cu.o
CMake Error at cuda_compile_generated_hdf5_data_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_hdf5_data_layer.cu.o
nvcc fatal : Unsupported gpu architecture 'compute_60'
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_tanh_layer.cu.o
CMake Error at cuda_compile_generated_filter_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_filter_layer.cu.o
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/solvers/./cuda_compile_generated_adam_solver.cu.o
nvcc fatal : Unsupported gpu architecture 'compute_60'
nvcc fatal : Unsupported gpu architecture 'compute_60'
CMake Error at cuda_compile_generated_lstm_unit_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_lstm_unit_layer.cu.o
CMake Error at cuda_compile_generated_hdf5_output_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_hdf5_output_layer.cu.o
nvcc fatal : Unsupported gpu architecture 'compute_60'
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_hdf5_data_layer.cu.o] Error 1
nvcc fatal : Unsupported gpu architecture 'compute_60'
CMake Error at cuda_compile_generated_lrn_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_lrn_layer.cu.o
nvcc fatal : Unsupported gpu architecture 'compute_60'
CMake Error at cuda_compile_generated_inner_product_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_inner_product_layer.cu.o
CMake Error at cuda_compile_generated_log_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_log_layer.cu.o
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_filter_layer.cu.o] Error 1
nvcc fatal : Unsupported gpu architecture 'compute_60'
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_hdf5_output_layer.cu.o] Error 1
CMake Error at cuda_compile_generated_mvn_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_mvn_layer.cu.o
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_lstm_unit_layer.cu.o] Error 1
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/solvers/./cuda_compile_generated_adagrad_solver.cu.o
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_lrn_layer.cu.o] Error 1
nvcc fatal : Unsupported gpu architecture 'compute_60'
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_inner_product_layer.cu.o] Error 1
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_log_layer.cu.o] Error 1
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_tile_layer.cu.o
CMake Error at cuda_compile_generated_im2col_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_im2col_layer.cu.o
Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile.dir/solvers/./cuda_compile_generated_nesterov_solver.cu.o
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_mvn_layer.cu.o] Error 1
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_im2col_layer.cu.o] Error 1
nvcc fatal : Unsupported gpu architecture 'compute_60'
CMake Error at cuda_compile_generated_recurrent_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_recurrent_layer.cu.o
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_recurrent_layer.cu.o] Error 1
nvcc fatal : Unsupported gpu architecture 'compute_60'
CMake Error at cuda_compile_generated_prelu_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_prelu_layer.cu.o
nvcc fatal : Unsupported gpu architecture 'compute_60'
nvcc fatal : Unsupported gpu architecture 'compute_60'
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_prelu_layer.cu.o] Error 1
CMake Error at cuda_compile_generated_scale_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_scale_layer.cu.o
CMake Error at cuda_compile_generated_sigmoid_cross_entropy_loss_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_sigmoid_cross_entropy_loss_layer.cu.o
nvcc fatal : Unsupported gpu architecture 'compute_60'
CMake Error at cuda_compile_generated_pooling_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_pooling_layer.cu.o
nvcc fatal : Unsupported gpu architecture 'compute_60'
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_scale_layer.cu.o] Error 1
nvcc fatal : Unsupported gpu architecture 'compute_60'
nvcc fatal : Unsupported gpu architecture 'compute_60'
nvcc fatal : Unsupported gpu architecture 'compute_60'
nvcc fatal : Unsupported gpu architecture 'compute_60'
CMake Error at cuda_compile_generated_softmax_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_softmax_layer.cu.o
CMake Error at cuda_compile_generated_reduction_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_reduction_layer.cu.o
nvcc fatal : Unsupported gpu architecture 'compute_60'
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_sigmoid_cross_entropy_loss_layer.cu.o] Error 1
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_pooling_layer.cu.o] Error 1
CMake Error at cuda_compile_generated_power_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_power_layer.cu.o
nvcc fatal : Unsupported gpu architecture 'compute_60'
CMake Error at cuda_compile_generated_relu_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_relu_layer.cu.o
CMake Error at cuda_compile_generated_slice_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_slice_layer.cu.o
CMake Error at cuda_compile_generated_sigmoid_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_sigmoid_layer.cu.o
CMake Error at cuda_compile_generated_silence_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_silence_layer.cu.o
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_softmax_layer.cu.o] Error 1
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_reduction_layer.cu.o] Error 1
nvcc fatal : Unsupported gpu architecture 'compute_60'
make[2]: CMake Error at cuda_compile_generated_softmax_loss_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_softmax_loss_layer.cu.o
*** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_power_layer.cu.o] Error 1
nvcc fatal : Unsupported gpu architecture 'compute_60'
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_slice_layer.cu.o] Error 1
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_relu_layer.cu.o] Error 1
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_sigmoid_layer.cu.o] Error 1
CMake Error at cuda_compile_generated_adadelta_solver.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/solvers/./cuda_compile_generated_adadelta_solver.cu.o
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_silence_layer.cu.o] Error 1
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_softmax_loss_layer.cu.o] Error 1
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/solvers/./cuda_compile_generated_adadelta_solver.cu.o] Error 1
nvcc fatal : Unsupported gpu architecture 'compute_60'
nvcc fatal : Unsupported gpu architecture 'compute_60'
nvcc fatal : Unsupported gpu architecture 'compute_60'
nvcc fatal : Unsupported gpu architecture 'compute_60'
CMake Error at cuda_compile_generated_adagrad_solver.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/solvers/./cuda_compile_generated_adagrad_solver.cu.o
CMake Error at cuda_compile_generated_tanh_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_tanh_layer.cu.o
CMake Error at cuda_compile_generated_threshold_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_threshold_layer.cu.o
CMake Error at cuda_compile_generated_adam_solver.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/solvers/./cuda_compile_generated_adam_solver.cu.o
nvcc fatal : Unsupported gpu architecture 'compute_60'
CMake Error at cuda_compile_generated_split_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_split_layer.cu.o
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/solvers/./cuda_compile_generated_adagrad_solver.cu.o] Error 1
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_tanh_layer.cu.o] Error 1
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_threshold_layer.cu.o] Error 1
nvcc fatal : Unsupported gpu architecture 'compute_60'
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/solvers/./cuda_compile_generated_adam_solver.cu.o] Error 1
CMake Error at cuda_compile_generated_tile_layer.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_tile_layer.cu.o
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_split_layer.cu.o] Error 1
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/layers/./cuda_compile_generated_tile_layer.cu.o] Error 1
nvcc fatal : Unsupported gpu architecture 'compute_60'
CMake Error at cuda_compile_generated_nesterov_solver.cu.o.cmake:206 (message):
Error generating
/root/caffe/build/src/caffe/CMakeFiles/cuda_compile.dir/solvers/./cuda_compile_generated_nesterov_solver.cu.o
make[2]: *** [src/caffe/CMakeFiles/cuda_compile.dir/solvers/./cuda_compile_generated_nesterov_solver.cu.o] Error 1
make[1]: *** [src/caffe/CMakeFiles/caffe.dir/all] Error 2
make: *** [all] Error 2
The command '/bin/sh -c git clone -b ${CAFFE_VERSION} --depth 1 https://github.com/BVLC/caffe.git /root/caffe && cd /root/caffe && cat python/requirements.txt | xargs -n1 pip install && mkdir build && cd build && cmake -DUSE_CUDNN=1 -DBLAS=Open .. && make -j"$(nproc)" all && make install' returned a non-zero code: 2
Error: Tag gpu not found in repository docker.io/floydhub/dl-docker
Hi, I'm new to docker.
Was able to install it (hello-world works).
Followed your instructions for GPU version.
sudo docker build -t floydhub/dl-docker:gpu -f Dockerfile.gpu .
returned
W: Failed to fetch http://archive.ubuntu.com/ubuntu/dists/trusty-security/main/binary-amd64/Packages Hash Sum mismatch
E: Some index files failed to download. They have been ignored, or old ones used instead.
The command '/bin/sh -c apt-get update && apt-get install -y bc build-essential cmake curl g++ gfortran git libffi-dev libfreetype6-dev libhdf5-dev libjpeg-dev liblcms2-dev libopenblas-dev liblapack-dev libopenjpeg2 libpng12-dev libssl-dev libtiff5-dev libwebp-dev libzmq3-dev nano pkg-config python-dev software-properties-common unzip vim wget zlib1g-dev && apt-get clean && apt-get autoremove && rm -rf /var/lib/apt/lists/* && update-alternatives --set libblas.so.3 /usr/lib/openblas-base/libblas.so.3' returned a non-zero code: 100
And
sudo nvidia-docker run -it -p 8888:8888 -p 6006:6006 -v /sharedfolder:/root/sharedfolder floydhub/dl-docker:gpu bash
returned
Error: Tag gpu not found in repository docker.io/floydhub/dl-docker
What could be the issue?
Theano timeout
I'm running this command sudo docker build -t floydhub/dl-docker:gpu -f Dockerfile.gpu . on my NVidia GTX 1080 Ubuntu 16.04 machine but got this error:
Collecting git+git://github.com/Theano/[email protected]
Cloning git://github.com/Theano/Theano.git (to rel-0.8.2) to /tmp/pip-5nHE0U-build
fatal: unable to connect to github.com:
github.com[0: 192.30.253.112]: errno=Connection timed out
github.com[1: 192.30.253.113]: errno=Connection timed out
Command "git clone -q git://github.com/Theano/Theano.git /tmp/pip-5nHE0U-build" failed with error code 128 in None
The command '/bin/sh -c pip --no-cache-dir install git+git://github.com/Theano/Theano.git@${THEANO_VERSION} && echo "[global]\ndevice=gpu\nfloatX=float32\noptimizer_including=cudnn\nmode=FAST_RUN \n[lib]\ncnmem=0.95 \n[nvcc]\nfastmath=True \n[blas]\nldflag = -L/usr/lib/openblas-base -lopenblas \n[DebugMode]\ncheck_finite=1" > /root/.theanorc' returned a non-zero code: 1
Any ideas?
Torch Docker link broken
I've finally moved "cuda-torch-plus" into a separate repo as it doesn't fit the "minimum viable build" principle for my Dockerfiles. It's up to you whether you want to change the link to the normal image or the mega image.
FYI many people will be upgrading to CUDA 8.0 when it comes out later this year, so keep that in mind for this repo~
GPU Docker on windows
Will the GPU based docker run on windows machine? Read somewhere that GPU passthrough is required
NVIDIA/nvidia-docker#197
port to cudnn5 cuda8, nvidia/cuda:8.0-ubuntu16.04
There's an ubuntu 16.04 available.
iTorch kernel, deepmask, sharpmask
Could you add those?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. ๐๐๐
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google โค๏ธ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.