maxmustermann/nvidia-docker
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity

Split cuda image into runtime and devel

Browse source 
Fixes: #12
Closes: #14
This commit is contained in:
Felix Abecassis 2015-11-20 18:08:10 -08:00
parent 89f32ae398
commit fe36ee3b3f
34 changed files with 277 additions and 48 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

52
README.md
View file

@ -10,32 +10,58 @@ Please be aware that this project is currently **experimental**.
* Reproducible builds
* Ease of deployment
* Isolation of individual devices
* Run across heterogeneous driver/toolkit environments *(e.g. CUDA 7.0 and 7.5 on a single host machine)*
* Run across heterogeneous driver/toolkit environments
* Requires only the NVIDIA driver
### Building images
Images can be built on any machine running Docker, it doesn't require a NVIDIA GPU nor any driver installation.
Building images is done through the Docker CLI or using the ```nvidia-docker``` wrapper similarly:
#### CUDA
Each CUDA image comes in two flavors:
* ```runtime```: a lightweight image containing the bare minimum to deploy a pre-built application which uses CUDA.
* ```devel```: extends the runtime image by adding the compiler toolchain, the debugging tools and the development files for the standard CUDA libraries. Use this image to compile a CUDA application from source.
The ```devel``` image must be built **after** the ```runtime``` image:
```sh
# With latest versions
$ docker build -t cuda ubuntu/cuda/latest
# Building a CUDA 7.5 development image based on Ubuntu
docker build -t cuda:7.5-runtime ubuntu/cuda/7.5/runtime
docker build -t cuda:7.5-devel ubuntu/cuda/7.5/devel
docker tag cuda:7.5-devel cuda
```
```sh
# With specific versions
$ docker build -t cuda:7.5 ubuntu-14.04/cuda/7.5
# Building a CUDA 7.5 development image based on CentOS
docker build -t cuda:7.5-runtime centos/cuda/7.5/runtime
docker build -t cuda:7.5-devel centos/cuda/7.5/devel
docker tag cuda:7.5-devel cuda
```
Alternatively, one can build an image directly from this repository:
```sh
# With latest versions
$ docker build -t cuda github.com/NVIDIA/nvidia-docker#:ubuntu/cuda/latest
# Building a CUDA 7.5 development image based on Ubuntu
docker build -t cuda:7.5-runtime github.com/NVIDIA/nvidia-docker#:ubuntu/cuda/7.5/runtime
docker build -t cuda:7.5-devel github.com/NVIDIA/nvidia-docker#:ubuntu/cuda/7.5/devel
docker tag cuda:7.5-devel cuda
```
#### cuDNN
Currently, only cuDNN v2 based on CUDA 7.0 is supported, this image also comes in two flavors: ```cudnn-runtime``` and ```cudnn-devel```.
```sh
# With specific versions
$ docker build -t cuda:7.5 github.com/NVIDIA/nvidia-docker#:ubuntu-14.04/cuda/7.5
# Building a cuDNN image based on CUDA 7.0 runtime
docker build -t cuda:7.0-runtime ubuntu/cuda/7.0/runtime
docker build -t cuda:7.0-cudnn2-runtime ubuntu/cuda/7.0/runtime/cudnn2
docker tag cuda:7.0-cudnn2-runtime cuda:cudnn-runtime
```
Building the development image requires the ``cuda:7.0-devel`` image:
```sh
# Building a cuDNN image based on CUDA 7.0 development
docker build -t cuda:7.0-runtime ubuntu/cuda/7.0/runtime
docker build -t cuda:7.0-devel ubuntu/cuda/7.0/devel
docker build -t cuda:7.0-cudnn2-devel ubuntu/cuda/7.0/devel/cudnn2
docker tag cuda:7.0-cudnn2-devel cuda:cudnn-devel
```
### NVIDIA Docker wrapper
@ -46,7 +72,7 @@ GPUs are exported through a list of comma-separated IDs using the environment va
The numbering is the same as reported by ```nvidia-smi``` or when running CUDA code with ```CUDA_DEVICE_ORDER=PCI_BUS_ID```, it is however **different** from the default CUDA ordering.
```sh
$ GPU=0,1 ./nvidia-docker <docker-options> <docker-command> <docker-args>
GPU=0,1 ./nvidia-docker <docker-options> <docker-command> <docker-args>
```
### CUDA requirements
@ -66,10 +92,10 @@ CUDA toolkit version | Minimum driver version | Minimum GPU architecture
### Samples
Once you have built the required images, a few examples are provided in the folder ```samples```.
The following assumes that you have an image in your repository named ```cuda``` (see ```samples/deviceQuery/Dockerfile```):
The following assumes that you have an Ubuntu-based CUDA image in your repository (see ```samples/ubuntu/deviceQuery/Dockerfile```):
```sh
# Run deviceQuery with one selected GPU
$ docker build -t device_query samples/deviceQuery
$ docker build -t device_query samples/ubuntu/deviceQuery
$ GPU=0 ./nvidia-docker run device_query
[ NVIDIA ] =INFO= Driver version: 352.39

17
centos-7/cuda/7.0/devel/Dockerfile Normal file
View file

@ -0,0 +1,17 @@
FROM cuda:7.0-runtime
MAINTAINER NVIDIA CORPORATION <digits@nvidia.com>
RUN yum install -y \
cuda-core-$CUDA_PKG_VERSION \
cuda-misc-headers-$CUDA_PKG_VERSION \
cuda-command-line-tools-$CUDA_PKG_VERSION \
cuda-license-$CUDA_PKG_VERSION \
cuda-cublas-dev-$CUDA_PKG_VERSION \
cuda-cufft-dev-$CUDA_PKG_VERSION \
cuda-curand-dev-$CUDA_PKG_VERSION \
cuda-cusparse-dev-$CUDA_PKG_VERSION \
cuda-npp-dev-$CUDA_PKG_VERSION \
cuda-cudart-dev-$CUDA_PKG_VERSION \
cuda-driver-dev-$CUDA_PKG_VERSION \
gcc-c++ && \
rm -rf /var/cache/yum/*

12
centos-7/cuda/7.0/Dockerfile → centos-7/cuda/7.0/runtime/Dockerfile
View file

@ -11,9 +11,17 @@ COPY cuda.repo /etc/yum.repos.d/cuda.repo
ENV CUDA_VERSION 7.0
LABEL com.nvidia.cuda.version="7.0"
ENV CUDA_PKG_VERSION 7-0-7.0-28
RUN yum install -y \
cuda-toolkit-7-0-7.0-28 \
gcc-c++ && \
cuda-nvrtc-$CUDA_PKG_VERSION \
cuda-cusolver-$CUDA_PKG_VERSION \
cuda-cublas-$CUDA_PKG_VERSION \
cuda-cufft-$CUDA_PKG_VERSION \
cuda-curand-$CUDA_PKG_VERSION \
cuda-cusparse-$CUDA_PKG_VERSION \
cuda-npp-$CUDA_PKG_VERSION \
cuda-cudart-$CUDA_PKG_VERSION && \
ln -s cuda-$CUDA_VERSION /usr/local/cuda && \
rm -rf /var/cache/yum/*
RUN echo "/usr/local/cuda/lib" >> /etc/ld.so.conf.d/cuda.conf && \

0
centos-7/cuda/7.0/cuda.repo → centos-7/cuda/7.0/runtime/cuda.repo
View file

17
centos-7/cuda/7.5/devel/Dockerfile Normal file
View file

@ -0,0 +1,17 @@
FROM cuda:7.5-runtime
MAINTAINER NVIDIA CORPORATION <digits@nvidia.com>
RUN yum install -y \
cuda-core-$CUDA_PKG_VERSION \
cuda-misc-headers-$CUDA_PKG_VERSION \
cuda-command-line-tools-$CUDA_PKG_VERSION \
cuda-license-$CUDA_PKG_VERSION \
cuda-cublas-dev-$CUDA_PKG_VERSION \
cuda-cufft-dev-$CUDA_PKG_VERSION \
cuda-curand-dev-$CUDA_PKG_VERSION \
cuda-cusparse-dev-$CUDA_PKG_VERSION \
cuda-npp-dev-$CUDA_PKG_VERSION \
cuda-cudart-dev-$CUDA_PKG_VERSION \
cuda-driver-dev-$CUDA_PKG_VERSION \
gcc-c++ && \
rm -rf /var/cache/yum/*

11
centos-7/cuda/7.5/Dockerfile → centos-7/cuda/7.5/runtime/Dockerfile
View file

@ -11,8 +11,17 @@ COPY cuda.repo /etc/yum.repos.d/cuda.repo
ENV CUDA_VERSION 7.5
LABEL com.nvidia.cuda.version="7.5"
ENV CUDA_PKG_VERSION 7-5-7.5-18
RUN yum install -y \
cuda-toolkit-7-5-7.5-18 && \
cuda-nvrtc-$CUDA_PKG_VERSION \
cuda-cusolver-$CUDA_PKG_VERSION \
cuda-cublas-$CUDA_PKG_VERSION \
cuda-cufft-$CUDA_PKG_VERSION \
cuda-curand-$CUDA_PKG_VERSION \
cuda-cusparse-$CUDA_PKG_VERSION \
cuda-npp-$CUDA_PKG_VERSION \
cuda-cudart-$CUDA_PKG_VERSION && \
ln -s cuda-$CUDA_VERSION /usr/local/cuda && \
rm -rf /var/cache/yum/*
RUN echo "/usr/local/cuda/lib" >> /etc/ld.so.conf.d/cuda.conf && \

0
centos-7/cuda/7.5/cuda.repo → centos-7/cuda/7.5/runtime/cuda.repo
View file

1
centos-7/cuda/latest
View file

@ -1 +0,0 @@
7.5

6
samples/bandwidthTest/Dockerfile
View file

@ -1,6 +0,0 @@
FROM cuda:latest
WORKDIR /usr/local/cuda/samples/1_Utilities/bandwidthTest
RUN make
CMD ./bandwidthTest --mode=shmoo

10
samples/centos/bandwidthTest/Dockerfile Normal file
View file

@ -0,0 +1,10 @@
FROM cuda
RUN yum install -y \
cuda-samples-$CUDA_PKG_VERSION && \
rm -rf /var/cache/yum/*
WORKDIR /usr/local/cuda/samples/1_Utilities/bandwidthTest
RUN make
CMD ./bandwidthTest --mode=shmoo

10
samples/centos/deviceQuery/Dockerfile Normal file
View file

@ -0,0 +1,10 @@
FROM cuda
RUN yum install -y \
cuda-samples-$CUDA_PKG_VERSION && \
rm -rf /var/cache/yum/*
WORKDIR /usr/local/cuda/samples/1_Utilities/deviceQuery
RUN make
CMD ./deviceQuery

10
samples/centos/matrixMulCUBLAS/Dockerfile Normal file
View file

@ -0,0 +1,10 @@
FROM cuda
RUN yum install -y \
cuda-samples-$CUDA_PKG_VERSION && \
rm -rf /var/cache/yum/*
WORKDIR /usr/local/cuda/samples/0_Simple/matrixMulCUBLAS
RUN make
CMD ./matrixMulCUBLAS -sizemult=10

2
samples/nvidia-smi/Dockerfile → samples/centos/nvidia-smi/Dockerfile
View file

@ -1,3 +1,3 @@
FROM cuda:latest
FROM cuda
CMD nvidia-smi -q

10
samples/centos/vectorAdd/Dockerfile Normal file
View file

@ -0,0 +1,10 @@
FROM cuda
RUN yum install -y \
cuda-samples-$CUDA_PKG_VERSION && \
rm -rf /var/cache/yum/*
WORKDIR /usr/local/cuda/samples/0_Simple/vectorAdd
RUN make
CMD ./vectorAdd

6
samples/deviceQuery/Dockerfile
View file

@ -1,6 +0,0 @@
FROM cuda:latest
WORKDIR /usr/local/cuda/samples/1_Utilities/deviceQuery
RUN make
CMD ./deviceQuery

6
samples/matrixMulCUBLAS/Dockerfile
View file

@ -1,6 +0,0 @@
FROM cuda:latest
WORKDIR /usr/local/cuda/samples/0_Simple/matrixMulCUBLAS
RUN make
CMD ./matrixMulCUBLAS -sizemult=10

10
samples/ubuntu/bandwidthTest/Dockerfile Normal file
View file

@ -0,0 +1,10 @@
FROM cuda
RUN apt-get update && apt-get install -y --no-install-recommends \
cuda-samples-$CUDA_PKG_VERSION && \
rm -rf /var/lib/apt/lists/*
WORKDIR /usr/local/cuda/samples/1_Utilities/bandwidthTest
RUN make
CMD ./bandwidthTest --mode=shmoo

10
samples/ubuntu/deviceQuery/Dockerfile Normal file
View file

@ -0,0 +1,10 @@
FROM cuda
RUN apt-get update && apt-get install -y --no-install-recommends \
cuda-samples-$CUDA_PKG_VERSION && \
rm -rf /var/lib/apt/lists/*
WORKDIR /usr/local/cuda/samples/1_Utilities/deviceQuery
RUN make
CMD ./deviceQuery

10
samples/ubuntu/matrixMulCUBLAS/Dockerfile Normal file
View file

@ -0,0 +1,10 @@
FROM cuda
RUN apt-get update && apt-get install -y --no-install-recommends \
cuda-samples-$CUDA_PKG_VERSION && \
rm -rf /var/lib/apt/lists/*
WORKDIR /usr/local/cuda/samples/0_Simple/matrixMulCUBLAS
RUN make
CMD ./matrixMulCUBLAS -sizemult=10

3
samples/ubuntu/nvidia-smi/Dockerfile Normal file
View file

@ -0,0 +1,3 @@
FROM cuda
CMD nvidia-smi -q

10
samples/ubuntu/vectorAdd/Dockerfile Normal file
View file

@ -0,0 +1,10 @@
FROM cuda
RUN apt-get update && apt-get install -y --no-install-recommends \
cuda-samples-$CUDA_PKG_VERSION && \
rm -rf /var/lib/apt/lists/*
WORKDIR /usr/local/cuda/samples/0_Simple/vectorAdd
RUN make
CMD ./vectorAdd

6
samples/vectorAdd/Dockerfile
View file

@ -1,6 +0,0 @@
FROM cuda:latest
WORKDIR /usr/local/cuda/samples/0_Simple/vectorAdd
RUN make
CMD ./vectorAdd

16
ubuntu-14.04/cuda/6.5/devel/Dockerfile Normal file
View file

@ -0,0 +1,16 @@
FROM cuda:6.5-runtime
MAINTAINER NVIDIA CORPORATION <digits@nvidia.com>
RUN apt-get update && apt-get install -y --no-install-recommends --force-yes \
cuda-core-$CUDA_PKG_VERSION \
cuda-misc-headers-$CUDA_PKG_VERSION \
cuda-command-line-tools-$CUDA_PKG_VERSION \
cuda-license-$CUDA_PKG_VERSION \
cuda-cublas-dev-$CUDA_PKG_VERSION \
cuda-cufft-dev-$CUDA_PKG_VERSION \
cuda-curand-dev-$CUDA_PKG_VERSION \
cuda-cusparse-dev-$CUDA_PKG_VERSION \
cuda-npp-dev-$CUDA_PKG_VERSION \
cuda-cudart-dev-$CUDA_PKG_VERSION \
cuda-driver-dev-$CUDA_PKG_VERSION && \
rm -rf /var/lib/apt/lists/*

9
ubuntu-14.04/cuda/6.5/Dockerfile → ubuntu-14.04/cuda/6.5/runtime/Dockerfile
View file

@ -12,8 +12,15 @@ RUN apt-key adv --fetch-keys http://developer.download.nvidia.com/compute/cuda/r
ENV CUDA_VERSION 6.5
LABEL com.nvidia.cuda.version="6.5"
ENV CUDA_PKG_VERSION 6-5=6.5-19
RUN apt-get update && apt-get install -y --no-install-recommends --force-yes \
cuda-toolkit-6-5=6.5-19 && \
cuda-cublas-$CUDA_PKG_VERSION \
cuda-cufft-$CUDA_PKG_VERSION \
cuda-curand-$CUDA_PKG_VERSION \
cuda-cusparse-$CUDA_PKG_VERSION \
cuda-npp-$CUDA_PKG_VERSION \
cuda-cudart-$CUDA_PKG_VERSION && \
ln -s cuda-$CUDA_VERSION /usr/local/cuda && \
rm -rf /var/lib/apt/lists/*
RUN echo "/usr/local/cuda/lib" >> /etc/ld.so.conf.d/cuda.conf && \

1
ubuntu-14.04/cuda/7.0/cudnn
View file

@ -1 +0,0 @@
cudnn-v2

18
ubuntu-14.04/cuda/7.0/devel/Dockerfile Normal file
View file

@ -0,0 +1,18 @@
FROM cuda:7.0-runtime
MAINTAINER NVIDIA CORPORATION <digits@nvidia.com>
RUN apt-get update && apt-get install -y --no-install-recommends --force-yes \
cuda-core-$CUDA_PKG_VERSION \
cuda-misc-headers-$CUDA_PKG_VERSION \
cuda-command-line-tools-$CUDA_PKG_VERSION \
cuda-license-$CUDA_PKG_VERSION \
cuda-nvrtc-dev-$CUDA_PKG_VERSION \
cuda-cusolver-dev-$CUDA_PKG_VERSION \
cuda-cublas-dev-$CUDA_PKG_VERSION \
cuda-cufft-dev-$CUDA_PKG_VERSION \
cuda-curand-dev-$CUDA_PKG_VERSION \
cuda-cusparse-dev-$CUDA_PKG_VERSION \
cuda-npp-dev-$CUDA_PKG_VERSION \
cuda-cudart-dev-$CUDA_PKG_VERSION \
cuda-driver-dev-$CUDA_PKG_VERSION && \
rm -rf /var/lib/apt/lists/*

1
ubuntu-14.04/cuda/7.0/devel/cudnn Symbolic link
View file

@ -0,0 +1 @@
cudnn2

3
ubuntu-14.04/cuda/7.0/cudnn-v2/Dockerfile → ubuntu-14.04/cuda/7.0/devel/cudnn2/Dockerfile
View file

@ -1,10 +1,11 @@
FROM cuda:7.0
FROM cuda:7.0-devel
MAINTAINER NVIDIA CORPORATION <digits@nvidia.com>
RUN apt-get update && apt-get install -y \
curl && \
rm -rf /var/lib/apt/lists/*
ENV CUDNN_VERSION 2
ENV CUDNN_DOWNLOAD_SUM 4b02cb6bf9dfa57f63bfff33e532f53e2c5a12f9f1a1b46e980e626a55f380aa
RUN curl -fsSL http://developer.download.nvidia.com/compute/redist/cudnn/v2/cudnn-6.5-linux-x64-v2.tgz -O && \

11
ubuntu-14.04/cuda/7.0/Dockerfile → ubuntu-14.04/cuda/7.0/runtime/Dockerfile
View file

@ -12,8 +12,17 @@ RUN apt-key adv --fetch-keys http://developer.download.nvidia.com/compute/cuda/r
ENV CUDA_VERSION 7.0
LABEL com.nvidia.cuda.version="7.0"
ENV CUDA_PKG_VERSION 7-0=7.0-28
RUN apt-get update && apt-get install -y --no-install-recommends --force-yes \
cuda-toolkit-7-0=7.0-28 && \
cuda-nvrtc-$CUDA_PKG_VERSION \
cuda-cusolver-$CUDA_PKG_VERSION \
cuda-cublas-$CUDA_PKG_VERSION \
cuda-cufft-$CUDA_PKG_VERSION \
cuda-curand-$CUDA_PKG_VERSION \
cuda-cusparse-$CUDA_PKG_VERSION \
cuda-npp-$CUDA_PKG_VERSION \
cuda-cudart-$CUDA_PKG_VERSION && \
ln -s cuda-$CUDA_VERSION /usr/local/cuda && \
rm -rf /var/lib/apt/lists/*
RUN echo "/usr/local/cuda/lib" >> /etc/ld.so.conf.d/cuda.conf && \

1
ubuntu-14.04/cuda/7.0/runtime/cudnn Symbolic link
View file

@ -0,0 +1 @@
cudnn2

16
ubuntu-14.04/cuda/7.0/runtime/cudnn2/Dockerfile Normal file
View file

@ -0,0 +1,16 @@
FROM cuda:7.0-runtime
MAINTAINER NVIDIA CORPORATION <digits@nvidia.com>
RUN apt-get update && apt-get install -y \
curl && \
rm -rf /var/lib/apt/lists/*
ENV CUDNN_VERSION 2
ENV CUDNN_DOWNLOAD_SUM 4b02cb6bf9dfa57f63bfff33e532f53e2c5a12f9f1a1b46e980e626a55f380aa
RUN curl -fsSL http://developer.download.nvidia.com/compute/redist/cudnn/v2/cudnn-6.5-linux-x64-v2.tgz -O && \
echo "$CUDNN_DOWNLOAD_SUM cudnn-6.5-linux-x64-v2.tgz" | sha256sum -c --strict - && \
tar -xzf cudnn-6.5-linux-x64-v2.tgz && \
mv cudnn-6.5-linux-x64-v2/libcudnn.so* /usr/local/cuda/lib64 && \
rm -rf cudnn-6.5-linux-x64-v2* && \
ldconfig

18
ubuntu-14.04/cuda/7.5/devel/Dockerfile Normal file
View file

@ -0,0 +1,18 @@
FROM cuda:7.5-runtime
MAINTAINER NVIDIA CORPORATION <digits@nvidia.com>
RUN apt-get update && apt-get install -y --no-install-recommends --force-yes \
cuda-core-$CUDA_PKG_VERSION \
cuda-misc-headers-$CUDA_PKG_VERSION \
cuda-command-line-tools-$CUDA_PKG_VERSION \
cuda-license-$CUDA_PKG_VERSION \
cuda-nvrtc-dev-$CUDA_PKG_VERSION \
cuda-cusolver-dev-$CUDA_PKG_VERSION \
cuda-cublas-dev-$CUDA_PKG_VERSION \
cuda-cufft-dev-$CUDA_PKG_VERSION \
cuda-curand-dev-$CUDA_PKG_VERSION \
cuda-cusparse-dev-$CUDA_PKG_VERSION \
cuda-npp-dev-$CUDA_PKG_VERSION \
cuda-cudart-dev-$CUDA_PKG_VERSION \
cuda-driver-dev-$CUDA_PKG_VERSION && \
rm -rf /var/lib/apt/lists/*

11
ubuntu-14.04/cuda/7.5/Dockerfile → ubuntu-14.04/cuda/7.5/runtime/Dockerfile
View file

@ -12,8 +12,17 @@ RUN apt-key adv --fetch-keys http://developer.download.nvidia.com/compute/cuda/r
ENV CUDA_VERSION 7.5
LABEL com.nvidia.cuda.version="7.5"
ENV CUDA_PKG_VERSION 7-5=7.5-18
RUN apt-get update && apt-get install -y --no-install-recommends --force-yes \
cuda-toolkit-7-5=7.5-18 && \
cuda-nvrtc-$CUDA_PKG_VERSION \
cuda-cusolver-$CUDA_PKG_VERSION \
cuda-cublas-$CUDA_PKG_VERSION \
cuda-cufft-$CUDA_PKG_VERSION \
cuda-curand-$CUDA_PKG_VERSION \
cuda-cusparse-$CUDA_PKG_VERSION \
cuda-npp-$CUDA_PKG_VERSION \
cuda-cudart-$CUDA_PKG_VERSION && \
ln -s cuda-$CUDA_VERSION /usr/local/cuda && \
rm -rf /var/lib/apt/lists/*
RUN echo "/usr/local/cuda/lib" >> /etc/ld.so.conf.d/cuda.conf && \

1
ubuntu-14.04/cuda/latest
View file

@ -1 +0,0 @@
7.5