安装NVIDIA Container Toolkit

Setting up NVIDIA Container Toolkit

# install NVIDIA Container Toolkit

distribution=$(. /etc/os-release;echo $ID$VERSION_ID) \
   && curl -s -L https://nvidia.github.io/nvidia-docker/gpgkey | sudo apt-key add - \
   && curl -s -L https://nvidia.github.io/nvidia-docker/$distribution/nvidia-docker.list | sudo tee /etc/apt/sources.list.d/nvidia-docker.list
   
curl -s -L https://nvidia.github.io/nvidia-container-runtime/experimental/$distribution/nvidia-container-runtime.list | sudo tee /etc/apt/sources.list.d/nvidia-container-runtime.list

sudo apt-get update

sudo apt-get install -y nvidia-docker2

sudo systemctl restart docker


# run a container with gpu

sudo docker run --rm --gpus all nvidia/cuda:11.0-base nvidia-smi
or 
nvidia-docker run --rm all nvidia/cuda:11.0-base nvidia-smi

参考：docs.nvidia.com/datacenter/…