Skip to content

Latest commit

 

History

History
176 lines (144 loc) · 8.34 KB

README.md

File metadata and controls

176 lines (144 loc) · 8.34 KB
Raw

CUDA Installation and Setup Reminder

Reference by: Managing Multiple CUDA + cuDNN Installations

Install Driver

/

Install CUDA

Download CUDA Installer Download Link

  • Check GPU driver version and CUDA upper limit

    user@admin1:~$ nvidia-smi
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 560.28.03              Driver Version: 560.28.03      CUDA Version: 12.6     |
|-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA GeForce RTX 3070        Off |   00000000:01:00.0  On |                  N/A |
|  0%   55C    P8             19W /  220W |     569MiB /   8192MiB |      0%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+
	                                                                                     
+-----------------------------------------------------------------------------------------+
| Processes:                                                                              |
|  GPU   GI   CI        PID   Type   Process name                              GPU Memory |
|        ID   ID                                                               Usage      |
|=========================================================================================|
|    0   N/A  N/A      1412      G   /usr/lib/xorg/Xorg                            277MiB |
|    0   N/A  N/A      1949      G   /usr/bin/gnome-shell                           79MiB |
|    0   N/A  N/A      6801      G   ...93,262144 --variations-seed-version         87MiB |
|    0   N/A  N/A    153603      G   ...irefox/4698/usr/lib/firefox/firefox          0MiB |
|    0   N/A  N/A    222999      G   ...erProcess --variations-seed-version         53MiB |
+-----------------------------------------------------------------------------------------+
    • My driver version is 560.28.03 and the highest cudatoolkit version I can install is 12.6

  • Check Architecture

    user@admin1:~$ uname -m
x86_64

  • Check Distribution and Version

    user@admin1:~$ lsb_release -a
No LSB modules are available.
Distributor ID:	Ubuntu
Description:	Ubuntu 22.04.4 LTS
Release:	22.04
Codename:	jammy

  • Download cuda_installer.run

    • It's better to install the *.run file 

      user@admin1:~/Downloads$ wget https://developer.download.nvidia.com/compute/cuda/12.1.0/local_installers/cuda_12.1.0_530.30.02_linux.run

  • Install cuda_installer.run

    user@admin1:~/Downloads$ sudo sh cuda_12.1.0_530.30.02_linux.run --silent --toolkit --toolkitpath=/usr/local/cuda-12.1

    • --silent
      This will force installer to do everything in a silence without any user-interaction.

    • --toolkit
      Install only the toolkit, no drivers, samples, documentation etc

    • --toolkitpath
      By default, it will install into the folder /usr/local/cuda-xx.x according to the version, but if you wish to install into a different folder you can specify it here. I have explicitly given it the default path just for demonstration.

IMPORTANT: The installer creates a symbolic link /usr/local/cuda that points to the actual installation folder /usr/local/cuda-12.1. The previous version of CUDA that stored in the symbolic link /usr/local/cuda will be replaced by /usr/local/cuda-12.1.

Install the cuDNN package

cuDNN package Download Link

  • Select the latest cuDNN v8.9.7 (December 5th, 2023), for CUDA 12.x (Tar) package, since our CUDA Installer is CUDA 12.1

  • Extract files from the tar file

    user@admin1:~/Downloads$ tar -xvf cudnn-linux-x86_64-8.9.7.29_cuda12-archive.tar.xz

  • Copy cuDNN files to CUDA toolkit directory

    user@admin1:~/Downloads$ cd cudnn-linux-x86_64-8.9.7.29_cuda12-archive ### Get into the directory
user@admin1:~/Downloads/cudnn-linux-x86_64-8.9.7.29_cuda12-archive$ sudo cp -P include/cudnn*.h /usr/local/cuda-12.1/include ### # Copy include files
user@admin1:~/Downloads/cudnn-linux-x86_64-8.9.7.29_cuda12-archive$ sudo cp -P lib/libcudnn* /usr/local/cuda-12.1/lib64 ### Copy lib files (it could be lib or lib64)
    user@admin1:~/Downloads$ sudo chmod a+r /usr/local/cuda-12.1/include/cudnn*.h ### Set read permissions of files for all users
user@admin1:~/Downloads$ sudo chmod a+r /usr/local/cuda-12.1/lib64/libcudnn* ### Set read permissions of files for all users

  • Update Environment Variables

    • update the .bashrc or .bash_profile or .zshrc or .profile hidden file

      user@admin1:~/home$ nano ~/.bashrc
      #.bashrc
### Append this 3 line at the bottom of the `.bashrc`

export PATH=/usr/local/cuda/bin:$PATH
export CUDA_HOME=/usr/local/cuda
export LD_LIBRARY_PATH=/usr/local/cuda/lib64:$LD_LIBRARY_PATH

  • Version Control of CUDA

    • update-alternatives command can help for managing symbolic links

      user@admin1:~$ sudo apt-get install update-alternatives ### Install package

    • Check current status, update-alternatives --display <name>

      user@admin1:~$ sudo update-alternatives --display cuda
cuda - manual mode
    link best version is /usr/local/cuda-11.7
    link currently points to /usr/local/cuda-12.6
    link cuda is /usr/local/cuda
/usr/local/cuda-11.7 - priority 11
/usr/local/cuda-12.6 - priority 9

    • Add new link, update-alternatives --install <link> <name> <path> <priority>

      user@admin1:~$ sudo update-alternatives --install /usr/local/cuda cuda /usr/local/cuda-12.1 10

      • <link> : Symbolic link --> /usr/local/cuda

      • <name> : Name of symbolic link --> cuda

      • <path> : Installation path of cuda-12.1 --> /usr/local/cuda-12.1

      • <priority> : Selection priority rank --> 10

    • Select CUDA version, update-alternatives --config <name>

      user@admin1:~$ sudo update-alternatives --config cuda
There are 3 choices for the alternative cuda (providing /usr/local/cuda).

  Selection    Path                   Priority   Status
  ------------------------------------------------------------
  0            /usr/local/cuda-11.7   11         auto mode
  1            /usr/local/cuda-11.7   11         manual mode
  2            /usr/local/cuda-12.1   10         manual mode
* 3            /usr/local/cuda-12.6   9          manual mode

Press <enter> to keep the current choice[*], or type selection number:

    • Verify the CUDA version, nvcc --version

      user@admin1:~$ nvcc -V
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2023 NVIDIA Corporation
Built on Tue_Feb__7_19:32:13_PST_2023
Cuda compilation tools, release 12.1, V12.1.66
Build cuda_12.1.r12.1/compiler.32415258_0

    • Removing An Alternative, sudo update-alternatives --remove <name> <path>

      user@admin1:~$ update-alternatives --list cuda ### List all cuda alternatives
user@admin1:~$ sudo update-alternatives --remove cuda /usr/local/cuda-11.7 ### Remove an alternative