How to Install CUDA on Ubuntu 24.04

Installing CUDA on Ubuntu serves the purpose of leveraging the parallel computing capabilities of NVIDIA GPUs. It significantly accelerates computationally intensive tasks. By installing CUDA, developers can optimize their applications to run on the powerful architecture of NVIDIA GPUs, thus enhancing performance and efficiency.

The installation of CUDA on Ubuntu 24.04 is an interesting process that can significantly enhance the performance of computationally. It is particularly beneficial for applications in scientific simulations, data analysis, and machine learning. 

This guide will provide a detailed overview of the different ways to install CUDA on Ubuntu, ensuring you can select the method that best fits your needs.

  1. How to Install CUDA on Ubuntu 24.04
  2. How to Remove/Uninstall CUDA on Ubuntu 24.04

How to Install CUDA on Ubuntu 24.04

If you’re looking to install CUDA on an Ubuntu system, there are several methods you can follow, each with its own set of steps and requirements. Let’s follow methods:

Method 1: Using Ubuntu’s Standard Repositories

For Ubuntu 24.04, the simplest method to install CUDA is to use the standard repositories provided by Ubuntu. This method may not provide the latest version of CUDA, but it offers a straightforward installation process:

Step 1: Update Package List

In Linux systems to refresh the local package index with the latest information from the repositories, ensuring that subsequent installations or upgrades are made with the most current package versions

sudo apt update

Step 2: Install the CUDA toolkit Package

Let’s install the NVIDIA CUDA Toolkit that facilitates the development of parallel multiple applications. 

sudo apt install nvidia-cuda-toolkit
Install CUDA on Ubuntu 24.04 b

Step 3: Verify CUDA Version

Verify the installation by checking the CUDA version. It displays the version of the NVIDIA CUDA Compiler Driver (NVCC) which is used to compile CUDA programs for NVIDIA GPUs, providing details about the version and build of the compiler:

nvcc --version
Install CUDA on Ubuntu 24.04 a

Method 2: Install CUDA on Ubuntu 24.04 Using Nvidia’s Official Website

Another method is to install CUDA directly from the NVIDIA CUDA repository. This approach is suitable for Ubuntu 24.04 and 24.04 LTS releases:

This setup allows you to leverage the power of your Nvidia GPU for various computing tasks, from deep learning to scientific simulations. To install CUDA on Ubuntu 24.04 via Nvidia’s official website, follow the below steps:

Step 1: Remove Any Previous CUDA Versions

If you have an older version of CUDA installed on your system, it’s essential to remove it to prevent any conflicts:

sudo apt --purge remove "*cud*" "*nvidia*"

Step 2: Update the System

Update the package repository to make sure you have access to the most recent packages:

sudo apt update
sudo apt upgrade

Step 3: Verify CUDA Version

Ubuntu 24.04 should come with the open-source Nouveau driver pre-installed, which needs to be replaced with the official Nvidia driver. Users can install the recommended driver via the following command:

sudo ubuntu-drivers autoinstall
Install CUDA on Ubuntu 24.04  c

Reboot your system after the installation to apply changes.

Step 4: Disable the Nouveau Driver

The Nouveau driver can interfere with the Nvidia driver, so it’s recommended to disable it. You can do this by creating a blacklist file for Nouveau:

echo "blacklist nouveau" | sudo tee /etc/modprobe.d/blacklist-nouveau.conf
Install CUDA on Ubuntu 24.04 d

Then, update the kernel initramfs and reboot:

sudo update-initramfs -u
sudo reboot
Install CUDA on Ubuntu 24.04 e

Step 5: Download and Install the CUDA Toolkit

Visit the Nvidia CUDA Downloads page to download the CUDA Toolkit for Ubuntu 24.04. Choose the deb (local) package which matches your system architecture:

Install CUDA on Ubuntu 24.04 f

Important: After selecting the tabs, follow the pop-up interface at the bottom of the page and execute commands based on the most recent release.

After downloading, install the CUDA Toolkit with the following commands:

wget mv /etc/apt/preferences.d/cuda-repository-pin-600wget
Install CUDA on Ubuntu 24.04 g

Now, install the CUDA Toolkit via the below commands:

sudo dpkg -i cuda-repo-ubuntu2204-12-4-local_12.4.1-550.54.15-1_amd64.deb
sudo cp /var/cuda-repo-ubuntu 2204-12-4-local/cuda-*-keyring.gpg /usr/share/keyrings/
sudo apt update
sudo apt install cuda-toolkit-12-4
Install CUDA on Ubuntu 24.04 h

If users find any error, install the CUDA driver by executing the below command:

sudo nano /etc/apt/sources.list
deb lunar universe
sudo apt update

To install the CUDA driver, use the below command:

sudo apt install cuda-drivers
Install CUDA on Ubuntu 24.04 i

Step 6: Configure PATH

To use the CUDA compiler and tools, add them to your PATH with the following commands:

echo 'export PATH=/usr/local/cuda/bin:$PATH' >>~/.bashrc
echo 'export LD_LIBRARY_PATH=/usr/local/cuda/lib64:$LD_LIBRARY_PATH' >> ~/.bashrc
source ~/.bashrc
Install CUDA on Ubuntu 24.04 j

You have now successfully installed CUDA on Ubuntu 24.04. 

Method 3: Install CUDA on Ubuntu 24.04 Using CUDA Toolkit Runfile 

For those who need the absolute latest version of CUDA or have specific requirements, manual installation might be the way to go:

Step 1: Download CUDA Toolkit Runfile

Download the appropriate CUDA Toolkit runfile from NVIDIA’s website.

Install CUDA on Ubuntu 24.04 l

Or utilize the below command:

Install CUDA on Ubuntu 24.04 m

Step 2: Run Downloaded File 

 Run the downloaded file and follow the guides for completing the installation:

sudo sh
Install CUDA on Ubuntu 24.04 n

Set the necessary environment variables for your system.

Install CUDA on Ubuntu 24.04 o

Step 3: Verify the Installation

To verify that CUDA is installed, reboot the system and run the “nvidia-smi” or “nvcc” command to check the status of the GPU and the installed CUDA version:

nvcc --version
Install CUDA on Ubuntu 24.04 p

By following these steps, a successful installation of CUDA has been done on your Ubuntu 24.04 system.

Remove/Uninstall CUDA on Ubuntu 24.04

To remove CUDA from Ubuntu, you can follow these steps: 

Uninstall CUDA Toolkit 

First, uninstall the CUDA Toolkit by using the “remove” command. It removes the toolkit and associated packages: 

sudo apt --purge remove "*cublas*" "cuda*" "nsight*"

Remove NVIDIA Drivers

If you have NVIDIA drivers installed, you can remove them with the “–purge” utility. After purging the packages, it’s a good practice to run the “autoremove” utility. To remove any unused packages and to clear the local repository of retrieved package files, use the “autoclean” utility:

sudo apt --purge remove "nvidia*"
sudo apt autoremove
sudo apt autoclean

Remove NUDA Directory

If users have installed CUDA by running the run file, remove the installation directory, typically located in “/usr/local/”, with the below command:

sudo rm -rf /usr/local/cuda-<version>

Note: Always ensure to replace “<version>” with the specific version number of CUDA you have installed. 


To install CUDA on Ubuntu 24.04, make the system have a CUDA-capable GPU and meet the necessary system requirements. Begin by removing any existing NVIDIA or CUDA installations to avoid conflicts. Then, you can install the NVIDIA CUDA Toolkit by integrating Nvidia’s official APT repository, which provides the latest drivers and tools for your system. 

This guide has explained all possible methods for installing the CUDA on Ubuntu 24.04.