The CUDA® Toolkit for Arm provides a development environment for creating high performance GPU-accelerated applications on the Arm server platform. With the CUDA Toolkit, you can develop, optimize and deploy your applications on GPU-accelerated Arm systems. The toolkit includes GPU-accelerated libraries, debugging and optimization tools, a C/C++ compiler, and the CUDA runtime and drivers to deploy your application.

This is a technology preview of CUDA for Arm systems. The preview consists of the following components:

  • CUDA Toolkit 10.2 for Arm (RHEL 8.0 and Ubuntu 18.04.3 LTS)
  • NVIDIA CUDA® Deep Neural Network Library (cuDNN) 7.6
  • NVIDIA Collective Communications Library (NCCL) 2.4
The preview is not feature complete and may have issues. The software is intended to aid the CUDA on Arm ecosystem in the development of GPU-accelerated applications.

If you would like to download the software, please register for the NVIDIA developer program. The program is free to join and everyone is accepted. If you are signed up and logged in, you can directly proceed to download the packages.

Join now

Downloads

CUDA Toolkit for RHEL 8.0

Download RPM

Getting Started:

  1. Download the local repository package
  2. Enable the EPEL repository to resolve dependency on DKMS: sudo dnf install https://dl.fedoraproject.org/pub/epel/epel-release-latest-8.noarch.rpm
  3. sudo rpm -i cuda-repo-rhel8-10-2-local-10.2.107-435.17.01-1.0-1.aarch64.rpm
  4. sudo dnf clean all
  5. sudo dnf -y install cuda

CUDA Toolkit for Ubuntu 18.04 LTS

Download DEB

Getting Started:

  1. Download the local repository package
  2. wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64/cuda-ubuntu1804.pin
  3. sudo mv cuda-ubuntu1804.pin /etc/apt/preferences.d/cuda-repository-pin-600
  4. sudo dpkg -i cuda-repo-ubuntu1804-10-2-local-10.2.107-435.17.01_1.0-1_arm64.deb
  5. sudo apt-key add /var/cuda-repo-10-2-local-10.2.107-435.17.01/7fa2af80.pub
  6. sudo apt-get update
  7. sudo apt-get -y install cuda

cuDNN 7.6.4 for Ubuntu 18.04

Download DEB

To get started with installing cuDNN on Linux, follow the steps in the cuDNN Installation Guide.

cuDNN 7.6.4 Tar archive for Linux

Download Tar file

To get started with installing cuDNN on Linux, follow the steps in the cuDNN Installation Guide.

NCCL 2.4.8

Download zip archive with DEB, RPM and Tar archive

This zip archive contains the debian, rpm and tar file packages for NCCL 2.4.8. Users can choose the relevant package for their Linux distribution. To get started with installing NCCL on Linux, follow the steps in the NCCL Installation Guide.