Installing cuDNN Debian Packages

sudo apt install ./cudnn-local-repo-ubuntu2004-*amd64.deb
sudo apt update
sudo apt install libcudnn8
sudo apt install libcudnn8-dev
sudo apt install libcudnn8-samples

Install the cuDNN Debians for cross-compiling on Linux:

sudo dpkg -i cudnn-prune-87-repo-cross-aarch64-ubuntu2004-8-2-local_1.0-1_all.deb
sudo apt update
sudo apt install libcudnn8-cross-aarch64