GTC 2020: An Overview of GPU Recurrent Neural Network Performance
After clicking “Watch Now” you will be prompted to login or join.
Click “Watch Now” to login or join the NVIDIA Developer Program.
An Overview of GPU Recurrent Neural Network Performance
Jeremy Appleyard, NVIDIA
We'll focus on performance of recurrent neural networks (RNNs) at the sub-framework level. There are several distinct methods one can use to implement an RNN, each with advantages and disadvantages, and the right choice will depend on both the target GPU and the network hyperparameters. We'll cover these methods in detail and give approximate hyper-parameter ranges for each method.