Scaling Deep Learning Training with NCCL

Accelerated Computing, Artificial Intelligence, DGX-1, DGX-2, InfiniBand, NCCL, NVLink, open source

Nadeem Mohammad, posted Sep 26 2018

NVIDIA Collective Communications Library (NCCL) provides optimized implementation of inter-GPU communication operations, such as allreduce and variants.

Read more

NVIDIA Deep Learning SDK Update for Volta Now Available

News, Research, cuDNN, Machine Learning & Artificial Intelligence, NCCL, Tesla

Nadeem Mohammad, posted Aug 08 2017

At GTC 2017, NVIDIA announced Volta optimized updates to the NVIDIA Deep Learning SDK. Today, we’re making these updates available as free downloads to members of the NVIDIA Developer Program.

Read more