Sylvain Jeaugey

Sylvain Jeaugey is a senior software engineer at NVIDIA developing the NCCL library since its creation in 2015. He has 15 years of experience in large scale distributed computing. He has been working on various MPI implementations, developing and integrating high-speed networks technologies, and designing large network fabrics.
Avatar photo

Posts by Sylvain Jeaugey

Data Science Feb 28, 2022

Doubling all2all Performance with NVIDIA Collective Communication Library 2.12

Collective communications are a performance-critical ingredient of modern distributed AI training workloads such as recommender systems and natural language... 8 MIN READ
Data Science Feb 04, 2019

Massively Scale Your Deep Learning Training with NCCL 2.4

Imagine using tens of thousands of GPUs to train your neural network. Using multiple GPUs to train neural networks has become quite common with all deep... 8 MIN READ
Simulation / Modeling / Design Sep 26, 2018

Scaling Deep Learning Training with NCCL

NVIDIA Collective Communications Library (NCCL) provides optimized implementation of inter-GPU communication operations, such as allreduce and variants.... 6 MIN READ