Michael Carilli

Michael Carilli is a Senior Developer Technology Engineer on the Deep Learning Frameworks team at Nvidia. His focus is making mixed-precision and multi-GPU training in PyTorch fast, numerically stable, and easy to use. Previously, he worked at the Air Force Research Laboratory optimizing CFD code for modern parallel architectures. He holds a PhD in computational physics from the University of California, Santa Barbara.
Avatar photo

Posts by Michael Carilli

Simulation / Modeling / Design

NVIDIA Apex: Tools for Easy Mixed-Precision Training in PyTorch

Most deep learning frameworks, including PyTorch, train using 32-bit floating point (FP32) arithmetic by default. However, using FP32 for all operations is not... 8 MIN READ
Data Science

New Optimizations To Accelerate Deep Learning Training on NVIDIA GPUs

The pace of AI adoption across diverse industries depends on maximizing data scientists’ productivity. NVIDIA releases optimized NGC containers every month... 12 MIN READ