Michael Carilli

Michael Carilli is a Senior Developer Technology Engineer on the Deep Learning Frameworks team at Nvidia. His focus is making mixed-precision and multi-GPU training in PyTorch fast, numerically stable, and easy to use. Previously, he worked at the Air Force Research Laboratory optimizing CFD code for modern parallel architectures. He holds a PhD in computational physics from the University of California, Santa Barbara.

Posts by Michael Carilli

Technical Walkthrough 0

NVIDIA Apex: Tools for Easy Mixed-Precision Training in PyTorch

Most deep learning frameworks, including PyTorch, train using 32-bit floating point (FP32) arithmetic by default. However, using FP32 for all operations is not… 8 MIN READ
Technical Walkthrough 0

New Optimizations To Accelerate Deep Learning Training on NVIDIA GPUs

The pace of AI adoption across diverse industries depends on maximizing data scientists’ productivity. NVIDIA releases optimized NGC containers every month with… 12 MIN READ