Dheevatsa Mudigere

Dheevatsa Mudigere is a senior distinguished engineer in the NVIDIA Compute Architecture group, focusing on the application-driven co-design of large-scale AI systems. He and his team work on understanding current and future AI applications and developing HW/SW technology to enable more capable and efficient AI systems. Before NVIDIA, he worked on designing, building, and deploying production hyperscale AI systems.
Avatar photo

Posts by Dheevatsa Mudigere

Deocrative image.
Data Center / Cloud Jul 06, 2026

Enhancing Goodput in Large-Scale LLM Training with Nonuniform Tensor Parallelism

Training LLMs at massive scale brings unique infrastructure challenges, especially as jobs span thousands of GPUs and run for extended periods. The longer these... 7 MIN READ
Decorative image.
Data Center / Cloud May 21, 2026

Unlock Exascale Performance on NVIDIA GB200 NVL72 with Slurm Topology-Aware Job Scheduling

As AI models grow in scale and complexity, realizing the full performance of modern accelerated infrastructure depends as much on how workloads are placed as on... 10 MIN READ
Developer Tools & Techniques Apr 22, 2026

Advancing Emerging Optimizers for Accelerated LLM Training with NVIDIA Megatron

Higher-order optimization algorithms such as Shampoo have been effectively applied in neural network training for at least a decade. These methods have achieved... 9 MIN READ
A multi-data center illustration.
Data Center / Cloud May 08, 2025

Turbocharge LLM Training Across Long-Haul Data Center Networks with NVIDIA Nemo Framework

Multi-data center training is becoming essential for AI factories as pretraining scaling fuels the creation of even larger models, leading the demand for... 6 MIN READ