Ashwath Aithal

Ashwath Aithal is a director of AI and deep learning systems and algorithms at NVIDIA, where he leads teams developing software for training and optimizing large AI models. His work spans NVIDIA Megatron Core, NVIDIA NeMo, and NeMo RL, with a focus on scalable distributed training, reinforcement learning, and performance optimization. He holds a master's degree in electrical and computer engineering from Rutgers University.
Avatar photo

Posts by Ashwath Aithal

Agentic AI / Generative AI

Scale Bitwise-Deterministic Pretraining with NVIDIA Megatron Core

Bitwise determinism makes large-scale pretraining easier to debug, validate, and resume reproducibly. These benefits become especially valuable when training... 11 MIN READ