Eric Harper

Eric Harper is a deep learning engineering manager at NVIDIA, where he leads engineering for Megatron Core, an open-source library for training large language models at scale. He leads a team focused on improving the performance, scalability, and usability of distributed training software on NVIDIA GPUs. He holds a Ph.D. in mathematics from the University of Miami.
Eric Harper

Posts by Eric Harper

Agentic AI / Generative AI

Scale Bitwise-Deterministic Pretraining with NVIDIA Megatron Core

Bitwise determinism makes large-scale pretraining easier to debug, validate, and resume reproducibly. These benefits become especially valuable when training... 11 MIN READ