Yan Xu

Yan Xu is a senior AI software engineer working on large-scale language model training with Megatron Core at NVIDIA. He develops tools and techniques that make pretraining more efficient, reproducible, and easier to debug. He holds an M.S. in Computer Science from the University of Maryland, College Park.
Yan Xu

Posts by Yan Xu

Agentic AI / Generative AI

Scale Bitwise-Deterministic Pretraining with NVIDIA Megatron Core

Bitwise determinism makes large-scale pretraining easier to debug, validate, and resume reproducibly. These benefits become especially valuable when training... 11 MIN READ