Jeremy Berchtold

Jeremy Berchtold is a senior software performance engineer at NVIDIA developing Transformer Engine, a library for accelerating large-scale transformer model training and inference. His work focuses on Transformer Engine JAX integrations and optimized implementations for Mixture of Experts, quantization, attention, and other performance-critical model components. Prior to Transformer Engine, he contributed to the autonomous vehicle stack at NVIDIA, focusing on complex intersection and junction handling.