Johannes Reifferscheid

Johannes Reifferscheid is a principal software engineer at NVIDIA, working on machine learning compilers and serving as a co-maintainer of XLA. He holds a master’s degree in Computer Science from Technical University of Munich.
Avatar photo

Posts by Johannes Reifferscheid

Agentic AI / Generative AI Jul 10, 2026

Reducing High-Bandwidth Memory Bottlenecks in JAX-Based LLM Training with Host Offloading

Large language model (LLM) training workloads increasingly run into GPU memory limits before compute is fully used. Model weights, gradients, optimizer states,... 9 MIN READ