Michael Goldfarb

Michael Goldfarb is a senior performance engineer on the End-to-End Training team at NVIDIA. He is currently supporting large scale JAX training performance and custom kernel development and integration for CuteDSL and cuTile. He holds a master’s degree in Electrical and Computer Engineering from Purdue University.
Avatar photo

Posts by Michael Goldfarb

Agentic AI / Generative AI Jul 10, 2026

Reducing High-Bandwidth Memory Bottlenecks in JAX-Based LLM Training with Host Offloading

Large language model (LLM) training workloads increasingly run into GPU memory limits before compute is fully used. Model weights, gradients, optimizer states,... 9 MIN READ