Zhongbo Zhu

Zhongbo Zhu is an AI Developer and Technology Engineer at NVIDIA, specializing in quantized training, CUDA kernel development, and end-to-end performance optimization. He's contributed to the research and productization of NVIDIA FP8 quantized training recipes. Zhongbo holds a Master's degree in Computer Engineering from the University of Illinois at Urbana-Champaign and a Bachelor’s degree in Computer Engineering from Zhejiang University.
Avatar photo

Posts by Zhongbo Zhu

Decorative image.
Generative AI Jul 01, 2025

Per-Tensor and Per-Block Scaling Strategies for Effective FP8 Training

In this blog post, we’ll break down the main FP8 scaling strategies—per-tensor scaling, delayed and current scaling, and per-block scaling (including the... 10 MIN READ