Guohao Wu

Guohao Wu is a senior deep learning engineer at Kuaishou. He focuses on developing and optimizing Kling base model training efficiency. He holds a B.E. in Computer Science and Technology from Tsinghua University.
Avatar photo

Posts by Guohao Wu

A decorative image.
Agentic AI / Generative AI

Speeding Up Variable-Length Training with Dynamic Context Parallelism and NVIDIA Megatron Core

This post introduces Dynamic Context Parallelism (Dynamic-CP), a scheduling approach in NVIDIA Megatron Core used for LLM post-training or DiT pre-training. It... 12 MIN READ