Sophia Yang

Sophia Yang is a deep learning solution architect at NVIDIA, specializing in LLM training. She has experience in deep learning frameworks, acceleration and optimization of large language model training, reinforcement learning.
Avatar photo

Posts by Sophia Yang

A decorative image.
Agentic AI / Generative AI Jan 28, 2026

Speeding Up Variable-Length Training with Dynamic Context Parallelism and NVIDIA Megatron Core

This post introduces Dynamic Context Parallelism (Dynamic-CP), a scheduling approach in NVIDIA Megatron Core used for LLM post-training or DiT pre-training. It... 12 MIN READ