Tailai Ma

Tailai Ma is an AI developer and technology engineer at NVIDIA, specializing in kernel optimization and accelerating LLM training, and contributing to Megatron-Core and Transformer-Engine. He holds a Ph.D. from Peking University.
Avatar photo

Posts by Tailai Ma

A decorative image.
Agentic AI / Generative AI Jan 28, 2026

Speeding Up Variable-Length Training with Dynamic Context Parallelism and NVIDIA Megatron Core

This post introduces Dynamic Context Parallelism (Dynamic-CP), a scheduling approach in NVIDIA Megatron Core used for LLM post-training or DiT pre-training. It... 12 MIN READ