Syed Ahmed

Syed Ahmed is a senior software engineer on the PyTorch Core team at NVIDIA, focused on keeping PyTorch fast and numerically stable on current NVIDIA platforms, and making PyTorch more expressive on future NVIDIA platforms. He holds a Master’s degree in Electrical Engineering from University of Pennsylvania, where he worked on accelerating FPGA compilation, and a Bachelor’s degree in Computer Engineering from Rochester Institute of Technology.
Avatar photo

Posts by Syed Ahmed

Decorative image.
Agentic AI / Generative AI

Setting a World Record for MoE Pre-Training on NVIDIA GB300 NVL72

Frontier model pre-training has converged on mixture of experts (MoE), which is fundamentally changing what limits large-scale AI training. As compute per token... 8 MIN READ