Tri Dao

Tri Dao is an Assistant Professor at Princeton University and co-founder & chief scientist of Together AI. He completed his PhD in Computer Science at Stanford. He works at the intersection of machine learning and systems, and his research interests include hardware-aware algorithms and sequence models with long-range memory. His notable work includes FlashAttention and Mamba.
Tri Dao

Posts by Tri Dao

Agentic AI / Generative AI

ReplaySSM: Rethinking State Storage for Faster Hybrid-Model Decoding

Hybrid models interleave state-space model (SSM) layers with a few attention layers. NVIDIA Nemotron 3, Qwen3.5 through Qwen3.8, Kimi-K3, and GLM-5.3-Flash are... 14 MIN READ