Timmy Liu

Timmy Liu is a principal architect with NVIDIA. He enjoys working at the intersection of hardware, software and algorithms. His current work focuses on attention mechanisms, including dense attention, linear attention and sparse attention.
Avatar photo

Posts by Timmy Liu

Developer Tools & Techniques

Co-Designing Sparse Attention for Efficient Long-Context Inference

Agentic workloads, long documents, and large codebases are pushing context lengths from tens of thousands of tokens to hundreds of thousands. At those lengths,... 16 MIN READ