Samkit Jain

Samkit Jain is a senior deep learning performance architect at NVIDIA, focusing on optimizing the performance and energy efficiency of generative AI inference and systems at scale. Prior to NVIDIA, Samkit was a software research scientist at Intel, where he led hardware/software co-design for sparse AI and graph analytics accelerators. Over his career, he has worked across multiple layers of the stack, spanning architecture pathfinding, performance modeling, and HPC system software. He holds a master’s degree in Electrical Engineering from the University of Minnesota, Twin Cities.
Avatar photo

Posts by Samkit Jain

Developer Tools & Techniques Jul 31, 2026

Co-Designing AI Model Attention for Fast, Interactive Long-Context Inference

As agentic and long-context workloads become common, the context lengths increase and attention consumes a larger share of inference time (Figure 1). Because... 14 MIN READ