Samkit Jain

Samkit Jain is a senior deep learning performance architect at NVIDIA, focusing on optimizing the performance and energy efficiency of generative AI inference and systems at scale. Prior to NVIDIA, Samkit was a software research scientist at Intel, where he led hardware/software co-design for sparse AI and graph analytics accelerators. Over his career, he has worked across multiple layers of the stack, spanning architecture pathfinding, performance modeling, and HPC system software. He holds a master’s degree in Electrical Engineering from the University of Minnesota, Twin Cities.
Avatar photo

Posts by Samkit Jain

Developer Tools & Techniques Sep 02, 2026

Co-Designing AI Models Using Speculative Decoding for Faster LLM Inference

This post is the third in a series on AI model co-design. It explores how to accelerate LLM inference while maintaining accuracy using speculative decoding and... 15 MIN READ
Developer Tools & Techniques Jul 31, 2026

Co-Designing AI Model Attention for Fast, Interactive Long-Context Inference

As agentic and long-context workloads become common, the context lengths increase and attention consumes a larger share of inference time (Figure 1). Because... 14 MIN READ