Nidhi Bhatia

Nidhi Bhatia is a senior AI/ML engineer at NVIDIA, driving model-hardware co-design to improve the efficiency of serving generative AI inference. She has worked across multiple layers of the stack, from GPU architecture and performance modeling to distributed inference algorithms, with her work shaping how large-scale AI inference systems are built and optimized. Nidhi holds a master's in electrical and computer engineering from Carnegie Mellon University and a bachelor's in electronics and instrumentation from BITS Pilani, India.
Avatar photo

Posts by Nidhi Bhatia

Developer Tools & Techniques Jul 31, 2026

Co-Designing AI Model Attention for Fast, Interactive Long-Context Inference

As agentic and long-context workloads become common, the context lengths increase and attention consumes a larger share of inference time (Figure 1). Because... 14 MIN READ
Agentic AI / Generative AI Jul 10, 2026

AI Model Co-Design: Hardware-Friendly LLM Design

AI performance comes down to three dimensions:  Accuracy: How well the model reasons and produces outputs Throughput: How many tokens per second a... 17 MIN READ
Developer Tools & Techniques Jul 07, 2025

Think Smart and Ask an Encyclopedia-Sized Question: Multi-Million Token Real-Time Inference for 32X More Users

Modern AI applications increasingly rely on models that combine huge parameter counts with multi-million-token context windows. Whether it is AI agents... 8 MIN READ