Nidhi Bhatia

Nidhi Bhatia is a senior AI/ML engineer at NVIDIA, driving model-hardware co-design to improve the efficiency of serving generative AI inference. She has worked across multiple layers of the stack, from GPU architecture and performance modeling to distributed inference algorithms, with her work shaping how large-scale AI inference systems are built and optimized. Nidhi holds a master's in electrical and computer engineering from Carnegie Mellon University and a bachelor's in electronics and instrumentation from BITS Pilani, India.
Avatar photo

Posts by Nidhi Bhatia

Agentic AI / Generative AI

AI Model Co-Design: Hardware-Friendly LLM Design

AI performance comes down to three dimensions:  Accuracy: How well the model reasons and produces outputs Throughput: How many tokens per second a... 17 MIN READ
Developer Tools & Techniques

Think Smart and Ask an Encyclopedia-Sized Question: Multi-Million Token Real-Time Inference for 32X More Users

Modern AI applications increasingly rely on models that combine huge parameter counts with multi-million-token context windows. Whether it is AI agents... 8 MIN READ