Nidhi Bhatia

Nidhi Bhatia is a senior AI/ML engineer in the Deep Learning Compute group at NVIDIA, where she focuses on accelerating and optimizing AI inference algorithms through hardware–software co-design. She holds a master’s degree in electrical and computer engineering from Carnegie Mellon University and a bachelor’s degree in electronics and instrumentation engineering from BITS Pilani in Goa, India.
Avatar photo

Posts by Nidhi Bhatia

Development & Optimization

Think Smart and Ask an Encyclopedia-Sized Question: Multi-Million Token Real-Time Inference for 32X More Users

Modern AI applications increasingly rely on models that combine huge parameter counts with multi-million-token context windows. Whether it is AI agents... 8 MIN READ