Bita Darvish Rouhani

Bita Darvish Rouhani is a senior distinguished engineer and manager at NVIDIA, leading algorithms, software, and hardware co-design initiatives for cost-optimized generative AI inference. Prior to joining Nvidia, Bita was a partner group manager at Microsoft, where she co-founded and led the OCP MX consortium. The consortium standardized the first set of 4- and 6-bit data types for AI training and inference for nearly all mainstream AI chips. Bita holds a Ph.D. in computer engineering from UC San Diego.
Avatar photo

Posts by Bita Darvish Rouhani

Developer Tools & Techniques Jul 31, 2026

Co-Designing AI Model Attention for Fast, Interactive Long-Context Inference

As agentic and long-context workloads become common, the context lengths increase and attention consumes a larger share of inference time (Figure 1). Because... 14 MIN READ
Agentic AI / Generative AI Jul 10, 2026

AI Model Co-Design: Hardware-Friendly LLM Design

AI performance comes down to three dimensions:  Accuracy: How well the model reasons and produces outputs Throughput: How many tokens per second a... 17 MIN READ
Developer Tools & Techniques Jul 07, 2025

Think Smart and Ask an Encyclopedia-Sized Question: Multi-Million Token Real-Time Inference for 32X More Users

Modern AI applications increasingly rely on models that combine huge parameter counts with multi-million-token context windows. Whether it is AI agents... 8 MIN READ
Data Center / Cloud Jun 06, 2025

How NVIDIA GB200 NVL72 and NVIDIA Dynamo Boost Inference Performance for MoE Models

The latest wave of open source large language models (LLMs), like DeepSeek R1, Llama 4, and Qwen3, have embraced Mixture of Experts (MoE) architectures. Unlike... 12 MIN READ