Ganesh Kudleppanavar

Ganesh Kudleppanavar is a system software manager and engineering leader at NVIDIA, focused on the performance, efficiency, and safety of machine learning and generative AI models. He leads teams driving model benchmarking, faster model loading and weight delivery, and programmable safety guardrails for LLM based applications across the inference stack. Ganesh holds a Master of Science in electrical engineering from California State University, Long Beach.
Avatar photo

Posts by Ganesh Kudleppanavar

Agentic AI / Generative AI

ModelExpress: Distributing Model Artifacts at the Speed of Light

Every byte moved has a cost. As model checkpoints grow to hundreds of gigabytes or even a terabyte, that cost adds up quickly. To make things even worse, moving... 12 MIN READ
Decorative image of a datacenter with floating icons overlaid.
Agentic AI / Generative AI

LLM Inference Benchmarking Guide: NVIDIA GenAI-Perf and NIM

This is the second post in the LLM Benchmarking series, which shows how to use GenAI-Perf to benchmark the Meta Llama 3 model when deployed with NVIDIA NIM. ... 11 MIN READ
Agentic AI / Generative AI

LLM Inference Benchmarking: Fundamental Concepts

This is the first post in the large language model latency-throughput benchmarking series, which aims to instruct developers on common metrics used for LLM... 15 MIN READ
Decorative image.
Agentic AI / Generative AI

Measuring Generative AI Model Performance Using NVIDIA GenAI-Perf and an OpenAI-Compatible API

NVIDIA offers tools like Perf Analyzer and Model Analyzer to assist machine learning engineers with measuring and balancing the trade-off between latency and... 6 MIN READ