Harshini Komali

Harshini Komali is a systems software engineer at NVIDIA working on AIPerf, which measures the performance of LLM inference systems. Her work spans dataset support, metrics, and endpoint coverage. She cares about building software that is intuitive and easy to use. She holds an M.S. in Software Engineering from San Jose State University.
Avatar photo

Posts by Harshini Komali

Developer Tools & Techniques

Benchmarking LLM Inference at Scale with AIPerf

You’re deploying a model on a system. It starts up, prompts are getting responses. Now the hard question: Is this fast? Your instincts might lead you to send... 11 MIN READ