Matthew Kotila

Matthew Kotila is a senior system software engineer at NVIDIA developing AIPerf, a benchmarking tool for LLMs. He cares about delivering great user experiences and working with his peers to solve problems. He holds a master's degree and a bachelor's degree in computer science, both from the University of California, Davis.
Avatar photo

Posts by Matthew Kotila

Developer Tools & Techniques

Benchmarking LLM Inference at Scale with AIPerf

You’re deploying a model on a system. It starts up, prompts are getting responses. Now the hard question: Is this fast? Your instincts might lead you to send... 11 MIN READ