Shobhit Verma

Shobhit Verma is a software engineer on the TensorRT team at NVIDIA, where he focuses on MLPerf Inference. He has experience in the design and verification of ML accelerators, developing high performance computing applications and distributed systems. Shobhit holds an M.Sc. in computer science from the University of Chicago and a B.Sc. in computer engineering from Delhi Technological University
Avatar photo

Posts by Shobhit Verma

Data Center / Cloud

NVIDIA Blackwell Ultra Sets New Inference Records in MLPerf Debut

As large language models (LLMs) grow larger, they get smarter, with open models from leading developers now featuring hundreds of billions of parameters. At the... 10 MIN READ
Decorative image.
Generative AI

NVIDIA Triton Inference Server Achieves Outstanding Performance in MLPerf Inference 4.1 Benchmarks

Six years ago, we embarked on a journey to develop an AI inference serving solution specifically designed for high-throughput and time-sensitive production use... 8 MIN READ