Chris Hoge

Chris Hoge is the manager for the AI Platform Software Technical Marketing Engineering team at NVIDIA. Chris has worked in open source software for over 10 years, with a focus on AI, high-performance computing, and infrastructure. He holds a master’s degree in Applied Mathematics from the University of Colorado, and a bachelor’s degree in Systems Science and Mathematics from Washington University in St. Louis.
Avatar photo

Posts by Chris Hoge

Developer Tools & Techniques

Enhancing Distributed Inference Performance with the NVIDIA Inference Transfer Library

Deploying large language models (LLMs) requires large-scale distributed inference, which spreads model computation and request handling across many GPUs and... 13 MIN READ