Ryan McCormick

Ryan McCormick is an engineering manager on the NVIDIA Dynamo team, focused on high-performance distributed inference, self-hosted agents at scale, and optimizing multimodal workloads across datacenter infrastructure. He holds bachelor’s degrees in Computer Science and Mathematics from Binghamton University.
Ryan McCormick

Posts by Ryan McCormick

Computer Vision / Video Analytics

When to Use Encode-Prefill-Decode Disaggregation to Accelerate Multimodal Model Serving

Encode-prefill-decode (EPD) disaggregation is an inference optimization technique for multimodal models that separates the vision encoder stage from the prefill... 14 MIN READ
Data Science

How to Build a Distributed Inference Cache with NVIDIA Triton and Redis

Caching is as fundamental to computing as arrays, symbols, or strings. Various layers of caching throughout the stack hold instructions from memory while... 13 MIN READ