Posts by Ryan McCormick
Computer Vision / Video Analytics
Sep 09, 2026
When to Use Encode-Prefill-Decode Disaggregation to Accelerate Multimodal Model Serving
Encode-prefill-decode (EPD) disaggregation is an inference optimization technique for multimodal models that separates the vision encoder stage from the prefill...
14 MIN READ
Data Science
Aug 30, 2023
How to Build a Distributed Inference Cache with NVIDIA Triton and Redis
Caching is as fundamental to computing as arrays, symbols, or strings. Various layers of caching throughout the stack hold instructions from memory while...
13 MIN READ