Schwinn Saereesitthipitak

Schwinn Saereesitthipitak is a Software Engineer at NVIDIA specializing in large-scale distributed inference systems. His work bridges research and engineering across the inference stack to enable elasticity and resiliency of production workloads at scale.
Avatar photo

Posts by Schwinn Saereesitthipitak

Decorative image.
Developer Tools & Techniques

Restore LLM Inference Capacity in Seconds with Shadow Engine Recovery in NVIDIA Dynamo

When an LLM engine process fails, the standard recovery path involves a cold restart. This requires loading weights into HBM from storage, compiling kernels,... 13 MIN READ
Top Stories

NVIDIA Dynamo Snapshot: Fast Startup for Inference Workloads on Kubernetes

The cold-start problem In production inference deployments, demand fluctuates over time, requiring inference replicas to scale elastically. However,... 15 MIN READ