Posts by Jamie Li
AI Platforms / Deployment
Oct 07, 2025
Pruning and Distilling LLMs Using NVIDIA TensorRT Model Optimizer
Large language models (LLMs) have set a high bar in natural language processing (NLP) tasks such as coding, reasoning, and math. However, their deployment...
11 MIN READ
Data Center / Cloud
Sep 17, 2025
An Introduction to Speculative Decoding for Reducing Latency in AI Inference
Generating text with large language models (LLMs) often involves running into a fundamental bottleneck. GPUs offer massive compute, yet much of that power sits...
11 MIN READ