Posts by Ruixiang Wang
Edge Computing
Jun 09, 2026
Model Quantization: Turn FP8 Checkpoints into High-Performance Inference Engines with NVIDIA TensorRT
Converting a quantized checkpoint into an NVIDIA TensorRT engine bridges the gap between model optimization and production deployment, enabling faster...
10 MIN READ
Edge Computing
May 07, 2026
Model Quantization: Post-Training Quantization Using NVIDIA Model Optimizer
Model quantization is an effective method to reduce VRAM usage and improve inference performance on consumer devices such as NVIDIA GeForce RTX GPUs. By...
8 MIN READ
Edge Computing
Nov 24, 2025
Model Quantization: Concepts, Methods, and Why It Matters
AI models are becoming increasingly complex, often exceeding the capabilities of available hardware. Quantization has emerged as a crucial technique to address...
12 MIN READ