Justin Xin

Justin Xin serves as a deep learning algorithms engineer at NVIDIA, where his primary focus is on improving generative AI's inference capabilities through algorithmic and systemic optimization on NVIDIA platforms. He holds a B.Sc. in computer science from the University of Arizona.
Avatar photo

Posts by Justin Xin

Generative AI / LLMs

NVIDIA TensorRT Model Optimizer v0.15 Boosts Inference Performance and Expands Model Support

NVIDIA has announced the latest v0.15 release of NVIDIA TensorRT Model Optimizer, a state-of-the-art quantization toolkit of model optimization techniques... 5 MIN READ
Four images compared against three modes for quality.
Generative AI / LLMs

NVIDIA TensorRT Accelerates Stable Diffusion Nearly 2x Faster with 8-bit Post-Training Quantization

In the dynamic realm of generative AI, diffusion models stand out as the most powerful architecture for generating high-quality images with text prompts. Models... 7 MIN READ