Learn how to accelerate AI model inference at scale for financial services at our live webinar.   Register Now

TensorRT: What’s New

NVIDIA® TensorRT™ 8.5 includes support for new NVIDIA H100 Tensor Core GPUs and reduced memory consumption for TensorRT optimizer and runtime with CUDA® Lazy Loading.

TensorRT 8.5 GA is a free download for members of the NVIDIA Developer Program .

Download Now

Torch-TensorRT is now available in the PyTorch container from the NVIDIA NGC™ catalog.

TensorFlow-TensorRT is now available in the TensorFlow container from the NGC catalog.



Explore Ways to Get Started With TensorRT


Get Enterprise Support for NVIDIA TensorRT

NVIDIA Enterprise Support for TensorRT, offered with the NVIDIA AI Enterprise software suite, includes:

  • Single source of support with service-level agreements for AI deployments
  • Security reviews and notifications
  • API stability and compatibility across releases
  • Access to NVIDIA AI experts
  • Long-term support on designated releases
  • Customized support-upgrade options
Learn More
Get Enterprise technical support for TensorRT

Join the Triton community and stay current on the latest feature updates, bug fixes, and more.

Subscribe

Discover More TensorRT Resources




TensorRT 8.5 GA is available for free to members of the NVIDIA Developer Program.

Download Now

Ethical AI

NVIDIA’s platforms and application frameworks enable developers to build a wide array of AI applications. Consider potential algorithmic bias when choosing or creating the models being deployed. Work with the model’s developer to ensure that it meets the requirements for the relevant industry and use case; that the necessary instruction and documentation are provided to understand error rates, confidence intervals, and results; and that the model is being used under the conditions and in the manner intended.