TensorRT: What’s New

NVIDIA® TensorRT 8.4 includes new tools to explore TensorRT optimized engines and quantize the TensorFlow models with QAT.

Torch-TensorRT is now an official part of PyTorch, read more about the announcement here.

Download Now

Highlights:

  • New tool to visualize optimized graphs and debug model performance easily. Learn more
  • Reduce engine size by up to 50x, allowing for easier application package distribution
  • New TF-QAT toolkit for improved INT8 accuracy on TensorFlow models. Learn more

Torch-TensorRT is available today in the PyTorch container from the NVIDIA NGC™ catalog.

TensorFlow-TensorRT is available today in the TensorFlow container from the NGC catalog.


How to Get Started with TensorRT

Find other TensorRT developers on the NVIDIA Developer Forum or additional resources on the NVIDIA Developer Blog.

DEVELOPER FORUM

Additional TensorRT Resources




TensorRT 8.4 GA is available for free to members of the NVIDIA Developer Program.

DOWNLOAD NOW

Ethical AI

NVIDIA’s platforms and application frameworks enable developers to build a wide array of AI applications. Consider potential algorithmic bias when choosing or creating the models being deployed. Work with the model’s developer to ensure that it meets the requirements for the relevant industry and use case; that the necessary instruction and documentation are provided to understand error rates, confidence intervals, and results; and that the model is being used under the conditions and in the manner intended.