TensorRT is an SDK for high performance, deep learning inference. It includes a deep learning inference optimizer and a runtime that delivers low latency and… 10 MIN READ

Microsoft and NVIDIA have collaborated to build, validate and publish the ONNX Runtime Python package and Docker container for the NVIDIA Jetson platform… 6 MIN READ

As more and more deep learning models are being deployed into production environments, there is a growing need for a separation between the work on the model… 13 MIN READ

Figure 1. TensorCores. Every year, clever researchers introduce ever more complex and interesting deep learning models to the world. There is of course a big… 13 MIN READ

Starting with TensorRT 7.0, the Universal Framework Format (UFF) is being deprecated. In this post, you learn how to deploy TensorFlow trained deep learning… 15 MIN READ

Introduction to accelerated creating inference engines using TensorRT and C++ with code samples and tutorial links 22 MIN READ