NVIDIA TAO
NVIDIA Train, Adapt, and Optimize (TAO) is an AI-model-adaptation platform that simplifies and accelerates the creation of enterprise AI applications and services. By fine-tuning pretrained models with custom data through a UI-based, guided workflow, enterprises can produce highly accurate computer vision, speech, and language understanding models in hours rather than months, eliminating the need for large training runs and deep AI expertise.
Apply for Early AccessAdapting AI to complex industrial environments with NVIDIA TAO, Metropolis, and Fleet Command.
What Is NVIDIA TAO?
The foundation of an AI application is a deep learning model that’s tuned and optimized to deliver the right level of accuracy and performance. Building a deep learning model consists of several steps, including collecting large, high-quality datasets, preparing the data, training the model, and optimizing the model for deployment.
For many enterprises, this is cost prohibitive and time consuming, as they may not have access to the data, deep AI domain expertise, and computing infrastructure required to train these complex models. TAO is useful for enterprises looking to speed up their AI projects and bring their products to market faster.
NVIDIA TAO lowers the barrier to AI by bringing together key NVIDIA technologies, such as pretrained models from the NGC™ catalog, TAO Toolkit, federated learning, and NVIDIA® TensorRT™. The platform simplifies the creation of AI applications through an all new UI-based, guided workflow to meet the needs of users with varying levels of AI expertise.
Additionally, with the integration of NVIDIA Fleet Command™, IT managers can deploy and orchestrate their optimized AI applications.
Fast-Track AI with NVIDIA TAO
NVIDIA TAO simplifies the time-consuming parts of a deep learning workflow, from data preparation to training to optimization, shortening the time to value.
Train Faster
Produce state of the art models in hours by fine-tuning pre-trained models from the NGC catalog across various domains, including vision, speech, recommender systems, and language understanding.
Easily Adapt
Adapt your models with your data using TAO Toolkit or collaborate with partners through federated learning and contribute to a global model while preserving data privacy.
Efficiently Optimize
Select the optimal configuration deployment for any model architecture on a CPU or GPU with NVIDIA® Triton Inference Server. Optimize with NVIDIA TensorRT for GPUs to reduce the memory footprint while attaining the lowest latency and highest throughput.
Key Features in NVIDIA TAO
Pre-Trained Models from NGC
The NGC catalog offers a diverse set of pre-trained models for a variety of common AI tasks that are optimized for NVIDIA Tensor Core GPUs and can be easily re-trained by updating just a few layers, saving valuable time.
These pre-trained models can easily integrate into AI application frameworks such as Clara for healthcare, Isaac for robotics, Riva for conversational AI, Metropolis for smart cities and more.
Pre-trained models in the catalog are accompanied with model credentials that show various parameters such as accuracy, training epochs, batch size, and more—giving you the confidence to choose the right model for your use case.
Explore NGC pre-trained models
TAO Toolkit
The NVIDIA TAO Toolkit abstracts away the AI and deep learning framework complexity and enables you to build production-quality pre-trained models faster with no coding required.
A toolkit for anyone building AI apps and services, TAO Toolkit helps reduce costs associated with large-scale data collection, labeling and eliminates the burden of training AI and machine learning models from the ground up.
With TAO Toolkit, you can use NVIDIA’s production-quality pre-trained models and deploy as is or apply minimal fine-tuning for various computer vision and conversational AI use cases.
Learn more about TAO ToolkitFederated Learning
Federated learning enables you to build generalizable AI models that have learnt from distributed diversity of data across multiple sites. Federated learning increases model performance by allowing you to securely collaborate, train, and contribute to a global model. With differential privacy, only partial model weights are shared with the global model from each site, along with the ability to add random noise to the weights, making it less exposed to model inversion.
Federated learning is currently available as part of the NVIDIA Clara application framework.
Learn more about federated learning powered by NVIDIA Clara
TensorRT
NVIDIA TAO also leverages NVIDIA TensorRT™, an SDK for high-performance deep learning inference. It includes a deep learning inference optimizer and runtime that delivers low latency and high throughput for deep learning inference applications.
TensorRT is built on CUDA®, NVIDIA’s parallel programming model, and enables you to optimize inference leveraging libraries, development tools, and technologies in CUDA-X™ for artificial intelligence, autonomous machines, high-performance computing, intelligent video analytics, and graphics.
Learn more about TensorRTFleet Command
NVIDIA TAO offers the ability to deploy and orchestrate AI applications with NVIDIA Fleet Command.
Fleet Command is a hybrid-cloud platform for IT admins to remotely deploy applications, update software over the air, and monitor location health. It combines the benefits of accelerated computing at the edge with the ease of software as a service to deliver resilient AI securely and remotely to your entire network—in minutes.
Learn more about Fleet Command
Resources
Latest NGC Catalog News
Check out the latest update to the NGC catalog user interface, including a richer, more seamless experience.
Developer Blog
Learn about the value of pre-trained models from the NGC catalog with the help of an example.
GTC 2021 Keynote
Watch the announcement of NVIDIA TAO from NVIDIA’s CEO, Jensen Huang.
Latest TAO News
Read how NVIDIA TAO lets users choose, adapt, and deploy models easily for any task, any industry and on any system with ease.