TensorFlow

Apr 05, 2022

Training a Recommender System on DGX A100 with 100B+ Parameters in TensorFlow 2

Deep learning recommender systems often use large embedding tables. It can be difficult to fit them in GPU memory. This post shows you how to use a combination...
13 MIN READ
Feb 28, 2022

Deep Learning Study Could Spark New Dinosaur Discoveries

Applying new technology to studying ancient history, researchers are looking to expand their understanding of dinosaurs with a new AI algorithm. The study,...
4 MIN READ
Feb 17, 2022

Autonomous AI Outraces Gran Turismo World Champs

Gran Turismo (GT) Sport competitors are facing a new, AI-supercharged contender thanks to the latest collaborative effort from Sony AI, Sony Interactive...
5 MIN READ
Sep 24, 2021

Accelerating Embedding with the HugeCTR TensorFlow Embedding Plugin

Recommender systems are the economic engine of the Internet. It is hard to imagine any other type of applications with more direct impact in our daily digital...
12 MIN READ
Sep 01, 2020

Streaming Interactive Deep Learning Applications at Peak Performance

Imagine that you have just finished implementing an awesome, interactive, deep learning pipeline on your NVIDIA-accelerated data science workstation using...
12 MIN READ
Mar 26, 2020

Jump-start AI Training with NGC Pretrained Models On-Premises and in the Cloud

Figure 1. NGC software stack. The process of building an AI-powered solution from start to finish can be daunting. First, datasets must be curated and...
11 MIN READ
Jetson Xavier Tensor Core Matrix
Mar 18, 2019

Automatic Mixed Precision for NVIDIA Tensor Core Architecture in TensorFlow

Whether to employ mixed precision to train your TensorFlow models is no longer a tough decision. NVIDIA’s Automatic Mixed Precision (AMP) feature for...
5 MIN READ
Oct 09, 2018

Mixed Precision Training for NLP and Speech Recognition with OpenSeq2Seq

The success of neural networks thus far has been built on bigger datasets, better theoretical models, and reduced training time. Sequential models, in...
11 MIN READ
Figure 1: The Tesla V100 Accelerator with Volta GV100 GPU. SXM2 Form Factor.
Aug 28, 2018

Mixed-Precision ResNet-50 Using Tensor Cores with TensorFlow

Mixed-Precision combines different numerical precisions in a computational method. Using precision lower than FP32 reduces memory usage, allowing deployment of...
2 MIN READ
Apr 24, 2017

Photo Editing with Generative Adversarial Networks (Part 2)

In part 1 of this series I introduced Generative Adversarial Networks (GANs) and showed how to generate images of handwritten digits using a GAN. In this post I...
12 MIN READ
Apr 20, 2017

Photo Editing with Generative Adversarial Networks (Part 1)

Adversarial training (also called GAN for Generative Adversarial Networks), and the variations that are now being proposed, is the most interesting idea in the...
26 MIN READ