Jared Casper

Jared works as a Senior Deep Learning Scientist in the Applied Deep Learning Research team at NVIDIA. Prior to joining NVIDIA in 2017, Jared worked on systems for deep learning at Baidu’s Silicon Valley AI Lab and on domain-specific hardware accelerators at Oracle Labs. Jared received his Ph.D. from Stanford in 2015 focusing on Computer Architecture.
Avatar photo

Posts by Jared Casper

Technical Walkthrough 2 Apr 12, 2021

Scaling Language Model Training to a Trillion Parameters Using Megatron

Natural Language Processing (NLP) has seen rapid progress in recent years as computation at scale has become more available and datasets have become larger. At... 17 MIN READ
Technical Walkthrough 0 May 14, 2020

State-of-the-Art Language Modeling Using Megatron on the NVIDIA A100 GPU

Recent work has demonstrated that larger language models dramatically advance the state of the art in natural language processing (NLP) applications such as... 9 MIN READ
Technical Walkthrough 0 May 02, 2018

NVVL Accelerates Machine Learning on Video Datasets

Loading data onto GPUs for training has historically been a minor issue for most deep learning practitioners. Data read from a local spinning hard drive or NAS... 11 MIN READ