Posts by Paresh Kharya
Conversational AI
Oct 11, 2021
Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, the World’s Largest and Most Powerful Generative Language Model
We are excited to introduce the DeepSpeed- and Megatron-powered Megatron-Turing Natural Language Generation model (MT-NLG), the largest and the most powerful...
13 MIN READ
Simulation / Modeling / Design
Jul 13, 2015
Introducing the NVIDIA OpenACC Toolkit
Programmability is crucial to accelerated computing, and NVIDIA's CUDA Toolkit has been critical to the success of GPU computing. Over three million CUDA...
4 MIN READ