Yi Dong

Yi Dong is a principal research scientist on the Learning and Perception Research team at NVIDIA, where he leads efforts in developing reasoning models and virtual agents. He earned his PhD in Computational Neuroscience from the Johns Hopkins University School of Medicine. With over a decade of experience in software engineering, machine learning, finance and AI research, Yi’s research focuses on building artificial general intelligence (AGI) systems that emulate human cognitive capabilities, particularly in enabling models to reason effectively in complex and novel situations for enterprise applications.
Avatar photo

Posts by Yi Dong

Generative AI

Scaling LLM Reinforcement Learning with Prolonged Training Using ProRL v2

Currently, one of the most compelling questions in AI is whether large language models (LLMs) can continue to improve through sustained reinforcement learning... 8 MIN READ
Generative AI

Announcing NVIDIA SteerLM: A Simple and Practical Technique to Customize LLMs During Inference

With the advent of large language models (LLMs) such as GPT-3, Megatron-Turing, Chinchilla, PaLM-2, Falcon, and Llama 2, remarkable progress in natural language... 10 MIN READ
Conversational AI

Adapting P-Tuning to Solve Non-English Downstream Tasks

With the increasing demand for access to pretrained large language model (LLM) weights, the climate around LLM sharing is changing. Recently, Meta released Open... 15 MIN READ
Data Science

Generating Synthetic Data with Transformers: A Solution for Enterprise Data Challenges

Big data, new algorithms, and fast computation are three main factors that make the modern AI revolution possible. However, data poses many challenges for... 8 MIN READ
Data Science

Accelerated Portfolio Construction with Numba and Dask in Python

Python is no stranger to data scientists. It ranks as the most popular computer language and is widely used for all kinds of tasks. Though Python is notoriously... 8 MIN READ
Simulation / Modeling / Design

Training and Fine-tuning BERT Using NVIDIA NGC

Imagine an AI program that can understand language better than humans can. Imagine building your own personal Siri or Google Search for a customized domain or... 12 MIN READ