Posts by Yi Dong
Generative AI
Aug 13, 2025
Scaling LLM Reinforcement Learning with Prolonged Training Using ProRL v2
Currently, one of the most compelling questions in AI is whether large language models (LLMs) can continue to improve through sustained reinforcement learning...
8 MIN READ
Generative AI
Oct 11, 2023
Announcing NVIDIA SteerLM: A Simple and Practical Technique to Customize LLMs During Inference
With the advent of large language models (LLMs) such as GPT-3, Megatron-Turing, Chinchilla, PaLM-2, Falcon, and Llama 2, remarkable progress in natural language...
10 MIN READ
Conversational AI
Jul 12, 2022
Adapting P-Tuning to Solve Non-English Downstream Tasks
With the increasing demand for access to pretrained large language model (LLM) weights, the climate around LLM sharing is changing. Recently, Meta released Open...
15 MIN READ
Data Science
May 09, 2022
Generating Synthetic Data with Transformers: A Solution for Enterprise Data Challenges
Big data, new algorithms, and fast computation are three main factors that make the modern AI revolution possible. However, data poses many challenges for...
8 MIN READ
Data Science
Oct 21, 2021
Accelerated Portfolio Construction with Numba and Dask in Python
Python is no stranger to data scientists. It ranks as the most popular computer language and is widely used for all kinds of tasks. Though Python is notoriously...
8 MIN READ
Simulation / Modeling / Design
Jun 16, 2020
Training and Fine-tuning BERT Using NVIDIA NGC
Imagine an AI program that can understand language better than humans can. Imagine building your own personal Siri or Google Search for a customized domain or...
12 MIN READ