Joseph Jennings

Joseph Jennings is currently a deep learning algorithm engineer at NVIDIA. He is interested in the application of accelerated and distributed computing to large language model pretraining and data curation. He received his Ph.D. in geophysics from Stanford University.
Avatar photo

Posts by Joseph Jennings

Decorative image.
Conversational AI Aug 08, 2023

Curating Trillion-Token Datasets: Introducing NVIDIA NeMo Data Curator

The latest developments in large language model (LLM) scaling laws have shown that when scaling the number of model parameters, the number of tokens used for... 8 MIN READ