Fred Oh

Fred is a senior product marketing manager for CUDA, CUDA on WSL, and CUDA Python. Fred has a B.S. in Computer Science and Math from UC Davis. He began his career as a UNIX software engineer porting kernel services and device drivers to x86 architectures. He loves Star Wars, Star Trek and the NBA Warriors.
Avatar photo

Posts by Fred Oh

Generative AI

NVIDIA TensorRT-LLM Supercharges Large Language Model Inference on NVIDIA H100 GPUs

Large language models offer incredible new capabilities, expanding the frontier of what is possible with AI. But their large size and unique execution... 10 MIN READ
Simulation / Modeling / Design

Simplifying GPU Application Development with Heterogeneous Memory Management

Heterogeneous Memory Management (HMM) is a CUDA memory management feature that extends the simplicity and productivity of the CUDA Unified Memory programming... 16 MIN READ
CUDA abstract image.
Simulation / Modeling / Design

NVIDIA CUDA Toolkit 12.2 Unleashes Powerful Features for Boosting Applications

The latest release of NVIDIA CUDA Toolkit 12.2 introduces a range of essential new features, modifications to the programming model, and enhanced support for... 8 MIN READ
A screenshot of the YouTube page for the event.
Data Center / Cloud

Event: CUDA 12.2 YouTube Premiere

Watch on-demand as experts deep dive into CUDA 12.2, including support for confidential computing. 1 MIN READ
CUDA abstract image.
Simulation / Modeling / Design

Improving GPU Performance by Reducing Instruction Cache Misses

GPUs are specially designed to crunch through massive amounts of data at high speed. They have a large amount of compute resources, called streaming... 11 MIN READ
Abstract image
Data Center / Cloud

CUDA 12.1 Supports Large Kernel Parameters

CUDA kernel function parameters are passed to the device through constant memory and have been limited to 4,096 bytes. CUDA 12.1 increases this parameter limit... 5 MIN READ