CUDA Training

CUDA U has online courses to help you get started programming or teaching CUDA as well as links to Universities teaching CUDA.

CUDA U is organized into three sections to get you started

• Introductory CUDA Technical Training Courses
• CUDA University Courses
• CUDA Seminars and Tutorials

Introductory CUDA Technical Training Courses

• Volume I: Introduction to CUDA Programming
• Exercises (for Linux and Mac)
• Visual Studio Exercises (for Windows)
• Instructions for Exercises
• Volume II: CUDA Case Studies

CUDAcasts - Downloadable CUDA Training Podcasts

• Introduction to GPU Computing
• CUDA Programming Model Overview
• CUDA Programming Basics - Part I
• CUDA Programming Basics - Part II

Additional GPU Computing Online Seminars

CUDA University Courses

University of Illinois : ECE 498AL

Taught by Professor Wen-mei W. Hwu and David Kirk, NVIDIA Chief Scientist.

• Introduction to GPU Computing (60.2 MB)
• CUDA Programming Model (75.3 MB)
• CUDA API (32.4 MB)
• Simple Matrix Multiplication in CUDA (46.0 MB)
• CUDA Memory Model (109 MB)
• Shared Memory Matrix Multiplication (81.4 MB)
• Additional CUDA API Features (22.4 MB)
• Useful Information on CUDA Tools (15.7 MB)
• Threading Hardware (140 MB)
• Memory Hardware (85.8 MB)
• Memory Bank Conflicts (115 MB)
• Parallel Thread Execution (32.6 MB)
• Control Flow (96.6 MB)
• Precision (137 MB)

These classes are each downloadable CUDAcasts with video pre-scaled to be compatible with major players.

All PowerPoint class presentations can be found on the course syllabus: ECE 498AL

Stanford University: CS193G
Taught by Jared Hoberock and David Tarjan

• Introduction to Massively Parallel Computing
• GPU History and CUDA Programming Basics
• CUDA Treads and Atomics
• CUDA Memories
• Performance Considerations
• Parallel Patterns I
• Parallel Patterns II
• Introduction to Thrust
• Sparse Matrix-Vector Multiplication on Throughput-Oriented Processors
• PDE Solvers
• The Fermi Architecture
• Ray Tracing Case Study
• Future of Throughput
• Path Planning Case Study
• Optimizing GPU Performance
• Final lecture TBD

PowerPoint versions of these presentations can be found here.
CS193G Assignments
CS193G Tutorials

UC Davis: EE171, Parallel Computer Architecture

Taught by John Owens, Associate Professor

• Course Materials

Universities teaching CUDA where you can apply to enroll or register for courses.

CUDA Seminars and Tutorials

• GPU Technology Conference: search for recordings via the interactive session calendar
• SC09
• NVIDIA GPU Computing Theatre
• SC09 Tutorial: High Performance Computing with CUDA
• SC08 Tutorial: High Performance Computing with CUDA
• SC07 Tutorial: High Performance Computing with CUDA
• NVISION 08 Tutorials
• Getting Started with CUDA (covers CUDA programming model, basics of CUDA programming, and BLAS and FFT libraries)
• Advanced CUDA Training (covers 10-series architecture and optimization techniques using particle simulation and finite difference case studies)
• All presentations from NVISION 08
• ISC 2008 Case Study: Computational Fluid Dynamics (CFD)

CUDA Consultants and Trainings

• Acceleware Professional Services
• Stone Ridge Technology
• Wipro Global Consultancy Services

Dr. Dobb's Article Series

• CUDA, Supercomputing for the Masses: Part 1
  CUDA lets you work with familiar programming concepts while developing software that can run on a GPU

• CUDA, Supercomputing for the Masses: Part 2
  A first kernel

• CUDA, Supercomputing for the Masses: Part 3
  Error handling and global memory performance limitations

• CUDA, Supercomputing for the Masses: Part 4
  Understanding and using shared memory (1)

• CUDA, Supercomputing for the Masses: Part 5
  Understanding and using shared memory (2)

• CUDA, Supercomputing for the Masses: Part 6
  Global memory and the CUDA profiler

• CUDA, Supercomputing for the Masses: Part 7
  Double the fun with next-generation CUDA hardware

• CUDA, Supercomputing for the Masses: Part 8
  Using libraries with CUDA
• CUDA, Supercomputing for the Masses: Part 9
  Extending High-level Languages with CUDA

• CUDA, Supercomputing for the Masses: Part 10
  CUDPP, a powerful data-parallel CUDA library

• CUDA, Supercomputing for the Masses: Part 11
  Revisiting CUDA memory spaces

• CUDA, Supercomputing for the Masses: Part 12
  CUDA 2.2 changes the data movement paradigm

• CUDA, Supercomputing for the Masses: Part 13
  Using texture memory in CUDA

• CUDA, Supercomputing for the Masses: Part 14
  Debuggin CUDA and using CUDA-GDB

• CUDA, Supercomputing for the Masses: Part 15
  Using Pixel Buffer Objects with CUDA and OpenGL