Digital Humans Teaching Kit Syllabus
This page is the syllabus for the NVIDIA Deep Learning Institue (DLI) Digital Humans Teaching Kit outlining each module's organization in the downloaded Teaching Kit .zip file. It shows the content for every module including Lecture Videos where available, as well as links to the suggested online DLI course for each module and related resources where applicable.
Module 1: Introduction to the Digital Humans Teaching Kit
Lecture Slides
- 1.1 - Modules Overview
- 1.2 - Course Synopsis
- 1.3 - Quick Start Guide
- 1.4 - Getting Started: Omniverse Launcher
- 1.5 - Getting Started: Omniverse Nucleus Installation
Labs ( Available in a future release of the Teaching Kit )
Quiz ( Available in a future release of the Teaching Kit )
Resources - Learn More
- Installation Guide
- User Guide
- IT Managed User Guide
- Custom Protocol Commands
- HTTP API
- Using a Proxy Server
- Linux Troubleshooting
Module 2: Develop Tools for your Digital Humans Pipeline
Lecture Slides
- 2.1 - Omniverse Kit and Code
- 2.2 - Omniverse Omni.UI
Labs ( Available in a future release of the Teaching Kit )
Quiz ( Available in a future release of the Teaching Kit )
Resources - Learn More
- Omniverse Developer Resource Center
- Mati Codes YouTube Channel
- Kit Developer Documentation
- Code Overview
- How to Build Extensions and Apps for Virtual Worlds with NVIDIA Omniverse
- Why Use USD?
- Omni.UI Overview Documentation
- Omni.UI Tutorial Playlist
- Developer Breakout: Building Extensions on Omniverse
Resources - DLI Self-Paced Online Courses
- Build Beautiful, Custom UI for 3D Tools on NVIDIA Omniverse
- Develop, Customize, and Publish in Omniverse With Extensions
- Easily Develop Advanced 3D Layout Tools on NVIDIA Omniverse
- How to Build Custom 3D Scene Manipulator Tools on NVIDIA Omniverse
Module 3: Assembling and Presenting 3D Scenes in Omniverse
Lecture Slides
- 3.1 - Introduction to Omniverse USD Composer
- 3.2 - Introduction Omniverse USD Presenter
Labs ( Available in a future release of the Teaching Kit )
Quiz ( Available in a future release of the Teaching Kit )
Resources - Learn More
- Omniverse USD Composer Overview
- Kit Developer Documentation
- Extensions Overview
- Omniverse Farm
- Omniverse Forum
- Pixar's USD Reference Documentation
- Material Definition Language (MDL)
- Overview of Omniverse USD Presenter
- Omniverse USD Presenter Essential Skill Playlist
- Omniverse USD Presenter Forum
Module 4: Introduction Universal Scene Description (USD)
Lecture Slides
- 4.1 - Fundamentals of USD Data Modeling
- 4.2 - USD Paths ( Available in a future release of the Teaching Kit )/p>
- 4.3 - USD View ( Available in a future release of the Teaching Kit )
Labs ( Available in a future release of the Teaching Kit )
Quiz ( Available in a future release of the Teaching Kit )
Resources - Learn More
- USD and Hydra Resources
- Maximizing USD Performance
- Guidelines for Structuring USD Assets
- Workflow Basics Part 1: USD and Layers in Omniverse
- USD Paths
- USD View In Omniverse
Resources - DLI Self-Paced Online Courses
Module 5: Connect your favorite DCC App to the Omniverse Platform
Lecture Slides ( Available in a future release of the Teaching Kit )
- 5.1 - Data Exchange - Work in your preferred DCC app
- 5.2 - Collaboration using the Omniverse Platform
- 5.3 - Animation in Omniverse USD Composer by way of your favorite DCC app
- 5.4 - How to Build a Connector
Lecture Videos ( Available in a future release of the Teaching Kit )
Labs ( Available in a future release of the Teaching Kit )
- Connect Sample
Quiz ( Available in a future release of the Teaching Kit)
Resources - Learn More
- Connect Overview
- Install Connectors
- Connect Sample
- Exploring Creative Workflows with Omniverse and the Unreal Engine Connector
Module 6: Audio2Face, Audio2Emotion, Audio2Gesture
Lecture Slides ( Available in a future release of the Teaching Kit)
- 6.1 - Audio2Face Overview
- 6.2 - Audio2Face - Audio2Emotion Overview
- 6.3 - Machinima and Audio2Gesture
- 6.4 - Reallusion iClone and Omniverse Audio2Face - Language Independent Facial & Lip-sync Animation from Voice
- 6.5 - Audio2Face to UnReal Engine Metahuman
- 6.6 - Audio2Face and the Real Illusion iClone connector to Unreal Engine Metahuman
Lecture Videos ( Available in a future release of the Teaching Kit )
Labs ( Available in a future release of the Teaching Kit )
Quiz ( Available in a future release of the Teaching Kit )
Resources - Learn More
- Audio2Face Overview
- Audio2Face Interface
- Optimizing Performance
- Character Transfer Part 1: Overview in Omniverse Audio2Face
- Character Transfer Part 2: User Interface and Samples in Omniverse Audio2Face
- Character Transfer Part 3: Mesh Fitting in Omniverse Audio2Face
- Character Transfer Part 4: Post Wrap in Omniverse Audio2Face
- Character Transfer Part 5: Iterative Workflow in Omniverse Audio2Face
- Character Transfer Part 6: Custom Mesh in Omniverse Audio2Face
- Character Transfer Part 7: Creating Presets in Omniverse Audio2Face
- Audio2gesture
- Overview of the NEW Audio2Emotion Feature in Omniverse Audio2Face
- Overview of Character Setup in Omniverse Audio2Face
- Audio2Face Tool
- Realistic Digital Human Rendering with Omniverse RTX Renderer
Resources - Omniverse Partner
- Overview of the Reallusion iClone Connector with Omniverse
- Importing and Rendering Realistic Human Characters with Reallusion iClone Connector in Omniverse
- NVIDIA Omniverse Audio to Gesture to Unreal Engine 5 Metahuman
- Nvidia Omniverse Audio2face to Unreal Engine Metahuman Tutorial
- Animating MetaHuman with Omniverse Audio2Face and Autodesk Maya Character Transfer: Maya Workflow Example in Omniverse Audio2Face
Module 7: Lighting and Rendering on the Omniverse Platform
Lecture Slides
- 7.1 - Managing Lighting ( Available in a future release of the Teaching Kit)
- 7.2 - Light Linking ( Available in a future release of the Teaching Kit)
- 7.3 - Introduction to the RTX Renderer
- 7.4 - MDL with Omniverse USD Composer
Labs ( Available in a future release of the Teaching Kit)
Quiz ( Available in a future release of the Teaching Kit)
Resources - Learn More
- Lighting Basics
- Lighting Overview
- Light Linking Overview
- Light Linking Property Panel
- RTX Renderer Forum
- Rendering Basics
- Render Settings Overview
- Five things to know about Materials
- Materials and Rendering
- UsdShadeNode Reference
- Material Graph
- Realistic Digital Human Rendering with Omniverse RTX Renderer
Module 8: Client Review
Lecture Slides
- 8.1 - Introduction to Omniverse USD Presenter
- 8.2 - Connect Teams for the review process ( Available in a future release of the Teaching Kit)
- 8.3 - Interactive presentations ( Available in a future release of the Teaching Kit)
- 8.4 - Virtual World immersion with Omniverse XR ( Available in a future release of the Teaching Kit)
Labs ( Available in a future release of the Teaching Kit )
Quiz ( Available in a future release of the Teaching Kit )
Resources - Learn More