## Industrial Metaverse Teaching Kit Syllabus _This page is the syllabus for the **NVIDIA Deep Learning Institute (DLI) Industrial Metaverse Teaching Kit** outlining each module's organization in the downloaded Teaching Kit .zip file. It shows the content for every module including Lecture Videos where available, as well as links to the suggested online DLI course for each module and related resources where applicable._ ## Module 1: Introduction to the Industrial Metaverse Teaching Kit **Lecture Slides** - 1.1 - Modules Overview - 1.2 - Course Synopsis - Why connect virtual worlds to physical worlds? - 1.3 - Quick Start Guide - 1.4 - Getting Started: Omniverse Launcher - 1.5 - Getting Started: Omniverse Nucleus Installation [**Lecture Videos**](https://www.nvidia.com/en-us/on-demand/playlist/playList-76d88c2f-92ef-413f-9893-1b0da41387ee/) **Labs** _Available in a future release of the Teaching Kit_ **Quizzes** - 1.4 - Getting Started: Omniverse Launcher - 1.5 - Getting Started: Omniverse Nucleus Installation **Resources - Learn More** - [Installation Guide](https://docs.omniverse.nvidia.com/prod_launcher/prod_launcher/installing_launcher.html) - [User Guide](https://docs.omniverse.nvidia.com/prod_launcher/prod_launcher/workstation-launcher.html) - [IT Managed User Guide](https://docs.omniverse.nvidia.com/prod_launcher/prod_launcher/it-managed-launcher.html) - [Custom Protocol Commands](https://docs.omniverse.nvidia.com/prod_launcher/prod_launcher/custom-protocol-commands.html) - [HTTP API](https://docs.omniverse.nvidia.com/prod_launcher/prod_launcher/http-api.html) - [Using a Proxy Server](https://docs.omniverse.nvidia.com/prod_launcher/prod_launcher/proxy-server.html) - [Linux Troubleshooting](https://docs.omniverse.nvidia.com/dev-guide/latest/linux-troubleshooting.html) ## Module 2: Develop Tools for your Industrial Metaverse Pipeline **Lecture Slides** - 2.1 - Omniverse Kit and Code - 2.2 - Omniverse Omni.UI [**Lecture Videos**](https://www.nvidia.com/en-us/on-demand/playlist/playList-eea5395d-f8ad-4637-a5cf-8d9b773647a7/) **Labs** _Available in a future release of the Teaching Kit_ **Quizzes** - 2.1 - Omniverse Kit and Code - 2.2 - Omniverse Omni.UI **Resources - Learn More** - [Omniverse Developer Resource Center](https://developer.nvidia.com/nvidia-omniverse-developer-resource-center) - [Mati Codes YouTube Channel](https://www.youtube.com/@mati-codes) - [Kit Developer Documentation](https://docs.omniverse.nvidia.com/prod_kit/prod_kit/overview.html) - [Code Overview](https://docs.omniverse.nvidia.com/app_code/app_code/overview.html) - [Developing an Omniverse Kit-Based Application](https://learn.nvidia.com/courses/course-detail?course_id=course-v1:DLI+S-OV-11+V1) - [Extensions Overview](https://docs.omniverse.nvidia.com/prod_extensions/prod_extensions/overview.html) - [How to Build Extensions and Apps for Virtual Worlds with NVIDIA Omniverse](https://www.nvidia.com/en-us/on-demand/session/gtcfall22-a41167/) - [Why Use USD?](https://graphics.pixar.com/usd/release/intro.html#why-use-usd) - [Omni.UI Overview Documentation](https://docs.omniverse.nvidia.com/kit/docs/omni.ui/latest/Overview.html) - [Omni.UI Tutorial Playlist](https://www.nvidia.com/en-us/on-demand/playlist/playList-6e090c22-6b15-4c72-9406-01d9a9adf571/) - [Developer Breakout: Building Extensions on Omniverse](https://www.nvidia.com/en-us/on-demand/session/gtcfall22-se41414/) **Resources - DLI Self-Paced Online Courses** - [Developing an Omniverse Kit-Based Application](https://learn.nvidia.com/courses/course-detail?course_id=course-v1:DLI+S-OV-11+V1) - [Build Beautiful, Custom UI for 3D Tools on NVIDIA Omniverse](https://courses.nvidia.com/courses/course-v1:DLI+S-OV-08+V1/) - [(Simplified Chinese) Build Beautiful, Custom UI for 3D Tools on NVIDIA Omniverse](https://courses.nvidia.com/courses/course-v1:DLI+S-OV-08+V1-ZH/) - [Develop, Customize, and Publish in Omniverse With Extensions](https://courses.nvidia.com/courses/course-v1:DLI+S-OV-02+V1/) - [(Simplified Chinese) Develop, Customize, and Publish in Omniverse With Extensions](https://courses.nvidia.com/courses/course-v1:DLI+S-OV-02+V1-ZH/) - [Easily Develop Advanced 3D Layout Tools on NVIDIA Omniverse](https://courses.nvidia.com/courses/course-v1:DLI+S-OV-07+V1/) - [(Simplified Chinese) Easily Develop Advanced 3D Layout Tools on NVIDIA Omniverse](https://courses.nvidia.com/courses/course-v1:DLI+S-OV-07+V1-ZH/) - [How to Build Custom 3D Scene Manipulator Tools on NVIDIA Omniverse](https://courses.nvidia.com/courses/course-v1:DLI+S-OV-06+V1/) - [(Simplified Chinese) How to Build Custom 3D Scene Manipulator Tools on NVIDIA Omniverse](https://courses.nvidia.com/courses/course-v1:DLI+S-OV-06+V1-ZH/) ## Module 3: Create Robust, Physically Accurate Simulations and Collaborate with your Team **Lecture Slides** - 3.1 - Introduction to Isaac Sim - 3.2 - Introduction Omniverse USD Presenter ( _Formerly View_ ) - 3.3 - Data Exchange - With Connectors Work in your preferred DCC app ( _Available in a future release of the Teaching Kit_ ) - 3.4 - Collaboration using the Omniverse Platform ( _Available in a future release of the Teaching Kit_ ) [**Lecture Videos**](https://www.nvidia.com/en-us/on-demand/playlist/playList-24156845-df02-4663-9ce7-73b4b317e5be/) **Labs** _Available in a future release of the Teaching Kit_ **Quizzes** - 3.1 - Introduction to Isaac Sim - 3.2 - Introduction Omniverse USD Presenter ( _Formerly View_ ) **Resources - Learn More** - [What Is Isaac Sim?](https://docs.omniverse.nvidia.com/app_isaacsim/app_isaacsim/overview.html) - [Omniverse Farm](https://docs.omniverse.nvidia.com/app_farm/app_farm/overview.html) - [Omniverse Forum](https://forums.developer.nvidia.com/c/omniverse/300) - [Pixar's USD Reference Documentation](https://graphics.pixar.com/usd/release/index.html) - [Material Definition Language (MDL)](https://www.nvidia.com/en-us/design-visualization/technologies/material-definition-language) - [Overview of Omniverse USD Presenter (_Formerly View_)](https://docs.omniverse.nvidia.com/app_view/app_view/overview.html) - [Connect Overview](https://docs.omniverse.nvidia.com/con_connect/con_connect/overview.html) **Resources - 3rd Party Connector Examples** - [Exploring Creative Workflows with Omniverse and the Unreal Engine Connector](https://www.nvidia.com/en-us/on-demand/session/omniverse2020-om1643/?playlistId=playList-0d151e6e-cf21-4686-b4e2-b141eaf17de6) - [Unreal Engine Connector - Imported USD Workflows](https://www.nvidia.com/en-us/on-demand/session/omniverse2020-om1604/?playlistId=playList-984a8dc6-cd63-4087-9101-aedd98fa2586) - [Autodesk Maya (Native) Omniverse Connector Overview](https://www.nvidia.com/en-us/on-demand/session/omniverse2020-om1560/?playlistId=playList-18b8594a-5183-48d9-99f0-655cd6a4ca28) - [Exporting an Animation Clip with Autodesk 3ds Max Connector to NVIDIA Omniverse Create](https://www.nvidia.com/en-us/on-demand/session/omniverse2020-om1562/?playlistId=playList-18b8594a-5183-48d9-99f0-655cd6a4ca28) - [Omniverse For AEC: Getting Started with AutoDesk Revit](https://www.nvidia.com/en-us/on-demand/session/omniverse2020-om1402/?playlistId=playList-3c90fff2-a052-49d0-8a32-582be2c450c2) - [Blender Connector Scene Optimizer Overview](https://www.nvidia.com/en-us/on-demand/session/omniverse2020-om1662/?playlistId=playList-d37d7b1a-2b54-4337-abd2-40a30d2956fb) ## Module 4: Introduction Universal Scene Description (OpenUSD) **Lecture Slides** - 4.1 - Fundamentals of USD Data Modeling - 4.2 - USD Paths ( Available in a future release of the Teaching Kit ) - 4.3 - USD View ( Available in a future release of the Teaching Kit ) [**Lecture Videos**](https://www.nvidia.com/en-us/on-demand/playlist/playList-fd72a888-c250-400e-8195-c8b29f0f4c41/) **Labs** _Available in a future release of the Teaching Kit_ **Quiz** - 4.1 - Fundamentals of USD Data Modeling **Resources - Learn More** - [OpenUSD and Hydra Resources](https://developer.nvidia.com/usd#resources%20) - [Maximizing OpenUSD Performance](https://graphics.pixar.com/usd/release/maxperf.html) - [Guidelines for Structuring USD Assets](https://github.com/usd-wg/assets/blob/main/docs/asset-structure-guidelines.md) - [Workflow Basics Part 1: OpenUSD and Layers in Omniverse](https://youtu.be/euC5BJWRla0) - [USD Paths](https://docs.omniverse.nvidia.com/prod_extensions/prod_extensions/ext_usd-paths.html) - [USD View In Omniverse](https://youtu.be/mxRnFZ9TMtc) **Resources - DLI Self-Paced Online Courses** - [Fundamentals of Working with OpenUSD](https://learn.nvidia.com/courses/course-detail?course_id=course-v1:DLI+S-OV-15+V1/) - [Essentials of USD in Omniverse](https://learn.nvidia.com/courses/course-detail?course_id=course-v1:DLI+S-OV-05+V1) - [Getting Started with USD for Collaborative 3D Workflows](https://courses.nvidia.com/courses/course-v1:DLI+S-FX-02+V1/) - [How to Build OpenUSD Applications for Industrial Digital Twins](https://learn.nvidia.com/courses/course-detail?course_id=course-v1:DLI+S-OV-13+V1) - [Building a 3D Product Configurator with USD and Omniverse](https://learn.nvidia.com/courses/course-detail?course_id=course-v1:DLI+S-OV-14+V1) ## Module 5: Getting Started with Isaac Sim **Lecture Slides** _Available in a future release of the Teaching Kit_ - 5.1 - Workstation Installation - 5.2 - Contaniner Istallation - 5.3 - Cloud Installation - 5.4 - Python Environment Installation **Lecture Videos** _Available in a future release of the Teaching Kit_ **Labs** _Available in a future release of the Teaching Kit_ **Quizzes** _Available in a future release of the Teaching Kit_ **Resources - Learn More** - [Isaac Sim Documentation](https://docs.omniverse.nvidia.com/app_isaacsim/app_isaacsim/overview.html) ## Module 6: Explore Isaac Sim, a Robotics Toolkit **Lecture Slides** _Available in a future release of the Teaching Kit_ - 6.1 - Omniverse Isaac Sim Interface - 6.2 - Environment Setup - 6.3 - Add Single Objects - 6.4 - OpenUSD in Isaac Sim - 6.5 - Isaac Sim Workflows **Lecture Videos** _Available in a future release of the Teaching Kit_ **Labs** _Available in a future release of the Teaching Kit_ **Quizzes** _Available in a future release of the Teaching Kit_ **Resources - Learn More** - [Isaac Sim Documentation](https://docs.omniverse.nvidia.com/app_isaacsim/app_isaacsim/overview.html) - [Guidelines for Structuring USD Assets](https://github.com/usd-wg/assets/blob/main/docs/asset-structure-guidelines.md) - [Workflow Basics Part 1: USD and Layers in Omniverse ](https://youtu.be/euC5BJWRla0) ## Module 7: Using the Isaac Sim GUI **Lecture Slides** - 7.1 - Build a Simple Robot ( _Available in a future release of the Teaching Kit_ ) - 7.2 - Add Camera and Sensors ( _Available in a future release of the Teaching Kit_ ) - 7.3 - Interactive Scripting ( _Available in a future release of the Teaching Kit_ ) - 7.4 - Getting Started with OmniGraph and Action Graph [**Lecture Videos**](https://www.nvidia.com/en-us/on-demand/playlist/playList-69b0a511-b965-4e96-b26e-e519bfa45469/) **Labs** - _Build a Simple Robot_ - _Hands-on Isaac Sim Build a Simple Robot_ **Quizzes** _Available in a future release of the Teaching Kit_ **Resources - Learn More** - [Isaac Sim Documentation](https://docs.omniverse.nvidia.com/app_isaacsim/app_isaacsim/overview.html) **Resources - DLI Self-Paced Online Courses** - [Introduction to Robotic Simulations in Isaac Sim](https://courses.nvidia.com/courses/course-v1:DLI+S-OV-03+V1/) - [Assemble a Simple Robot in Isaac Sim](https://courses.nvidia.com/courses/course-v1:DLI+T-OV-01+V1/) ## Module 8: Omniverse Isaac Sim Core Python APIs **Lecture Slides** _Available in a future release of the Teaching Kit_ - 8.1 - Building Environments - 8.2 - Building Robots - 8.3 - Building Tasks **Lecture Videos** _Available in a future release of the Teaching Kit_ **Labs** _Available in a future release of the Teaching Kit_ **Quizzes** _Available in a future release of the Teaching Kit_ **Resources - Learn More** - [Isaac Sim Documentation](https://docs.omniverse.nvidia.com/app_isaacsim/app_isaacsim/overview.html) - [LiveWorkflows](https://www.youtube.com/watch?v=al_XhUQLXhY) ## Module 9: Getting Started with Isaac Gym **Lecture Slides** _Available in a future release of the Teaching Kit_ - 9.1 - Training Examples - 9.2 - Inferencing Examples - 9.3 - Getting Started with Cloner - 9.4 - Physics Replication **Lecture Videos** _Available in a future release of the Teaching Kit_ **Labs** _Available in a future release of the Teaching Kit_ **Quizzes** _Available in a future release of the Teaching Kit_ **Resources - Learn More** - [Isaac Sim Documentation](https://docs.omniverse.nvidia.com/app_isaacsim/app_isaacsim/overview.html) ## Module 10: Creating Synthetic Data **Lecture Slides** _Available in a future release of the Teaching Kit_ - 10.1 - Getting Started with Replicator - 10.2 - Offline Synthetic Data-set Generation - 10.3 - Online Synthetic Data-set Generation with PyTorch - 10.4 - Generating Synthetic Data on OVX clusters **Lecture Videos** _Available in a future release of the Teaching Kit_ **Labs** _Available in a future release of the Teaching Kit_ **Quizzes** _Available in a future release of the Teaching Kit_ **Resources - Learn More** - [Isaac Sim Documentation](https://docs.omniverse.nvidia.com/app_isaacsim/app_isaacsim/overview.html) **Resources - DLI Self-Paced Online Courses** - [Synthetic Data Generation for Training Computer Vision Models](https://learn.nvidia.com/courses/course-detail?course_id=course-v1:DLI+S-OV-10+V1) ## Module 11: OmniGraph Input Devices **Lecture Slides** _Available in a future release of the Teaching Kit_ - 11.1 - Gamepad Input - 11.2 - Keyboard Input - 11.3 - OmniGraph Python Scripting - 11.4 - Code Explanation **Lecture Videos** _Available in a future release of the Teaching Kit_ **Labs** _Available in a future release of the Teaching Kit_ **Quizzes** _Available in a future release of the Teaching Kit_ **Resources - Learn More** - [Isaac Sim Documentation](https://docs.omniverse.nvidia.com/app_isaacsim/app_isaacsim/overview.html) ## Module 12: Force and Contact Sensor **Lecture Slides** _Available in a future release of the Teaching Kit_ - 12.1 - Isaac Examples **Lecture Videos** _Available in a future release of the Teaching Kit_ **Labs** _Available in a future release of the Teaching Kit_ **Quizzes** _Available in a future release of the Teaching Kit_ **Resources - Learn More** - [Isaac Sim Documentation](https://docs.omniverse.nvidia.com/app_isaacsim/app_isaacsim/overview.html) ## Module 13: IMU Sensor Node **Lecture Slides** _Available in a future release of the Teaching Kit_ - 13.1 - Adding Simple Articulation - 13.2 - Adding the IMU Sensor **Lecture Videos** _Available in a future release of the Teaching Kit_ **Labs** _Available in a future release of the Teaching Kit_ **Quizzes** _Available in a future release of the Teaching Kit_ **Resources - Learn More** - [Isaac Sim Documentation](https://docs.omniverse.nvidia.com/app_isaacsim/app_isaacsim/overview.html) ## Module 14: Adding a new Manipulator **Lecture Slides** _Available in a future release of the Teaching Kit_ - 14.1 - Adding a Unified Robot Descriptor Format (URDF) to Represent the Robot - 14.2 - Tuning the Manipulator - 14.3 - Adding a Follow Target Example - 14.4 - Performing a Pick and Place Task **Lecture Videos** _Available in a future release of the Teaching Kit_ **Labs** _Available in a future release of the Teaching Kit_ **Quizzes** _Available in a future release of the Teaching Kit_ **Resources - Learn More** - [Isaac Sim Documentation](https://docs.omniverse.nvidia.com/app_isaacsim/app_isaacsim/overview.html) ## Module 15: RTX Lidar **Lecture Slides** _Available in a future release of the Teaching Kit_ - 15.1 - Introduction: How to Use RTX Lidar Sensors - 15.2 - Create an RTX Lidar Sensor - 15.3 - Publish Sensor **Lecture Videos** _Available in a future release of the Teaching Kit_ **Labs** _Available in a future release of the Teaching Kit_ **Quizzes** _Available in a future release of the Teaching Kit_ **Resources - Learn More** - [Isaac Sim Documentation](https://docs.omniverse.nvidia.com/app_isaacsim/app_isaacsim/overview.html) ## Module 16: Visualizing Live Data **Lecture Slides** _Available in a future release of the Teaching Kit_ - 16.1 - API - UsdGeom.Points and Pointsinstancer - 16.2 - API - DebugDraw **Lecture Videos** _Available in a future release of the Teaching Kit_ **Labs** _Available in a future release of the Teaching Kit_ **Quizzes** _Available in a future release of the Teaching Kit_ **Resources - Learn More** - [Isaac Sim Documentation](https://docs.omniverse.nvidia.com/app_isaacsim/app_isaacsim/overview.html)