NVIDIA CloudXR™ SDK
CloudXR is NVIDIA's solution for streaming virtual reality (VR), augmented reality (AR), and mixed reality (MR) content from any OpenVR XR application on a remote server—cloud, data center, or edge. The CloudXR streaming solution includes NVIDIA RTX™ hardware, NVIDIA RTX Virtual Workstation (vWS) drivers, and the CloudXR software development kit (SDK).
See CloudXR Results Across Industries
Autodesk VRED
Rendered in Autodesk VRED, streamed over 5G
ESI Group IC.IDO
ESI Group’s IC.IDO collaborative VR environment
Innoactive
Why SAP uses Innoactive Creator and Portal
Luxion KeyVR
One Click from Luxion’s KeyShot to KeyVR streaming AR
Theia Interactive
Image courtesy of Theia Interactive
Masterpiece VR
Streaming immersive 3D design and character creation
Dreamscape Immersive
5G use case with AT&T, WEVR, Ericsson, and Dreamscape Immersive
Heavenue
Actors Theatre of Louisville’s Lab Production of A Christmas Carol: Scrooge’s Ghost Encounter Live in VR
Benefits
Untethered XR Device Experience
High-fidelity, immersive VR applications typically require the use of a restrictive tethered HMD. CloudXR allows VR users to move to wireless HMDs without any noticeable degradation in the VR experience.
Growing Wireless Ecosystem
Beyond the multitude of cellular phones and tablets, there are several OEMs working on 5G- and Wi-Fi-enabled VR All-in-One HMDs.
Streaming of Any OpenVR Application
The CloudXR streaming stack provides developers with a flexible high-performance cloud instance they can leverage to stream even the most demanding immersive experiences.
AR Support
The CloudXR server application even supports streaming VR content to AR phones/tablets by adding an alpha channel. This alpha channel is used to blend the rendered content with the live camera stream.
How It Works
With CloudXR, VR/AR content can be streamed over wireless or wired networks to any end device, whether the device is untethered or a tethered thin client. CloudXR thin clients are supported on XR-capable Android platforms.
The SDK provides a way to stream graphics-intensive XR content by accessing a high-powered graphics server and streaming over a radio signal (5G or Wi-Fi, for instance) to a relatively low-powered client, such as an Android-based All-In-One head-mounted display (HMD), or a PC-connected HMDs like the Vive Pro. The SDK also enables streaming of OpenVR applications to a number of 5G-connected Android devices, including 5G-enabled phones. This enables more mobile access to high-powered servers, as well as access to graphics-intensive applications on relatively low-powered graphics hardware.
- CloudXR Server Driver: Server-side binaries and libraries (Windows 10 or higher)
- CloudXR Client App: Operating system (OS)-specific binaries and libraries
- CloudXR Client SDK: OS-specific sample application (with source code sample)
The CloudXR Server presents a virtual HMD driver to SteamVR. This allows existing OpenVR applications to see the HMD as being locally connected, and thus does not require any changes at the application level. The CloudXR server receives frames and audio from the OpenVR application and subsequently encodes and transports them to the CloudXR client.
On the client, the Cloud XR Client Application receives and decodes the frames and audio, and presents them to the end device runtime. This application also relays controller and HMD tracking data and other inputs back to the server.
Supported Devices
Head Mounted Displays
OpenVR-capable HMDs tethered to NVIDIA Pascal™, Turing™, or Ampere™ based GPU:
HTC VIVE
Valve
Untethered Android-based devices:
HTC VIVE
Meta Quest
Pico
Mobile Devices
Device-specific CloudXR client application packages (APKs):
HMD partners wishing to support CloudXR can use the CloudXR Client SDK to create a device-specific APK.
Supported Cloud Service Providers
CloudXR is available on the following Cloud Service Provider Marketplaces:
CloudXR News
March 23, 2023
Dialed Into 5G: NVIDIA CloudXR 4.0 Brings Enhanced Flexibility and Scalability for XR Deployment
February 15, 2023
Building XR Applications on PC for High-Quality Graphics
October 5, 2022
Explainer: What Is Extended Reality?
September 14, 2022
Developing the Next Generation of Extended Reality Applications with Speech AI
Additional Resources
Streaming Immersive 3D Design & Character Creation with NVIDIA CloudXR
3D character artists use Masterpiece Studio to immersively work face-to-face with their creations, entirely in VR. By leveraging CloudXR and the Google Cloud Platform, those artists can now realize their visions from anywhere in the world.
Solution Brief: The Challenge of Enterprise XR
Creative and technical professionals use an immersive visual computing platform to imagine, design, and build everything from office buildings to airplanes to feature films. Leveraging virtual and augmented reality, those professionals are now gaining deeper insights into their digital creations.
XR Sessions On Demand
Explore the latest in XR from NVIDIA’s GTC 2021. Watch a selection of the on-demand sessions and hear how HTC, Innoactive, Horizon Productions, Wevr and others are leveraging NVIDIA solutions like CloudXR, RTXGI, VRWorks and Omniverse to push the limits of XR development.