VRWorks - Audio
VRWorks Audio brings truly immersive audio to applications by pathtracing sound in 3D space in real time.
|Hardware:||Compatible with: Maxwell and Pascal based GPUs. (GeForce GTX 900 series and higher, Quadro M5000 and higher)|
|Software:||64 bit Windows.
Plugin for Unreal Engine
The demand for realism increases dramatically the instant a player puts on a Head-Mounted Display (HMD) - images, sounds, and interactions make or break the immersiveness of the experience. For example, audio in a small room will sound different than the same audio outdoors because of the reflections caused by sound bouncing off the walls of the room.
Leveraging NVIDIA OptiX ray tracing technology, VRWorks Audio traces the path of sound in real-time, delivering physically realistic audio that conveys the size, shape, and material properties of the virtual environment you are in.
How Sound Moves in Space
Path Traced Audio
Real-time modeling of the following effects:
- Sound propagation, direct and indirect paths
- Occlusion for direct and indirect paths
- Directionality/HRTF (Head Related Transfer Function)
- Approximate direct path diffraction
- Material reflection, absorption, & transmission
NVIDIA VRWorks Audio is a fully GPU accelerated and path-traced audio solution that creates a complete acoustic image of the environment in real-time without requiring any precomputed filters.
As the scene is loaded by the application, the acoustic model is built and updated on-the-fly; audio effect filters are generated and applied in real time on the sound source waveforms. This approach gives tremendous flexibility to the audio designers and engineers, allowing them to design soundscapes interactively.
NVIDIA VRWorks Audio Pipeline
- Scene information is loaded
- Simulation is performed (using geometry, source locations and material properties)
- Audio filters are generated
- Audio filters are applied on the source "Dry" audio
- "Wet" audio (with VRWorks filters applied) is output to the application
NVIDIA VRWorks Audio SDK
NVIDIA VRWorks Audio SDK consists of a library, a set of APIs, sample applications and documentation designed for application developers who wish to have immersive audio in their applications. All APIs are designed as standard C-APIs.
Download VRWorks Audio SDK
NVIDIA VRWorks Audio for Unreal Engine 4
VRWorks Audio is also avaialable as an Unreal Engine 4.15 game engine plugin which makes using this technology in UE4 based games and experiences simple. Plugins for other game and audio platforms are forthcoming.
In order to access the UE4 GameWorks integrations, you will need a UE4 / GitHub subscription.
- GTC2018 - Creating Immersive Audio Effects in Games and Applications Using VRWorks Audio
- SDK Overview Document
- "VRWorks Audio SDK in-depth" developer blog