VRWorks 360 Video Releases
VRWorks 360 Video SDK version 2.0VRWorks 360 Video SDK 2.0 for Windows VRWorks 360 Video SDK 2.0 for Linux
VRWorks 360 Video features are aimed at content creators and VR application developers and bring a new level of performance, immersiveness and responsiveness to capture, stitch and stream 360 mono or stereo in real-time or offline. This version paired with Turing based GPUs brings many new technologies including ambisonics audio, improved mono stitch, depth-based mono stitch, a region of interest stitch, moveable seams and Warp 360.Release Highlights
- Ambisonic Audio s a technique to record, mix and playback 3D 360 degree audio. The new pipeline enables 3D, omnidirectional audio such that the perceived direction of sound sources change when viewers modify their orientation.
- New Mono Pipeline s a new stitching pipeline that brings additional robustness, improved image quality without additional processing time as the older method on a single GPU. It offers multi-GPU scaling on Turing-based GPUs which contribute up to 2x scaling compared to old mono pipeline.
- Depth-based mono stitch s a new stitching pipeline that uses depth-based alignment to improve the stitching quality in scenes with objects close to the camera rig and improves the quality across the region of overlap between two cameras.
- Region of interest stitch enables adaptive stitching by defining the desired field of view rather than stitching a complete panorama. This opens up new use cases such as 180-degree VR and can reduce execution time and improve performance.
- Moveable seams s a feature that enables creators to adjust the seams location in the region of overlap between 2 cameras to preserve visual fidelity in the region of overlap particularly when objects are close to the camera.
- Warp 360 rovides highly-optimized image warping and distortion removal by converting images between a number of projection types, including perspective, fisheye and equirectangular. It can transform equirectangular stitched output into projection format such as cubemap to reduce streaming bandwidth leading to increased performance.
- Added support for MP4 metadata injection which supports tags for Ambisonic audio and 360 video, with or without the top/bottom stereo views.
- Stability, quality and performance improvements.
- NVIDIA BLOG - NVIDIA RTX-Powered VRWorks 360 Video SDK Brings Big Speedups and New Features
- DEVBLOG - VRWorks 360 Video SDK 2.0 Adds Features, Turing Support
VRWorks 360 Video SDK version 1.5VRWorks 360 Video SDK 1.5 for Windows VRWorks 360 Video SDK 1.5 for Linux
- Added Linux support for Linux version - Ubuntu 16.04 and up and Fedora 25 and up
- Added support for GP100
- Enhanced low level audio SDK to use static buffers for
- consistent processing performance
- Enhanced quality for stereo panoramas when the rig is calibrated with nearby objects (e.g. indoor scenes)
- General stability improvements
- NVIDIA BLOG - Industry Leaders Adopt NVIDIA VRWorks to Push Boundaries of 360-Degree Video Storytelling
VRWorks 360 Video SDK version 1.1VRWorks 360 Video SDK 1.1 for Windows
This release brings many improvements listed below including new calibration technologies. The SDK now supports camera calibration without requiring input estimates for camera parameters. It automatically computes estimated focal length, rotation, principal point and fisheye radius if not provided. Non homogenous camera rigs are also supported given constraints related to overlap are satisfied. These rigs can be composed of cameras with different resolution, lens distortion type or focal length and the SDK also includes auto balancing for automatic equatorial alignment of the camera rig.Release Highlights
- Added support for Volta based GPUs resulting in a 70% performance increase* (Built on CUDA 9.0).
- Added support to specify the minimum distance (in cm) for stereo stitching.
- Reduced AAC audio latency.
- Added callback mode to high level sample application. Can now be used easily for applications such as streaming.
- Added a delay parameter for manual synchronization of input videos. The delay can be set separately for each input stream, manually or through the XML.
- Added support for creating and running multiple stitcher instances at the same time, within one or more processes.
- Added support for running multiple stitching sessions using a single stitcher instance.
- Added feature for automatic equatorial alignment of the output panorama. This feature detects if camera rig has a ring of cameras and aligns them along the equator of the panorama.
- Added support for camera calibration without any input estimates for camera parameters. Estimates for focal length, rotation, principal point and fisheye radius are automatically computed if not provided and are optional.
- Added support for camera calibration with non-homogenous rigs, i.e. rigs having cameras of different resolution, lens distortion type or focal length.
- DEV BLOG - Calibrating Stitched Videos with VRWorks 360 Video SDK
- NEWS BLOG - NVIDIA VRWorks 360 Video SDK 1.1 released