Vision Programming Interface (VPI)

NVIDIA^® Vision Programming Interface (VPI) is a software library that provides Computer Vision / Image Processing algorithms implemented on several computing engines available in NVIDIA embedded devices like Jetson and in discrete devices like dGPU.

VPI provides a uniform interface for seamless access to multiple compute engines like CPU, GPU Programmable Vision Accelerator (PVA), and Video Image Compositor (VIC). With VPI, a processing pipeline can fully utilize the installed computing capacity of the device with different parts of the pipeline running on different compute engines simultaneously.

VPI algorithms are highly optimized ⁠— check out the VPI performance benchmarks. Increase performance of your application by replacing parts of your pipeline containing any non performant OpenCV or Visionworks algorithms with VPI algorithms and by optimally distributing your workload on multiple compute engines with VPI.

VPI 1.0

VPI 1.0 is the first production release and is available with JetPack 4.5 to download on Jetson modules and developer kits and is also available for x86.

VPI 1.0 highlights include:

• Support for Pyramidal LK Optical Flow on CPU and GPU
• Supports YUV422 packed color format for VIC
• Enhanced interoperability with OpenCV

Refer to VPI Release Notes for details.

Features

• Algorithms implemented on multiple compute engines (GPU, CPU, PVA, and VIC)
• Uniform interface to access all supported compute engines
• Seamless, zero-copy memory mapping to achieve high throughput
• Easy interoperability with OpenCV
• Sample applications to illustrate use of VPI algorithms
• Performance benchmarks for every supported algorithm

Supported Algorithms

Webinars and Blogs

Reference Information

• VPI Release Notes
• VPI Documentation