Clara Holoscan SDK

Build high-performance streaming AI applications for medical devices with the NVIDIA Clara™ Holoscan SDK. Access healthcare-specific acceleration libraries, pretrained AI models, and reference applications for ultrasound, endoscopy, surgical robots, and more.

Download Documentation
Learn more about the Clara Holoscan Platform

Features

Reference AI Pipelines

Access reference architectures for endoscopy, ultrasound, and colonoscopy applications with video-in and AI inference for video-based modalities.

Sensor Processing

Support for camera serial interface and front-end sensors for video capture, ultrasound research, data acquisition, and connection to legacy medical devices.

Low Latency

Use Clara Holoscan SDK’s data transfer latency tool to measure complete end-to-end latency for video processing applications.

Compatible Platforms

NVIDIA RTX support - Docker and CUDA, TensorRT, dGPU enablement
NVIDIA Rivermax 100GbE streaming - Rivermax transport protocol streams data over ethernet directly into GPU GDDR DRAM using GPU Direct Technology
NVIDIA Clara Guardian support - Build edge AI applications to improve patient care and operational efficiency using everyday sensors like cameras & microphones

Find the latest collection of reference applications on the NGC Collection for Clara Holoscan. In addition, find Deep Learning framework enabled Docker containers such as PyTorch and TensorFlow on NGC.

Download

1.

Apply for developer access to the Clara Holoscan SDK Program.

2.

Download and install the SDK Manager. After logging in to SDK Manager, you'll be able to flash your device.

3.

Download the Clara Holoscan SDK from GitHub.

Scroll down to the Documentation section to access user guides, NGC Collections, and sample code.

System Requirements

The Clara Holoscan SDK is compatible with the Clara AGX Developer Kit and NVIDIA IGX Orin Developer Kit. For more information on the SDK v0.3 platform and release information, please see the release notes in the Documentation section.

	V0.1 [Embedded]	V0.2 [Embedded]	V0.3 [Embedded]	V0.3 [x86]
Operating System	Ubuntu 18.04	Ubuntu 20.04	Ubuntu 20.04	Ubuntu 20.04
Software	Jetpack 4.5.1, l4t 32.5.1	Jetpack 5.0 HP, l4t 34.1.2	Holopack 1.1, l4t 34.1.2	-
Hardware	Clara AGX Developer Kit	Clara AGX Developer Kit, Clara Holoscan Developer Kit	Clara AGX Developer Kit, NVIDIA IGX Orin Developer Kit	x86 workstations
Supported GPUs	RTX 6000	RTX 6000, RTX A6000	RTX 6000, RTX A6000	Ampere, Turing
Supported Drivers	460.73.01	510.73.08	510.73.08	510.73.08

Latest Version for Clara Holoscan SDK

Announced at GTC, NVIDIA Clara Holoscan SDK 0.3 now provides a lightning-fast frame rate of 240Hz for 4K video that allows developers to combine data from more sensors and build AI applications that can provide surgical guidance. With faster data transfer enabled via high speed ethernet connected sensors, developers have even more tools to build accelerated AI pipelines.

The Clara Holoscan SDK v0.3 provides GXF integration, C++ API and sample applications in both GXF and C++ API for endoscopy, colonoscopy, and ultrasound. GPUDirect RDMA with AJA video capture integration and high speed 4K 240 Hz Emergent camera integration with Rivermax support allows combined sensor data from multiple channels. Vulkan API is available for visualization, CUDA / OpenGL interoperability, TensorRT inference, and image transform acceleration in the NVIDIA Performance Primitive Library (NPP). x86 support is now available making it even easier to experiment and build AI applications with Clara Holoscan on other platforms.

Visit the NGC Collection to run our Reference Applications today. To see the source code of our SDK, you can find it among a set of GitHub resources. If you have any questions or would like to exchange any ideas, visit the Developer Forum to chat with us.

Documentation

Below you’ll find documentation for both the Clara AGX Developer Kit and Clara Holoscan SDK. If this is your first time getting started with either product, we suggest starting with the NVIDIA Clara AGX User Guide.

Development Tasks	Getting Started
Flash and set up the Clara AGX Developer Kit	Follow the Clara AGX Dev Kit User Guide.
Flash and set up the NVIDIA IGX Orin Developer Kit	Follow the NVIDIA IGX Orin Dev Kit User Guide (Early Access)
Connect your sensor IO to Clara AGX Developer Kit	Check out our distributor page for Holoscan IO Partners and their IO formats.
Check out the reference applications	Visit the Clara Holoscan NGC Collection to see the run container for our GXF reference applications.
Check out the source code	Visit the Clara Holoscan GitHub to find the source code for Clara Holoscan Embedded SDK.
Explore the reference architecture for endoscopy use cases	Endoscopy tool tracking sample application Ultrasound segmentation sample application
Bring your own model to the endoscopy reference pipeline	Visit the Clara Holoscan SDK User Guide to see the Chapter Clara Holoscan Sample Apps on how to customize the reference apps.
Use TensorRT for your deep learning inference applications	Visit the TensorRT developer page and getting started page for documentation and other resources on TensorRT.
Develop drivers for GPU Direct/RDMA over PCIe as an ecosystem partner	Follow the minimal GPU Direct/RDMA driver sample code .