Clara Holoscan SDK

Build high-performance streaming AI applications for medical devices with the NVIDIA Clara™ Holoscan SDK. Access healthcare-specific acceleration libraries, pretrained AI models, and reference applications for ultrasound, endoscopy, surgical robots, and more.

Download  Documentation
Learn more about the Clara Holoscan Platform
Build high-performance streaming AI applications for medical devices with the NVIDIA Clara™ Holoscan SDK

Features

Reference AI Pipelines

Access reference architectures for endoscopy, ultrasound, and colonoscopy applications with video-in and AI inference for video-based modalities.

Sensor Processing

Support for camera serial interface and front-end sensors for video capture, ultrasound research, data acquisition, and connection to legacy medical devices.

Low Latency

Use Clara Holoscan SDK’s data transfer latency tool to measure complete end-to-end latency for video processing applications.

Compatible Platforms


  • NVIDIA RTX support - Docker and CUDA, TensorRT, dGPU enablement
  • NVIDIA Rivermax 100GbE streaming - Rivermax transport protocol streams data over ethernet directly into GPU GDDR DRAM using GPU Direct Technology
  • NVIDIA Clara Guardian support - Build edge AI applications to improve patient care and operational efficiency using everyday sensors like cameras & microphones

Find the latest collection of reference applications on the NGC Collection for Clara Holoscan. In addition, find Deep Learning framework enabled Docker containers such as PyTorch and TensorFlow on NGC.

Download

1.

Apply for developer access to the Clara Holoscan SDK Program.

2.

Download and install the SDK Manager. After logging in to SDK Manager, you'll be able to flash your device.

3.

Download the Clara Holoscan SDK from GitHub.

Scroll down to the Documentation section to access user guides, NGC Collections, and sample code.


System Requirements

The Clara Holoscan SDK is compatible with the Clara AGX Developer Kit and NVIDIA IGX Orin Developer Kit. For more information on the SDK v0.3 platform and release information, please see the release notes in the Documentation section.


V0.1
[Embedded]
V0.2
[Embedded]
V0.3
[Embedded]
V0.3
[x86]
Operating SystemUbuntu 18.04Ubuntu 20.04Ubuntu 20.04Ubuntu 20.04
SoftwareJetpack 4.5.1, l4t 32.5.1Jetpack 5.0 HP, l4t 34.1.2Holopack 1.1, l4t 34.1.2 -
HardwareClara AGX Developer KitClara AGX Developer Kit,
Clara Holoscan Developer Kit
Clara AGX Developer Kit, NVIDIA IGX Orin Developer Kitx86 workstations
Supported GPUsRTX 6000RTX 6000, RTX A6000RTX 6000, RTX A6000Ampere, Turing
Supported Drivers460.73.01510.73.08510.73.08510.73.08

Latest Version for Clara Holoscan SDK

Announced at GTC, NVIDIA Clara Holoscan SDK 0.3 now provides a lightning-fast frame rate of 240Hz for 4K video that allows developers to combine data from more sensors and build AI applications that can provide surgical guidance. With faster data transfer enabled via high speed ethernet connected sensors, developers have even more tools to build accelerated AI pipelines.

The Clara Holoscan SDK v0.3 provides GXF integration, C++ API and sample applications in both GXF and C++ API for endoscopy, colonoscopy, and ultrasound. GPUDirect RDMA with AJA video capture integration and high speed 4K 240 Hz Emergent camera integration with Rivermax support allows combined sensor data from multiple channels. Vulkan API is available for visualization, CUDA / OpenGL interoperability, TensorRT inference, and image transform acceleration in the NVIDIA Performance Primitive Library (NPP). x86 support is now available making it even easier to experiment and build AI applications with Clara Holoscan on other platforms.

Visit the NGC Collection to run our Reference Applications today. To see the source code of our SDK, you can find it among a set of GitHub resources. If you have any questions or would like to exchange any ideas, visit the Developer Forum to chat with us.


Read more   Reference applications   Forum

Documentation

Below you’ll find documentation for both the Clara AGX Developer Kit and Clara Holoscan SDK. If this is your first time getting started with either product, we suggest starting with the NVIDIA Clara AGX User Guide.


Development TasksGetting Started
Flash and set up the Clara AGX Developer KitFollow the Clara AGX Dev Kit User Guide.
Flash and set up the NVIDIA IGX Orin Developer KitFollow the NVIDIA IGX Orin Dev Kit User Guide (Early Access)
Connect your sensor IO to Clara AGX Developer KitCheck out our distributor page for Holoscan IO Partners and their IO formats.
Check out the reference applicationsVisit the Clara Holoscan NGC Collection to see the run container for our GXF reference applications.
Check out the source codeVisit the Clara Holoscan GitHub to find the source code for Clara Holoscan Embedded SDK.
Explore the reference architecture for endoscopy use cases
Bring your own model to the endoscopy reference pipelineVisit the Clara Holoscan SDK User Guide to see the Chapter Clara Holoscan Sample Apps on how to customize the reference apps.
Use TensorRT for your deep learning inference applicationsVisit the TensorRT developer page and getting started page for documentation and other resources on TensorRT.
Develop drivers for GPU Direct/RDMA over PCIe as an ecosystem partnerFollow the minimal GPU Direct/RDMA driver sample code .

FAQ

It contains both. Clara Holoscan SDK is our software SDK that currently runs on the Clara AGX Developer Kit/NVIDIA IGX Orin Developer Kit hardware.


The Clara AGX/NVIDIA IGX Orin Developer Kits are ARM based.



Developer Blogs

Deploying AI-Accelerated Medical Devices with NVIDIA Clara Holoscan

November 15, 2022

Deploying AI-Accelerated Medical Devices with NVIDIA Clara Holoscan

Powering Ultra-High Speed Frame Rates in AI Medical Devices with the NVIDIA Clara Holoscan SDK

September 21, 2022

Powering Ultra-High Speed Frame Rates in AI Medical Devices with the NVIDIA Clara Holoscan SDK

AI in Endoscopy: Improving Detection Rates and Visibility with Real-Time Sensing

August 30, 2022

AI in Endoscopy: Improving Detection Rates and Visibility with Real-Time Sensing

AI Remotely Detects Parkinson’s Disease During Sleep

August 29, 2022

AI Remotely Detects Parkinson’s Disease During Sleep