Clara Holoscan SDK

Build high-performance streaming AI applications for medical devices with the NVIDIA Clara™ Holoscan SDK. Access healthcare-specific acceleration libraries, pretrained AI models, and reference applications for ultrasound, endoscopy, surgical robots, and more.

Download
Learn more about the Clara Holoscan Platform

Image alt text

Features

Reference AI Pipelines

Access reference architectures for endoscopy and ultrasound applications with video-in and AI inference for video-based modalities.

Sensor Processing

Support for camera serial interface and front-end sensors for video capture, ultrasound research, data acquisition, and connection to legacy medical devices.

Latency Measurement

Use Clara Holoscan SDK’s data transfer latency tool to measure complete end-to-end latency for video processing applications.

Compatible Platforms


  • NVIDIA RTX support - Docker and CUDA, TensorRT, dGPU enablement
  • NVIDIA Rivermax 100GbE streaming - Rivermax transport protocol streams data over ethernet directly into GPU GDDR DRAM using GPU Direct Technology
  • NVIDIA Clara Guardian support - Build edge AI applications to improve patient care and operational efficiency using everyday sensors like cameras & microphones

Find the latest collection of reference applications on the NGC Collection for Clara Holoscan. In addition, find Deep Learning framework enabled Docker containers such as PyTorch and TensorFlow on NGC.

Download

1.

Apply for developer access to the Clara Holoscan SDK Program.

2.

Download and install the SDK Manager. After logging in to SDK Manager, you'll be able to flash your device.

3.

Download the Clara Holoscan SDK from GitHub.

Scroll down to the Documentation section to access user guides, NGC Collections, and sample code.


System Requirements

The Clara Holoscan SDK is compatible with the Clara AGX Developer Kit and Clara Holoscan Developer Kit. For more information on the SDK v0.2 platform and release information, please see the release notes in the Documentation section.


v0.1v0.2
Operating SystemUbuntu 18.04Ubuntu 20.04
JetpackJetpack 4.5.1, l4t 32.5.1Jetpack 5.0 HP, l4t 34.1.2
Developer KitClara AGX Developer KitClara AGX Developer Kit,
Clara Holoscan Developer Kit
Supported GPUsRTX 6000RTX 6000, RTX A6000
Supported Drivers460.73.01510.73.08

Latest Version for Clara Holoscan SDK

The Clara Holoscan SDK v0.2 provides GXF integration, sample applications for endoscopy and ultrasound, GPUDirect RDMA with AJA integration, CUDA / OpenGL interoperability, TensorRT inference, and image transform acceleration in NVIDIA Performance Primitive Library (NPP). Visit the NGC Collection to run our Reference Applications today. To see the source code of our SDK, you can find it among a set of GitHub resources. If you have any questions or would like to exchange any ideas, visit the Developer Forum to chat with us.


Read More   Reference Applications   Forum

Documentation

Below you’ll find documentation for both the Clara AGX Developer Kit and Clara Holoscan SDK. If this is your first time getting started with either product, we suggest starting with the NVIDIA Clara AGX User Guide.

Development TasksGetting Started
Flash and set up the Clara AGX Developer KitFollow the Clara AGX Dev Kit User Guide.
Connect your sensor IO to Clara AGX Developer KitCheck out our distributor page for Holoscan IO Partners and their IO formats.
Check out the reference applicationsVisit the Clara Holoscan NGC Collection to see the run container for our GXF reference applications.
Check out the source codeVisit the Clara Holoscan GitHub to find the source code for Clara Holoscan Embedded SDK.
Explore the reference architecture for endoscopy use casesAccess the Endoscopy White Paper.
Bring your own model to the endoscopy reference pipelineVisit the Clara Holoscan SDK User Guide to see the Chapter Clara Holoscan Sample Apps on how to customize the reference apps.
Use TensorRT for your deep learning inference applicationsVisit the TensorRT developer page and getting started page for documentation and other resources on TensorRT.
Develop drivers for GPU Direct/RDMA over PCIe as an ecosystem partnerFollow the minimal GPU Direct/RDMA driver sample code .

Hardware

The NVIDIA Clara Developer kit helps facilitate accelerated processing with 3rd party sensor front ends, High-Speed I/O with the ConnectX SmartNIC, the flexibility and efficiency of the Jetson System-on-Module, and a powerful RTX-series Discrete GPU.

See our Clara Developer Kits Page for hardware options in your development journey, and the MGX product page for the production platform.

To find out more information about our ecosystem partners including IO partners and distributors, please visit our distributor page.

FAQ

It contains both. Clara Holoscan SDK is our software SDK that currently runs on the Clara AGX Developer Kit/Clara Holoscan Developer Kit hardware.


The Clara AGX/Holoscan Developer Kits are ARM based.



The Clara AGX Developer Kit is the predecessor of the updated Clara Holoscan Developer Kit. Read more about our devkits here.


Clara AGX Developer KitClara Holoscan Developer Kit
AvailabilityNowQ4 2022
SoCXavierOrin
Discrete GPU (dGPU)RTX 6000RTX A6000
SmartNICConnectX-6ConnectX-7
Memory Bandwidth100 GbE / 10 GbE / 1 GbE2x 100 GbE / 2x 1GbE
SSD250 GB500 GB
Operating SystemUbuntu 18.04, Ubuntu 20.04Ubuntu 20.04
Jetpack SupportJetpack 4.5, Jetpack 5.0Jetpack 5.0
Developer ToolsIn dGPU mode: CUDA 11.1In dGPU mode: CUDA 11.6

Developer Blogs

Boost AI Medical Device Streaming Workflows with the Clara Holoscan SDK

June 17, 2022

Boost AI Medical Device Streaming Workflows with the Clara Holoscan SDK

New Sensor Partners Expand Surgical, Ultrasound, and Data Acquisition Capabilities in the NVIDIA Clara Holoscan Platform

March 22, 2022

New Sensor Partners Expand Surgical, Ultrasound, and Data Acquisition Capabilities in the NVIDIA Clara Holoscan Platform

Autonomous Robot Improves Surgical Precision Using AI

February 2, 2022

Autonomous Robot Improves Surgical Precision Using AI

Removing Aliasing Artifacts in Ultrasound Color Doppler Imaging with NVIDIA Clara Holoscan and the NVIDIA Clara Developer Kit

November 29, 2021

Removing Aliasing Artifacts in Ultrasound Color Doppler Imaging with NVIDIA Clara Holoscan and the NVIDIA Clara Developer Kit

Developer Resources