NVIDIA DRIVE Hyperion

NVIDIA DRIVE Hyperion™ is an end-to-end development platform and reference architecture for designing autonomous vehicles (AV). It includes multiple DRIVE AGX Orin™ Developer Kits, each powered by an Orin SoC delivering up to 254 TOPS, a variety of sensor modalities to enable 360-degree surround view, and extra compute power to offload data recording and replay. The system is verified, calibrated, and synchronized out of the box to support rapid scaling from development to production.

hyperion-all-850x480.jpg

High Performance

NVIDIA DRIVE AGX modular computing platform delivers rich automotive IO and 254 TOPS per SoC, and is built on auto-grade silicon.

Algorithm Development

Safety-certified L2+/L3 sensor sets with production validated sensor drivers and tuning accelerate algorithm development.

Data Productivity

Accurate sensor calibration, precise time synchronization, efficient data compression, and integrated utilities improve the entire data processing pipeline efficiency.

Optimization & Testing

Physically accurate ray tracing-based virtual sensors are available in NVIDIA DRIVE Sim™ to virtually test and augment datasets with synthetic data.

Hyperion 8.1

AGX-Drive_Firespray_3QTR-Front-Right_Internal.jpg

DRIVE AGX Orin Developer Kit

  • Powered by a single Orin SoC delivering up to 254 TOPS.
  • Includes hardware, software, and sample applications needed for the development of production-level autonomous vehicle applications.
  • Built on production auto-grade silicon.
  • Provides rich automotive I/O and flexibility to expand.
  • Base kit for bench development and add-on vehicle kit for installation.
Component Description Details
One Orin SoC Deep Learning Accelerators (DLA) 21.5 TOPS (FP16) | 87 TOPS (INT8)
NVIDIA Ampere architecture-class integrated GPU 167 TOPS (INT8) | 5.2 TOPS (FP32)
Image Signal Processor (ISP) 1.85Gigapixels/s
DRIVE AGX System I/O Camera 90 Gb/s over 16x GMSL(R) ports
LIDAR / Radar ~30Gb/s over Ethernet
Vehicle IO 6 CAN interfaces

Component Description Details
One Orin SoC 12 Cortex-A78A CPU
Deep Learning Accelerators (DLA) 21.5 TOPS (FP16) | 87 TOPS (INT8)
NVIDIA Ampere architecture-class integrated GPU 167 TOPS (INT8) | 5.2 TOPS (FP32)
Programmable Vision Accelerators (PVA) 2048 GMACS (INT8) | 512 GMACS (INT16)
Image Signal Processor (ISP) 1.85Gigapixels/s
Video encoder Up to 1.0GPix/s (H.265)
Video decoder Up to 1.9GPix/s
Memory Bandwidth (256-Bit LPDDR5) ~200GB/s
DRIVE AGX System I/O Camera 90 Gb/s over 16x GMSL(R) ports
LIDAR / Radar ~30Gb/s over Ethernet
Vehicle IO 6 CAN interfaces
Included Accessories Network Interface Adapter Converts 1GbE Rugged Auto HMT-D IO to Standard Ethernet RJ45 IO
Other cables Connects the DRIVE AGX system to a host development computer

Scaleable AV Platform

  • A single Orin SoC with up to 254 TOPS (CUDA Tensor Core GPU + DLA)
  • 12 Arm Cortex-A78AE CPUs
  • Architected for safety

Rich Automotive I/O

  • 16x GMSL cameras
  • 2x 10GbE, 10x 1GbE, 6x 100 MbE
  • DisplayPort 1.4
  • Automotive Audio Bus (A2B)

NVIDIA DRIVE SDK Support

  • Includes the foundational software stack, NVIDIA DRIVE OS with DriveWorks
  • Contains a rich suite of developer tools such as NvMedia, NvStreams, CUDA, cuDNN, and TensorRT

Availability

  • Early access in limited quantities in Q4 2021. Signed agreements required
  • General availability in Q2 2022 directly from NVIDIA or via distributor / channel. No signed agreements required

Camera

A mix of wide-angle fisheye cameras for near vision, paired with high-fidelity wide and tele 8MP cameras for detecting longer distances.

Learn More

Radar

Multiple radars for overlapping front, side, and corner visibility and redundancy, with increased angular and vertical resolution for complex urban driving.

Learn More

Lidar

Front center automotive-grade lidar for an additional layer of redundant vision, as well as a rooftop high-resolution lidar for ground truth (GT) data collection.

Learn More

IMU + GPS

Vehicle odometry sensing for precise localization and ground truth determination.

Learn More

Hyperion 8.1 Sensor Specifications

Sensor Qty & Type Function Details
8 exterior cameras Wide & tele vision Sony IMX728, 8.3MPix
4 exterior cameras Fisheye near vision Sony IMX623, 3.0MPix
6 radars Corner & side sensing Hella Short Range Radar
3 radars Front & rear sensing Continental Long Range Radar/Image
1 lidar Front redundant sensing Luminar
3 interior cameras Driver & occupant monitoring OVT 2311/2312, 2.3MPix
2 IMUs Vehicle dynamics detection Continental
1 GPS Vehicle location detection U-blox
1 development lidar Ground Truth data collection Hesai
1 development GNSS Ground Truth data collection Novatel
Learn More About Sensors

Offloads Sensor Record & Replay

  • Compact record & replay platform for DRIVE Hyperion 8.1 development platform sensors
  • Capture raw data from sensors along with output control data and encode for external storage
  • Replay encoded data from external storage and decode it for simulation
  • Each recorder has 2x Orin SoC & 2x Mellanox CX6-DX with dual 100G QSFP28 port
  • Each Orin connects to each of CX6-DX via 4x PCIE Gen4 (8 GB/s)
  • Dedicated Marvell Spruce to PTP sync SoCs & connected sensors
  • Supports DRIVE OS Linux for development only
Hyperion_8.1_Recorder_630x354px.png

Vehicle Setup Flow

Recorder I/O

  • 3x Harness for CAN/Flexray/A2B/GPIO
  • 8x 1 GbE-T1 H-MTD
  • 4x 10 GbE RJ45
  • 4x 100 GbE QSFP
  • 2x DisplayPort 1.4
  • 4x Host USB A, 1x Recovery USB C
  • Debug Micro-USB
  • Antenna

Smart Network Attached Storage (NAS)

  • Efficient and scalable storage solution with CPU offload support (Bluefield2- based)
  • 2GB/s lossless data recording storage bandwidth guaranteed Data encryption support
  • Data encryption support
  • Supports RDMA & NVMe-oF
  • 4x M.2 NVMe SSDs
    • Hot-pluggable
    • 4x PCIE Gen3 lanes
Hyperion_7.1_Zoomed_In_840x480px.png

Hyperion 7.1

DRIVE AGX Xavier™ Developer Kit (SKU 2000)

Includes two Xavier Systems-on-a-Chip (SoCs) for developing SAE Level 2/3 autonomous driving applications


DRIVE AGX Xavier™ Developer Kit (SKU 2000):

Component Description Details
Two Xavier SoCs 8-core “Carmel” CPUs based on ARM v8 ISA
Deep Learning Accelerators (DLA) 5 TOPS (FP16) | 10 TOPS (INT8)
NVIDIA Volta™-class integrated GPU 20 TOPS (INT8) | 1.3 TFLOPS (FP32)
Programmable Vision Accelerators (PVA) 1.6 TOPS
Image Signal Processor (ISP) 1.5Gigapixels/s
Video encoder Up to 1.2GPix/s
Video decoder Up to 1.8GPix/s
Memory Bandwidth (256-Bit LPDDR4) 136GB/s
DRIVE AGX System I/O Camera 90Gb/s over 16x GMSL(R) ports
Lidar/Radar ~50Gb/s over Ethernet
Vehicle IO 6 CAN interfaces
Included Accessories Camera 2 Megapixel RCCB Camera with 60-degree FOV
Vehicle harness Connects to vehicle IO ports
Other cables Connects the DRIVE AGX system to a host development computer
DRIVE SDK DRIVE OS
Preflashed Linux Ubuntu OS
QNX option also available
NVIDIA CUDA Libraries, including TensorRT (for access to deep learning hardware accelerator); NVMEDIA (for access to hardware accelerators for image processing and computer vision); compute and NVIDIA CUDA tools.
NVIDIA DriveWorks SDK Provides reference applications, tools, and a comprehensive library of modules that leverage the computing power of the DRIVE AGX platform.
DRIVE AV Provides modules for perception, mapping, and planning that leverage the DriveWorks SDK.
DRIVE IX Algorithms to visualize the vehicle’s surroundings, AI-based driver monitoring, and in-cabin assistance.

*TOPS measurements are per-chip


DRIVE AGX Pegasus™ Developer Kit (SKU 2200): Same as above with the addition

Component Description Details
Two “Turing” Discrete GPUs (DRIVE AGX Pegasus) Turing discrete GPU (TU104 SXM2) 130 TOPS (INT8) | 8.1 TFlops (FP32) connected to Xavier SoC over NVIDIA NVLink™ (20GB/s)
Discrete GPU Memory Bandwidth 384GB/s

1 DRIVE AGX Pegasus Developer Kit

320 TOPS of total compute power

2 Xavier SoCs

2 Turing GPUs

IO for sensors, actuation, and networking

DRIVE AGX Pegasus™ Developer Kit (SKU 2200)

Includes two Xavier SoCs and two NVIDIA Turing™ GPUs for developing robotaxi applications

7x external cameras (Sekonix/On Semi AR0231)

2x front cameras (120 FOV and 60 FOV) for Euro NCAP safety and basic L2 features

3x side (120 FOV) and back cameras (60 FOV) for advanced highway L2+ features

2x cross-traffic (120 FOV) cameras for urban development

1x in-cabin (55 FOV) camera for driver monitoring features (On Semi AR0144)

8x radars (Continental ARS430)

1x front centered radar for basic L2 features

4x corner radars for advanced highway L2+ features

1x rear radar for high-speed automatic lane changes

2x cross-traffic radars for urban development

1x IMU (Inertial Measurement Unit) for self-calibration and egomotion (Xsens)

Refer to the DRIVE Hyperion Developer Kit Quick Start Guide (PDF) for details.

Learn More

Camera

A mix of cameras for near and far vision

Learn More

Radar

Overlapping front, side, and corner visibility and redundancy

Learn More

IMU + GPS

Vehicle odometry sensing for improved precise localization and ground truth determination.

Learn More

FAQ

NVIDIA DRIVE Hyperion™ is an AV development platform and reference architecture for developing Level 2+ and Level 3 highway autonomous solutions. It consists of a complete sensor suite that’s tuned, optimized, and safety-certified, as well as a high-performance AI computing platform, NVIDIA DRIVE AGX™.

The NVIDIA DRIVE AGX™ Developer Kit provides the hardware, software, and sample applications needed for the development of production-level AVs. The DRIVE AGX system is built on production, auto-grade silicon and engineered with security in mind, featuring an open software framework.

The NVIDIA DRIVE Software Development Kit (SDK) is a collection of software packages used for developing autonomous vehicles. It comprises the foundational NVIDIA DRIVE® OS and DriveWorks SDK as well as advanced applications such as highly automated supervised driving (DRIVE AV) and AI cockpit (DRIVE IX).

The DRIVE AGX Xavier and Pegasus™ XT Developer Kits are available directly from NVIDIA and through authorized sublease partners. Software releases and materials are published in the NVIDIA DRIVE AGX SDK Developer Program. Your company or university must have current legal agreements on file. Please contact your Account Representative (or contact us) to ensure necessary agreements have been signed before requesting to join the NVIDIA DRIVE AGX SDK Developer Program. Users may only join with an approved corporate or university email address.

The NVIDIA DRIVE AGX Orin™ Developer Kit will be available directly from NVIDIA or through authorized distributors. Users must register their DRIVE AGX Orin Developer Kit to get access to the NVIDIA DRIVE AGX SDK Developer Program where software releases and materials will be published. Users may only join with an approved corporate or university email address.

If you’ve received your NVIDIA DRIVE AGX DevKit, congratulations! The Onboarding Guide provides an overview of all resources relevant to help you start your development.

The DRIVE AGX platforms are compatible with a number of sensors and peripherals from different vendors. A full list is available on the DRIVE Ecosystem Hardware and Software Components.

While both the Jetson AGX and DRIVE AGX kits use the same Orin SoC, DRIVE is built for automotive applications. The following table highlights the differences between the two platforms.

DRIVE AGX
Jetson AGX
Hardware
Segment
Automotive
Embedded & Robotics​
Power
200W​
15W | 30W | 50W​
Input Voltage Range
9V to 16V (Static), 7V to 32V (Transient)​
7V to 20V (High), 5V (Mid)​
DL Inference TOPS (INT8)
254 TOPS
200 TOPS​
Operating Temperature​
0 to 45C​
0 to 35C​
Safety MCU
Infineon Aurix TC397
No​
Networking
1GbE RJ45​
10GbE RJ45​
100 T1, 1000 T1, 10 GbE T1
​ CAN, LIN, Flexray, USS
1GbE RJ45​
10GbE RJ45​
M.2 Key E (WLAN / BT, PCIe, USB 2.0, UART, I2S & I2C)
Storage (default stuffing)
1x UFS (256 GB)​
64GB eMMC 5.1​
MicroSD​
M.2 Key M (NVMe)​
Video In​
16x GMSL-In ​
MIPI CSI-2​
Segment
Automotive
Embedded & Robotics
Operating System
Operating System
DRIVE OS Linux with Safety Extensions (Ubuntu) | QNX for Safety​

​Comprehensive safety & security services: Functional safety island integration, streamlined safety framework, platform security controller integration, secure boot & PKCS #11 support for crypto acceleration features​
Linux4Tegra (Ubuntu)​

Secureboot, trusted execution environment, disk and dram encryption, crypto acceleration, hardware-based security fuses​
Bootloader
Quickboot (optimized for real-time applications)​
UEFI
Computer Vision
NvMedia (highly optimized APIs to access compute engines and sensors)​
VPI (image-processing algorithms supported on multiple compute engines like CPU, GPU, PVA, VIC)
Multimedia
NvMedia ​ (up to 16 cameras for simultaneous processing with hardware acceleration)​
MM API / V4L2 API / Gstreamer​
Imaging
NvMedia SIPL (provides proprietary ISP algorithms with optimization)​
Librargus (Multimedia, ISP access)
SDK
DriveWorks: Sensor abstraction, image/point cloud processing, vehicle I/O, compute graph framework, DNN framework, recorder, calibration, egomotion​

​ NvMedia, NvStreams, CUDA, cuDNN, TensorRT​, Triton inference server, NVIDIA container runtime

​ Tools: Nsight Systems (performance analysis), Nsight Graphics (debug, profiler and export with Direct3D), Nsight Eclipse Edition (IDE), Nsight Compute (interactive kernel profiler for CUDA applications)​
Compute/Inferencing: CUDA, cuDNN, TensorRT​ Inference serving: Triton inference server​ Cloud native: NVIDIA container runtime​

​ Tools: Nsight Systems (performance analysis), Nsight Graphics (debug, profiler, and export with Direct3D), Nsight Eclipse Edition (IDE), Nsight Compute (interactive kernel profiler for CUDA applications)​
Production
Automotive Grade
Yes
No
ASIL Target*
ASIL-D (QNX)
-
AEC-Q100 qual
Yes
No
NVIDIA Design Support
Available
-
*Intended for production platform only

DRIVE AGX Orin
DRIVE AGX Xavier
SoC​
Orin (x1)
Xavier (x2)​
DL Inference TOPS (INT8)​
254 TOPS
60 TOPS
Memory Bandwidth​
Per Orin – 205GB/
Per Xavier – 136GB/s​
System RAM​
32GB LPDDR5 (3200MHz)​
32GB LPDDR4 (2133MHz)​
Networking
100MbE (x6)​
1GbE (x10)​
10GbE (x2)​
100MbE (x5)​
1GbE (x7)​
10GbE (x2)
Automotive Audio Bus (A2B)​
1
No
Wireless Connection​
Wi-Fi/Bluetooth​
No
Operating System​
DRIVE OS 6 Linux | QNX
DRIVE OS 5 Linux | QNX​
Middleware Framework
DriveWorks 5 (compute graph framework)​
DriveWorks 3 & 4​
Developer Tools​
CUDA 11.4​
TensorRT 8.x​
cuDNN 8.x​
CUDA 10.2​
TensorRT 6.4​
cuDNN 7.6​
Support
Yes
EOL

Feature
NVIDIA DRIVE AGX Orin
NVIDIA DRIVE Orin-X SoC
1
NVIDIA dGPU SXM2
N/A
System RAM
32GB LPDDR5
QSPI NOR Flash
64MB
eMMC
64GB
Security Key Storage
8MB
UFS
256GB
Camera
16x GMSL2
MCU
Aurix Safety MCU
Ethernet
10GbE
2
1GbE
10
100MbE
6
CAN
6
FlexRay to MCU
1
USB 2.0
USB3.2
2 Type-A
2 Type-C
Display Output
1 DisplayPort
GPIO
6
PCIe
PCIe x8 Gen4
eSATA
N/A
Automotive Audio Bus (A2B)
1
Debug and Development
JTAG, UART, USB

If you can’t find what you're looking for in the downloads, public documentation, or forum, please contact your NVIDIA representative or reach out directly.

Documentation

Training

The best way to learn is by doing. To help you get started, we’ve assembled a series of tutorials and instructional materials featuring the latest developer innovations.

See More

Resources

Peek under the hood to experience NVIDIA’s latest autonomous driving
innovations through DRIVE Labs and DRIVE Dispatch.

View Drive Videos