Jetson Benchmarks

Jetson is used to deploy a wide range of popular DNN models and ML frameworks to the edge with high performance inferencing, for tasks like real-time classification and object detection, pose estimation, semantic segmentation, and natural language processing (NLP). The tables below show inferencing benchmarks from the NVIDIA Jetson submissions to the MLPerf Inference Edge category.

Jetson Xavier NX and Jetson AGX Orin MLPerf v2.0 Results
Model Jetson Xavier NX (TensorRT) NVIDIA Orin (TensorRT)
Image Classification
ResNet-50
1243.146138.84
Object Detection
SSD-small
1782.536883.49
Object Detection
SSD-Large
36.69207.66
Speech to Text
RNN-T
260.521110.23
Natural Language
Processing
BERT-Large
61.40476.34


Jetson AGX Xavier and Jetson Xavier NX MLPerf v1.1 Results
Model Jetson Xavier NX (TensorRT) Jetson AGX Xavier 32GB (TensorRT)
Image Classification
ResNet-50
1245.102039.11
Object Detection
SSD-small
1786.912833.59
Object Detection
SSD-Large
36.9755.16
Speech to Text
RNN-T
259.67416.13
Natural Language
Processing
BERT-Large
61.3496.73


Jetson Pretrained Model Benchmarks

NVIDIA pretrained models from NGC start you off with highly accurate and optimized models and model architectures for various use cases. Pretrained models are production-ready. You can further customize these models by training with your own real or synthetic data, using the NVIDIA TAO (Train-Adapt-Optimize) workflow to quickly build an accurate and ready to deploy model.The table below shows inferencing benchmarks for some of our pretrained models running on Jetson modules.

Jetson Pretrained Model Benchmarks
Jetson Xavier NX Jetson AGX Xavier Jetson AGX Orin
PeopleNet124196536
Action Recognition 2D2454711577
Action Recognition 3D2132105
LPR Net70611904118
Dashcam Net4256711908
Bodypose Net105172559
ASR: Citrinet 10242734113
NLP: BERT-base5894287
TTS: Fastpitch-HifiGAN7942

  • These Benchmarks were run using Jetpack 5.0
  • Each Jetson module was run with maximum performance (MAX-N mode for Jetson AGX Xavier (32 GB) and Jetson AGX Orin, and 20W mode for Jetson Xavier NX)
  • Reproduce these results by downloading these models from our NGC catalog