Explore and learn from Jetson projects created by us and our community. Explore and learn from Jetson resources created our by our community. These have been created for Jetson developer kits. Scroll down to see projects with code, videos and more.


Get Started with These Projects

Modify or try out one of these projects provided by NVIDIA and jumpstart your creativity, find tips and tricks in the Community Resources page and find answers in the Jetson forum.

JetBot

Jetson Nano

Open-source project for learning AI by building fun applications. It’s easy to set up and use, is compatible with many accessories and includes interactive tutorials showing you how to harness the power of AI to follow objects, avoid collisions and more. The kit includes the complete robot chassis, wheels, and controllers along with a battery and 8MP camera. Supports AI frameworks such as TensorFlow and PyTorch.

Hello AI World

Jetson Nano Jetson TX2 Jetson AGX Xavier

Start using Jetson and experiencing the power of AI. In a couple of hours you can have a set of deep learning inference demos up and running for realtime image classification and object detection using pretrained models on your Jetson Developer Kit with JetPack SDK and NVIDIA TensorRT. We'll focus on networks related to computer vision and includes the use of live cameras. You also code your own easy-to-follow recognition program in C++.

JetRacer

Jetson Nano

Autonomous AI racecar using NVIDIA Jetson Nano. With JetRacer, you will:

  • Go fast- Optimize for high framerates to move at high speeds
  • Have fun - Follow examples and program interactively from your browser
By building and experimenting with JetRacer you will create fast AI pipelines and push the boundaries of speed.

Real-time Human Pose Estimation

Jetson Nano

This project features multi-instance pose estimation accelerated by NVIDIA TensorRT. It is ideal for applications where low latency is necessary. It includes:

  • Training scripts to train on any keypoint task data in MSCOCO format
  • A collection of models that may be easily optimized with TensorRT using torch2trt
This project can be used easily for the task of human pose estimation, or extended for something new.

Community Gallery

Have a Jetson project to share? Post it on our forum for a chance to be featured here too. Every month, we’ll award one Jetson AGX Xavier Developer Kit to a project that’s a cut above the rest for its application, inventiveness and creativity.

Mommybot: Sleeping Assistant

J Hyuk, S Park
Jetson Nano

These days, more and more people are suffering from sleep deprivation. Mommybot is a system using Jetson Nano that helps manages a user's sleeping hours. Mommybot has 4 functions: (1) detect with a camera and register the time of different user events, (2) determine whether a user is asleep using TensorFlow, (3) with sklearn suggest optimal bedtime hours based on previous sleeping habit predictions, and (4) wake up the user with a preferred sleeping hour schedule.

DeepStream ❤️ OSC

Berk Özdemir
Jetson Nano

I'm using DeepStream SDK for Jetson Nano as an instrument to sonify and visualize detected objects in real time. My idea [...] was to turn public spaces into interactive-playable places where I can use people or vehicles as input to make performances or installations. Any software that accepts OSC as input can use the incoming data from DeepStream (location, size, type of each detected object, number of objects, frame number etc.) to control their parameters. It can be sound / visual programming frameworks, videogames / emulators, whatever you can imagine. It is also possible to translate OSC to HID or MIDI messages to extend the amount of softwares DeepStream can communicate with.

Project of the Month August 2020

DBSE Monitor: Drowsiness, Blindspot & Emotion Monitor

L Arevalo Oliver, V Altamirano Izquierdo, A Sanchez Gutierrez
Jetson Nano

Drowsiness, emotion and attention monitor for driving. Detects objects in blindspots via CV. Jetson Nano [takes] care of running through both of the Pytorch-powered Computer Vision applications using a plethora of libraries in order to perform certain tasks. The two webcams serve as the main sensors to carry out Computer Vision and Pytorch [identifies] faces and eyes for one application and objects for the other and [sends the] information through MQTT in order to emmit a sound or show an image in the display. [We] added geolocation and crash detection with SMS notifications [through] Twilio with an accelerometer.

Project of the Month July 2020

Self-navigatng robot for Search & Rescue (TBC)

By Maggie Xu
Jetson Nano

This rescue robot project combines SLAM and object detection and tracking. It uses Jetson Nano as the master board, STM32 for base control, and Arduino for robot arm. Using ROS, we designed a valid logic that integrates multiple functions. The robot can perform a simplified 'rescue mission' - autonomously find and pick up a blue block and then return it to origin. We hope the principles can be applied to systematically design specific tasks, such as rescue, logistics, and service robots.

Fever Control with Jetson Nano & Lepton3

By Walter “Myzhar” Lucetti
Jetson Nano

A useful application for the COVID19 era to control the human temperature and issue alarms in case of fever. This year, the year of COVID19, I decided to get that project out of the drawer and to adapt it to Nvidia Jetson Nano to realize an application to control human body temperature and issue alerts in case of fever.

Leela Chess Zero

By E Zhu, ezchess
Jetson Xavier NX Jetson AGX Xavier

As a chess player, I usually find myself using a chess engine for game analysis or opening preparation. Recently, I’ve noticed that chess engines have grown to be super powerful. Consider Leela Chess Zero (aka lc0), the open-source implementation of Google DeepMind’s AlphaZero. It has played so many amazing games that it’s hard for me to pinpoint the best one! This video demonstrates how to load a frontend UCI engine in ChessBase and connect it to a Leela Chess Zero engine running backend in a Nvidia Jetson device (which can be either Jetson Xavier NX or Jetson AGX Xavier).

RB-0: Jetson Nano Rover

By plankton
Jetson Nano

RB-0 is a hobby sized rover that uses the same suspension method as NASA's newer differential-bar rovers. It uses a Jetson Nano, a camera, 15 servos, a Circuit Playground Express, and Wi-Fi for lots of fun with manuevering and running AI. It can climb small obstacles, move its camera in different directions, and steer all 6 wheels. I wanted to make it open source so anyone can have fun and learn from it!

DC-Gan Guitar Effector

By Nobuhiro Kuroiwa
Jetson Nano

Jetson Nano DC-GAN Guitar Effector is a Python app that modifies and adds effects to your electric guitar's raw sound input in real time. The Jetson module captures the instrument's sound through a Roland DUO-CAPTURE mk2 audio interface and outputs the resulting audio of the DC-GAN inference. The one-dimension pix2pix inference model is optimized and run on TensorRT at FP16 precision.

Project of the month June 2020

AI Thermometer

By Tomasz Lewicki
Jetson Nano

AI device for mass fever screening. I combine Thermal and Visible Spectrum cameras in order to detect people and measure their skin temperature in a contactless manner [...], automatically. You can test multiple people at the time, [...] on-the-fly, without interrupting the flow. [The] Raspberry Pi Camera Module v2 [...] works out-of-the-box with NVIDIA Jetson Nano. In my first approach, I used a SingleShot MultiBox Detector trained on COCO dataset, [which] detects objects across 91 classes from COCO [and] runs on Jetson Nano's embedded GPU at 9FPS.

Jetson Nano

A smart, fast and metrically accurate GPU-accelerated 3D scanner with Jetson Nano and Intel depth sensor for instant 3D reconstruction. This system design makes on-the-go 3D scanning modules without external computing power affordable by any creator/maker around the world, giving users HD 3D models of scanned objects or environments instantly. Using RGBD stereo mapping, render 3D models of people, objects and environments with JetScan.

Vision alerting system with IoT Edge, Azure Custom Vision and Jetson Nano

By Henk Boelman
Jetson Nano

[...] Create your own object alerting system running on an edge device. For this we will use an NVIDIA Jetson Nano, the Azure Custom Vision service and Azure IoT Edge. The goal is to process the camera frames locally on the Jetson Nano and only send a message to the cloud when the detected object hits a certain confidence threshold.

Safe Meeting

By Nick Bild
Jetson Nano

Safe Meeting keeps an eye on you during your video conferences, and if it sees your underwear, the video is immediately muted. A camera is connected to an NVIDIA Jetson Nano. This camera is positioned immediately next to a webcam that is used for video conferences, such that it captures the same region.

Jetson Nano

[Due to] the Covid-19 pandemic, people cannot drink outside [and] are looking for alternatives such as drinking with friends through videocall. Our team thought that enjoying time wisely with fun interaction is what people need. We focus on the problem that drinking through videocall can fill visual and auditory elements, but not physical interaction. Also, since you are drinking alone, it is important to know your drinking status. The model is made from the TensorFlor ObjectDetector API. Once [...] built, TensorRT can optimize it for real-time execution [...] on Jetson Nano.

The Tale of the Bee-Saving Christmas Tree

By Frederic Tausch, apic.ai
Jetson Nano

We used [64 NVIDIA Jetson Nano Devkits] to build the Jetson tree with a total of 8.192 CUDA cores and 256 CPU cores. We'll use its power to analyze bee videos [and] investigate [...] the perishing of insects. At apic.ai, we believe technology can help us create a better understanding of nature. [...] We [analyse] bee behavior like motion patterns and pollen intake. Our monitoring system visually detects bees as they enter and leave their hives. Through their level of activity, mortality and food abundance we gain insights into the well-being of the insects and the plant diversity in the environment [...], thus [enabling] us to evaluate regional living conditions for insects, detect problems and propose measures to improve the situation.

youfork

By Yukata Kondo
Jetson AGX Xavier

youfork: a Fully ROS 2 Homemade Mobile Manipulator running on Jetson AGX Xavier. youfork is a mobile manipulator for home tidy-up. Perform home tidy-up by teleoperation. All components are driven by ROS 2 Eloquent + Ubuntu 18.04 on Jetson Xavier.

Platooning Demonstrator

By Shankar Kumar
Jetson Nano

Originally envisioned as a demonstrator for the Bosch AI CON 2019, the platooning system consists of two cars, a leading car and a following car. The leading car can be driven manually using a PS4 controller and the following car will autonomously follow the leading car. The system currently is also capable of Object Tracking, Velocity Estimation by Optical Flow Visual Odometry and Monocular Depth Estimation.

Project of the Month May 2020

Qrio: A Bot That Plays Videos for My Toddler

By Agustinus Nalwan
Jetson Nano

[Use] an object detection AI model, a game engine, an Amazon Polly and a Selenium automation framework running on an NVIDIA Jetson Nano to build Qrio, a bot which can speak, recognise a toy and play a relevant video on YouTube.

Narwhal-AI: Ultrasonic Classifier

By Patrick Whetman
Jetson Nano

Listen, record and classify the sounds coming from a natural environment. Microphones capture audio data which is then processed using machine learning to identify the animal species, whether it be bird, bat, rodent, whale, dolphin or anything that makes a distinct noise. The key advantages over other existing technology is that: the audio data is filtered at source saving both disc space and human intervention. Previously recordings could easily generate many hours of footage per day, consuming up to 5 Gb per hour of disc space and adversely affecting the zoologist's golfing handicap and social life.

Deep Reinforcement Learning with JetBot

By Masato Kawamura
Jetson Nano

AI RC Car Agent using deep reinforcement learning on Jetson Nano. This software is capable of self-learning for your AI RC car in a matter of minutes. In the demo video, the Jetbot does deep reinforcement learning in the real world using a SAC (soft actor critic). The DRL process runs on the Jetson Nano. This project refers to this great post by Antonin Raffin.

Project of the Month April 2020

Smart Social Distancing

By Galliot
Jetson Nano

As a response to the COVID-19 pandemic, Neuralet released an open-source application to help people practice physical distancing rules in […] retail spaces, construction sites, factories, healthcare facilities, etc. […] Our approach uses […] edge AI devices such as Jetson Nano to track people in different environments and measure adherence to social distancing guidelines, and can give notifications each time social distancing rules are violated.

DeepClean

By Nick Bild
Jetson AGX Xavier

Deep Clean watches a room and flags all surfaces as they are touched for special attention on the next cleaning to prevent disease spread. […] A stereo camera detects the depth (z-coordinate) of an object of interest (e.g. a hand) in the video frame. OpenPose is used to detect hand location (x, y-coordinates). When a hand is at the same position and depth as another object in view (i.e. touching), that location is tracked.

NValhalla - a DeepStream demo in Vala

By Michael de Gans
Jetson AGX Xavier

NValhalla performs live redactions on multiple video streams. It is written in Genie, a Vala dialect. Vala is recommended by the gstreamer team for those who want syntactic sugar on top of their GObject C.

NVIDIA / Hackster AI at the Edge Challenge 1st Place

Reading Eye For The Blind

By Andrew Bernas
Jetson Nano

Allows the reading-impaired to hear both printed and handwritten text by converting recognized sentences into synthesized speech. […] Place some text under the camera, toggle the power switch […], and click the start button. Using the IAM Database, with more than 9,000 pre-labeled text lines from 500 different writers, we trained a handwritten text recognition.

NVIDIA / Hackster AI at the Edge Challenge 1st Place
Jetson Nano

[With] MixPose, we are building a streaming platform to empower fitness professionals, yoga instructors and dance teachers through power of AI. [Instructors] can choose anywhere they feel comfortable, [and] users can watch the stream in the comfort of their own TV.

NVIDIA / Hackster AI at the Edge Challenge 1st Place

Nindamani the Weed Removal Robot

By auto roboculture
Jetson Nano

Nindamani, the AI based mechanically weed removal robot, which autonomously detects and segment the weeds from crop using artificial intelligence. The whole robot modules natively build on ROS2. Nindamani can be used in any early stage of crops for autonomous weeding.

NVIDIA / Hackster AI at the Edge Challenge 2nd Place

Sim-to-Real: Virtual Guidance for Robot Navigation

By Kai-Chen Lin, Evan Luo, Chao-Hsien Ting, Hao-Kang Liu, Yu-Wen Chen
Jetson Nano Jetson AGX Xavier

Easy-to-implement and low-cost modular framework for complex navigation tasks. Visual-based autonomous navigation systems typically require visual perception, localization, navigation, and obstacle avoidance. We propose [a] single RGB camera [and] techniques such as semantic segmentation with deep neural networks (DNNs), simultaneous localization and mapping (SLAM), path planning algorithms, as well as deep reinforcement learning (DRL) to implement the four functionalities mentioned above.

NVIDIA / Hackster AI at the Edge Challenge 2nd Place

Bandwidth Reduction with Anomaly Detection

By Smells like ML
Jetson Nano

We experiment with visual anomaly detection to develop techniques for reducing bandwidth consumption in streaming IoT applications. There seems to be no avoiding the tradeoff of spending compute to save bandwidth but we also want to spend it intelligently so we want to take advantage of the context. [With] visual anomaly detection, we stream ONLY infrequent anomalous images [and] explore unsupervised methods of reducing bandwidth by learning the context of a scene in order to filter redundant content from streaming video.

NVIDIA / Hackster AI at the Edge Challenge 2nd Place

AIoT - Artificial Intelligence on Thoughts

By Authors
Jetson Nano

[Learn] how to read in and signal process brainwaves, build and train an Autoencoder to compress the EEG data to a latent representation, [use] the k-means machine learning algorithm to classify the data to determine brain-state, and [use] the information to control physical hardware! And along the way pick up tips on creating GUIs and real-time graphics in Python!

NVIDIA / Hackster AI at the Edge Challenge 3rd Place

Autonomous Tank

By Andrei Ciobanu
Jetson Nano

Tracked vehicle made with Lego Technic parts and motors, enhanced with LiDAR and controlled by a Jetson Nano board running the latest Isaac SDK. Issue voice commands and get the robot to move autonomously. Create missions: navigate [and] set where the tank should go. If [the camera] detects the target object, it will get closer and shoot it with... the camera. It'll just take a picture, no real weapons :)

NVIDIA / Hackster AI at the Edge Challenge 3rd Place

Deep Eye - DeepStream Based Video Analytics

By Attila Tőkés
Jetson Nano

Hardware platform combined with DeepLib: an easy to use but powerful Python library, and a Web IDE [for rapid prototyping of video analytics projects] with the Jetson Nano. It supports up to 2 MIPI CSI cameras, which are mounted on a rotating platform. The project consists of 3 main components:

  • Hardware platform [using] the Jetson Nano.
  • DeepLib: an easy to use Python Library, which allows creating DeepStream-based video processing pipelines in an easy way.
  • Web IDE that allows the easy creation of DeepStream-based applications.

NVIDIA / Hackster AI at the Edge Challenge 3rd Place
Jetson Nano

Clean Water AI is an IoT device powered by NVIDIA Jetson that classifies and detects dangerous bacteria and harmful particles. The system can run in real time, [with] cities [installing] IoT devices across different water sources and […] monitoring water quality as well as contamination continuously. We utilize Tensorflow Object Detection Method to detect the contaminants and WebRTC to let users check water sources the same way they check security cameras.

ActionAI: Custom Tracking & MultiPerson Activity Recognition

By Smells like ML
Jetson Nano

We introduce an IVA pipeline to enable the development and prototyping of AI social applications. ActionAI is a Python library for training machine learning models to classify human action. It is a generalization of our yoga smart personal trainer, which is included in this repo as an example. This makes an ideal prototyping and data gathering platform for Human Activity Recognition, Human Object Interaction, and Scene Understanding tasks with ActionAI, a Jetson Nano, a USB Camera and the PS3 controller's rich input interface.

WebRTC Native Client Momo

By @voluntas (Ryosuke Nakai)
Jetson Nano

Momo is a Native Client that can distribute video and audio via WebRTC from browser-less devices, such as wearable devices or Raspberry Pi. Using Jetson Nano's hardware encoder, it is possible to deliver 30fps video at 4K to a browser with a delay of less than 1 second. Momo is released on GitHub as open source under Apache License 2.0, and anyone can use it freely under the license. You must try 4K / 30fps video distribution on WebRTC at Momo!

Project of the Month January 2020
Jetson TX2

ROS node for real-time FCNN-based depth reconstruction. The platforms are NVIDIA Jetson TX2 and x86_64 PC with GNU/Linux (aarch64 should work as well, but not tested).

Shoot Your Shot!

By Smells like ML
Jetson Nano

This computer vision booth analyzes users throwing darts from multiple cameras, scoring each dart before logging data to the cloud. To analyze the player's form, we use pose estimation to track body parts through a throwing session. This demo uses two cameras to view the thrower and view the dartboard and track poses and dart placement.

Tipper

By Nick Bild
Jetson AGX Xavier

Tipper predicts if a pitch will be in or out of the strike zone in real time. The batter will see a green or red light illuminate in their peripheral vision if the pitch will be in or out of the strike zone, respectively. [...] A convolutional neural network running on an NVIDIA Jetson AGX Xavier rapidly classifies these images against a model built during the training phase of the project. If the images are classified as in the strike zone, a green LED on a pair of glasses (in the wearer's peripheral vision) is lit. Conversely, if the ball is predicted to be out of the strike zone, a red LED is lit.

Project of the Month February 2020

Point-Voxel CNN for Efficient 3D Deep Learning

By Zhijian Liu, Haotian Tang, Yujun Lin, Song Han. MIT Han Lab
Jetson Nano Jetson AGX Xavier

In our NeurIPS’19 paper, we propose Point-Voxel CNN (PVCNN), an efficient 3D deep learning method for various 3D vision applications. Here we show the 3D object segmentation demo which runs at 20 FPS on Jetson Nano. Note that the most efficient previous model, PointNet, runs at only 8 FPS. We also show the performance of 3D indoor scene segmentation with our PVCNN and PointNet on Jetson AGX Xavier. Remarkably, our network takes just 2.7 seconds to process more than one million points, while the PointNet takes more than 4.1 seconds and achieves around 9% worse mIoU comparing with our method.

Robaka 2: Self-Driving Hoverboad with ROS

By Alex Makarov, Mechanical Ants
Jetson Nano

My first mobile robot, Robaka v1 was a nice experience, but the platform was too weak to carry the Jetson Nano. The next milestone was building a robot ready to carry the real payload and drive outdoors. I stumbled upon the repo of Niklas Fauth’s repo, [who] summarized the reverse-engineering efforts on hoverboards, shared the opensource firmware, [and] instructions on reprogramming the controller. Another project, Bipropellant, extends his firmware, enabling hoverboard control via serial protocol. I built the platform around [this] and added a ROS-enabled controller for the motors.

Project of the Month December 2019

Jetbot Gazebo Football Soccer Simulation

By Dohyeong Kim
Jetson Nano

Gazebo reduces the inconvenience of having to test a robot in a real environment by controlling in a simulated environment. Deep Learning makes robots play games [more] like a human. My goal with this project [to] combine these two benefits so that the robot [can] play soccer without human support. […] Two Jetbots are placed in the field, one tries to make a goal and [the other one] tries to defend the goal. In cases of multiple agents as [such as this], [it can use] self-play reinforcement learning tools.

Deepstream SDK + Azure IoT Edge on Jetson Nano

By Microsoft Developer
Jetson Nano

[Do] realtime video analytics with Deepstream SDK on a Jetson Nano connected to Azure via Azure IoT Edge. Deepstream is a highly-optimized video processing pipeline capable of running deep neural networks. It's a must-have tool [for] complex video analytics requirements, whether realtime or with cascading AI models. IoT Edge gives you the possibility to run this pipeline next to your cameras, where the video data is being generated, thus lowering your bandwitch costs and enabling scenarios with poor internet connectivity or privacy concerns. [Transform] cameras into sensors to know when there is an available parking spot, a missing product on a retail store shelf, an anomaly on a solar panel, a worker approaching a hazardous zone, etc.

Real-time Pupil Detection with DeepLabCut

By Christoph Schmidt-Hieber
Jetson Nano

Realtime pupil and eyelid detection with DeepLabCut running on a Jetson Nano. In neuroscience research, this provides a realtime readout of animal and human cognitive states, as pupil size is an excellent indicator of attention, arousal, locomotion, and decision-making processes. As one example application, you could use this setup to trigger a reward when the experimentee is alert.

This was made with the support and funding of the ERC, the Institut Pasteur, and the DeepLabCut developer community.

Multimedia Sharing Tool with Jetson Nano

By Werther Berselli
Jetson Nano

Share video, screen, camera and audio with an RTSP stream through LAN or WAN supporting CUDA computations in a high-performance embedded environment (NVIDIA Jetson Nano), applying real-time AI techiques [such as] intrusion detection with bounding boxes, localization and frame manipulation.

BatBot: An Experimental AI-Vision Robot

By Lee Hounshell
Jetson Nano

[…] AI research robot created from commodity parts. Lower half is an Elegoo Robot Car v3.0. The upper half is a Jetson Nano. An Android app controls it with spoken English translated and sent over Bluetooth. The robot has a camera, an ultrasonic distance sensor, and 40 pin GPIO available for expansion. […] High-level spoken commands like 'WHAT ARE YOU LOOKING AT?' instruct the robot photograph and identify objects. The command 'GO FIND SOME-OBJECT' instructs the robot to locate, identify and photograph an object. Low-level spoken commands like 'WHAT IS YOUR IP-ADDRESS?' […] or 'LOOK TO THE LEFT' will obtain information and/or control the robot directly. Teach BatBot to identify new objects by using voice commands.

Smart Pothole Detector

By Jordan M. Bennet
Jetson Nano

A Convolutional Artificial Neural Network based pothole detector, for Jetson Nano or Google Colab, for the purpose of being mounted in a vehicle for live pothole detection and warning. The detection model is based on this repo by Suman Kumar Jha.

FastDepth: Fast Monocular Depth Estimation on Embedded Systems

By Diana Wofk, Fangchang Ma, Tien-Ju Yang, Sertac Karaman, Vivienne Sze
Jetson TX2

[…] There has been a significant and growing interest in depth estimation from a single RGB image, due to the relatively low cost and size of monocular cameras. [We] explore learning-based monocular depth estimation, targeting real-time inference on embedded systems. We propose an efficient and lightweight encoder-decoder network architecture and apply network pruning to further reduce computational complexity and latency. We deploy our proposed network, FastDepth, on the Jetson TX2 platform, where it runs at 178fps on the GPU and at 27fps on the CPU, with active power consumption under 10W. FastDepth achieves close to state-of-the-art accuracy on the NYU Depth v2 dataset.

SINTEF Self-Driving Truck with Induction Charger

By Jon Eivind Stranden
Jetson TX2

This small-scale self-driving truck using Jetson TX2 and ROS Kinetic was built to demonstrate the principle of a wireless inductive charging system developed by Norwegian research institute SINTEF for road use. Navigate using one of two modes; SLAM/Pure Pursuit path tracking and supervised deep learning based on NVIDIA DAVE-2.

Autonomous drone using ORBSLAM2 on the Jetson Nano

By Autonomous Drones Lab, Tel Aviv University
Jetson Nano

Run ORBSLAM2 and implement close-loop position control in real time on Jetson Nano using recorded rosbags (e.g., EUROC) or live footage from a Bebop2 Drone. Tested with [realtime] monocular camera using OrbSLAM2 and Bebop2. In the Autonomous Drones Lab at Tel Aviv University, we research, develop and implement solutions for autonomous navigation in GPS-denied environments. [To] validate our solution, we work mainly on prototype drones to achieve a quick integration between hardware, software and the algorithms.

GPU-enabled Kubernetes Cluster for Machine Learning with Jetson Nano

By Kacper Łęgowski, Witold Bołt. JIT Team
Jetson Nano

Jetson Nano is a fully-featured GPU compatible with NVIDIA CUDA libraries. CUDA is the de-facto standard for modern machine learning computation. Having […] a cheap, CUDA-equipped device, we thought let’s build [a] machine learning cluster. If you think “cluster”, you typically think “Kubernetes”, […] commonly used to manage distributed applications running on […] hundreds of thousands of machines. […] Ours is composed of four; [though] it is applicable to any number of Jetson Nanos.

Project of the Month November 2019

Temporal Shift Module for Efficient Video Understanding

By Ji Lin, Chuang Gan, Song Han. MIT Han Lab
Jetson Nano Jetson TX2

TSM is an efficient and light-weight operator for video recognition [on edge devices]. [...] Conventional methods using 3D convolution for temporal modeling are computationally expensive, making it difficult to be deployed on embedded devices which have a tight power constraint. In this ICCV’19 paper, we propose Temporal Shift Module (TSM) that can achieve the performance of 3D CNN but maintain 2D CNN’s complexity by shifting the channels along the temporal dimension. TSM enables real-time low-latency online video recognition and video object detection. [...] On NVIDIA Jetson Nano, it achieves a low latency of 13ms (76fps) for online video recognition.

Rock-Paper-Scissors

By Alan Mok
Jetson Nano

This is an implementation for Rock-Paper-Scissors game with a machine. The Jetson Nano developer kit is used for AI recognition of hand gestures.

Jetson-FFmpeg

By Jiang Wei
Jetson Nano

With Jetson-FFMpeg, use FFmpeg on Jetson Nano via the L4T Multimedia API, supporting hardware-accelerated encoding of H.264 and HEVC. FFMpeg is a highly portable multimedia framework, able to decode, encode, transcode, mux, demux, stream, filter and play pretty much any format. It supports the most obscure ancient formats up to the cutting edge.

Jetson Stats

By Raffaello Bonghi
Jetson Nano Jetson TX2 Jetson AGX Xavier

Jetson-Stats is a package for monitoring and controlling your NVIDIA Jetson [Nano, Xavier, TX2i, TX2, TX1] embedded board. When you install jetson-stats, the following are included:

  • jtop
  • jetson-release
  • jetson_variables

Homesecurity

By Jaiyam Sharma
Jetson Nano Jetson TX2

This software was written for monitoring the security of my home using single or multiple Picameras. The cameras perform motion detection and record video. The video is sent in an email. After recording video, an object detection model running on Jetson Nano checks if a person is present in the video. A set of 4 raspi zeros stream video over Wi-Fi to a Jetson TX2, which combines inputs from all sources, performs object detection and displays the results on a monitor.

Tiny YOLO v2 Inference with NVIDIA TensorRT

By Tsutomu Furuse
Jetson Nano

This application downloads a tiny YOLO v2 model from Open Neural Network eXchange (ONNX) Model Zoo, converts it to an NVIDIA TensorRT plan and then starts the object detection for camera captured image.

Open DataCam

By moovel lab
Jetson Nano Jetson TX2 Jetson AGX Xavier

Quantify the world—monitor urban landscapes with this offline lightweight DIY solution. The simple setup allows you to become an urban data miner. Install on an NVIDIA Jetson board + Logitech webcam and count cars, pedestrians, and motorbikes from your livestream, running yolo and a tracking software we built. Access via smart devices, define areas to track, count and export data once you're finished. You can use this system for surveying without saving video data—not intruding data privacy of counted objects. Where data goes and what happens during the counting algo is transparent.

JetsonSky: Electronically Assisted Astronomy

By Alain Paillou
Jetson Nano

With Electronically Assisted Astronomy, the camera replaces your eye. With a telescope, simply observe the deep sky on a screen or even record videos of your observations, using AI to enhance your images. I wanted to make a fully autonomous system I could control from my computer at home using a VNC client, instead of being outside during very cold nights.

Hey Jetson

By Brice Walker
Jetson Nano Jetson TX2 Jetson AGX Xavier

Build a scalable attention-based speech recognition platform in Keras/Tensorflow for inference on the NVIDIA Jetson Platform for AI at the Edge. This real-world application of automatic speech recognition was inspired by my previous career in mental health. This project begins a journey towards building a platform for real-time therapeutic intervention inference and feedback. The ultimate intent was to build a tool to give therapists real-time feedback on the efficacy of their interventions, but on-device speech recognition has many applications in mobile, robotics, or other areas where cloud-based deep learning is not desirable.

Transfer Learning with JetBot & Traffic Cones

By Dmitri Villevald
Jetson Nano

[When] driving [around] construction areas, I [think] how challenging it would be for self driving cars to navigate [around] traffic cones. It turns out it's not so difficult with NVIDIA's JetBot-with only a couple hundred images, you can train a state-of-the-art deep learning model to teach your robot how to [navigate] a maze of toy traffic cones using only an onboard camera and no other sensors.

MuSHR: Multi-agent System for non-Holonomic Racing

By MuSHR Racecar
Jetson Nano

The Unversity of Washington's Personal Robotics Lab has recently open-sourced the MuSHR Racecar Project. A robotic racecar equipped with lidar, a D435i Realsense Camera, and an NVIDIA Jetson Nano. The car can be used for machine learning, vision, autonomous driving, and robotics education. Build instructions and tutorials can all be found on the MuSHR website!

Project of the Month October 2019

ShAIdes

By Nick Bild
Jetson Nano

My AI is so bright, I gotta wear shades. Effect change in your surroundings by wearing these AI-enabled glasses. ShAIdes is a transparent UI for the real world. A camera is attached to the frames of a pair of glasses, capturing what the wearer sees. It feeds realtime images to an NVIDIA Jetson Nano, which runs two separate image classification CNN models, one to detect objects, and another to detect gestures made by the wearer. When combinations of known objects and gestures are detected, actions are fired that manipulate the wearer’s environment.

OCR Tesseract Docker App on BalenaCloud

By Richard Torzynski
Jetson Nano

Upload images using Flask — a lightweight development-purposes server framework — preprocess and reduce image noise using OpenCV, and perform OCR using Python-tesseract. Originally deployed on a Docker container on AWS, this version is deployed using BalenaCloud to a Jetson Nano.

PANTHER: Powerful Autonomous eNTity High-End Robot

By Raffaello Bonghi
Jetson TX2

Using its two tracks, ZED stereo camera and the NVIDIA Jetson TX2, this robot explores the outdoors and interacts with its surroundings. Weighing 9kg (20lbs), with 7cm (2.7in) of ground clearance, and a track system composed of three different dampers to absorb vibrations when drifting on grass, P.A.N.T.H.E.R. can climb little rocks and bumps. P.A.N.T.H.E.R. is built with plexiglass, aluminium, plastic, and other materials, is integrated with ROS, and all code is available on GitHub.

OpenALPR License Plate Recognition

By Alan Newcomer
Jetson Nano

The parking garage [of my apartment] upgraded to a license plate recognition system. […] I expected [it] to fail and hinder me from entering or exiting […]. I was wrong and [it] has worked with 100% success. Even [without] having a license plate on my front bumper or following good car hygiene. Being a flatfooder, […] [built] my own License Plate Detector using OpenALPR and Jetson Nano.

Project of the Month September 2019

Recognizing Sign Language with Jetson Nano

By Dennis Faucher
Jetson Nano

The Jetson Nano caches this model into memory and uses its 128 core GPU to recognize live images at up to 60fps. That high fps live recognition is what sets the Nano apart from other IoT devices. I have been hearing recommendations toward "Train in the cloud, deploy at the edge" and this seemed like a good reason to test that concept. Mission accomplished.

IntelligentEdgeHOL

By Paul DeCarlo
Jetson Nano

The IntelligentEdgeHOL walks through the process of deploying an IoT Edge module to an NVIDIA Jetson Nano device to allow for detection of objects in YouTube videos, RTSP streams, or an attached web cam.

Detecting LEGO Minifigures with Jetson Nano

By Goran Vuksic
Jetson Nano

For this project I had to build a rotating platform and I decided to use LEGO Boost for it. My idea was to place LEGO Minifigures on top of the platform, fix the Raspberry Pi camera in front of it and rotate the platform at different speeds to test how Jetson Nano recognition works.

ROS NavBot

By Imesh Sachinda
Jetson Nano

Navbot is an indoor mapping and navigation robot built with ROS and Jetson Nano. It maps its environment in 2D with Gmapping and 3D with RTAB-Map with Microsoft Kinect v1.

Fruit Classification with Jetson Nano

By Abdullah Sadiq
Jetson Nano

Classification of fruits on the Nvidia Jetson Nano using Tensorflow. Tested on Jetson Nano but should work on other platforms as well. [...] For classifying anything we need a proper dataset. [...] I made my own dataset, a small one with 6 classes and a total of 600 images (100 for each class). I used the camera-capture utility in the Hello AI World example to capture images.

Donkey Car 3.0 with Jetson Nano

By Rahul Ravikumar
Jetson Nano

Having read some amazing books on machine learning, I had been looking for opportunities to apply ML from first principles in the real world. That was what got me curious about the wonderful Donkey® Car project. The project is essentially a how-to guide to building your own RC car which can drive itself around a track using classical control theory, computer vision or in my case machine learning. I wanted to experiment with more sophisticated models. As I was constrained by the CPU on the Asus Tinkerboard S, I decided to level-up using the NVIDIA Jetson Nano.

OpenPose

By karaage
Jetson Nano

Run real-time, multi-person pose estimation on Jetson Nano using a Raspberry Pi camera to detect human skeletons, just like Kinect does. With this setup environment, obtain about 7–8fps performance.

Jetson Nano Detection and Tracking

By Steve Macenski
Jetson Nano

This repository is my set of install tools to get [Jetson] Nano up and running with a convincing and scalable demo for robot-centric uses. In particular, using detection and semantic segmentation models capable at running in real-time on a robot for $100. By convincing, I mean not using NVIDIA's 2-day startup model you just compile and have magically working without having control. This gives you full control of which model to run and when.

Fast Object Detector for the Jetson Nano

By Carroll Vance
Jetson Nano

MobileDetectNet is an object detector which uses MobileNet feature extractor to predict bounding boxes. It was designed to be computationally efficient for deployment on embedded systems and easy to train with limited data. It was inspired by the simple yet effective design of DetectNet and enhanced with the anchor system from Faster R-CNN.

Using an FP16 TF-TRT graph the model runs at ~55 FPS on the Jetson Nano in mode 1 (5W).

OpenCV with CUDA for Jetson Nano

By Michael de Gans
Jetson Nano

A small script to build OpenCV 4.1.0 on a barebones system. The script installs build dependencies, clones a requested version of OpenCV, builds it from source, tests it, and installs it.

Jetson Nano Insulator Detection: TensorFlow & TensorRT

By ICC TOBOROBOT
Jetson Nano

Detection insulator with ssd_mobilenet_v1 custom trained network. Testing with tensorflow frozen graph gives about 0.07sec per one image (~15FPS). I have recieved better result (about 20fps) with TensorRT library.

Interface Touch Sensor, Accelerometer, IV Sensor, OLED

By Elaine Wu, Seeed Studio
Jetson Nano

Grove is an open source, modulated, and ready-to-use toolset. It takes a building block approach to assembling electronics, […] [simplifying] the learning process. If you want to use Grove sensors with Jetson Nano, the best way is to grab the grove.py Python library and get your sensors up in running in minutes! Currently there are more than 20 Grove modules supported on Jetson Nano […].

Project of the Month August 2019

Smart Doorbell Camera

By Adam Geitgey
Jetson Nano

We’ll create a simple version of a doorbell camera that tracks everyone that walks up to the front door of your house. With face recognition, it will instantly know whether the person at your door has ever visited you before—even if they were dressed differently. And if they have visited, it can tell you exactly when and how often.

Open Source Autocar (1/10th scale) with Jetson Nano

By Joseph Bastulli
Jetson Nano

With this open-source autocar powered by Jetson Nano, you can seamlessly toggle between your remote-controlled manual input and your AI-powered autopilot mode!

Donkey Car with Jetson Nano

By Fei Cheung
Jetson Nano

Open source hardware and software platform to build a small scale self driving car. Donkeycar is minimalist and modular self driving library for Python. It is developed for hobbyists and students with a focus on allowing fast experimentation and easy community contributions.


Jetson Projects Forum

Have a Jetson project to share? Post it on our forum for a chance to be featured here too. Every month, we’ll award one Jetson AGX Xavier Developer Kit to a project that’s a cut above the rest for its application, inventiveness and creativity.

Active discussions right now: