Fingers Gesture Robot Control

With this project, control a Cobotta robot arm managed via Isaac SDK through the use of finger gestures coming from a USB camera and detected by a Resnet18 deep neural network. The output of the neural network is used to command pre-stored positions (in joint space) to the robotic arm. The software is connected to both a simulated environment running in Isaac Sim as well as the physical robot arm.

Authors

L Lattanzi

Share

Buy Jetson to Get Started

Bring your edge AI, computer vision or robotics ideas to life with a Jetson developer kit.

Explore Products