Researchers from the Toyota Technological Institute at Chicago (TTIC) and Carnegie Mellon University developed a deep learning-based method that locates a ground vehicle by using satellite imagery as the only prior knowledge of the environment.
Knowing the exact location of a vehicle is critical for autonomous cars, and currently GPS systems are being used which the researchers claim suffer from limited precision and are sensitive to multipath effects – such as in “urban canyons” formed by tall buildings.
Using TITAN X GPUs, CUDA, and Keras with the Theano deep learning framework, the researchers multi-view neural network learns to match ground-level images with their corresponding satellite view. For training, they used ground-level images from the KITTI dataset collected from a moving vehicle and paired them with the matching satellite image.
The next step for the work is to adapt their model so it is able to tolerate more severe appearance variations like seasonal changes.
Read more >
Related resources
- GTC session: Autonomous Passing Zone Detection on Rural Highways using Machine Learning Approaches (Spring 2023)
- GTC session: Using Synthetic Data Generation of Grid Infrastructure to Automate Drone Inspection (Spring 2023)
- GTC session: Sensor Cybersecurity for ADAS and In-Cabin Monitoring (Presented by onsemi) (Spring 2023)
- Webinar: Deep Learning for Intelligent Video Analytics
- Webinar: Using GPUs to Accelerate HD Mapping and Location-Based Services
- Webinar: Inception Workshop 101 - Getting Started with Vision AI
About the Authors
