Build Autonomous Vehicles (AVs) in
Virtual Environments
Accelerate AV development with simulation and synthetic data generation (SDG) pipelines powered by NVIDIA’s advanced models, tools, and libraries. These include:
NVIDIA Cosmos™ world foundation models NVIDIA Omniverse™ NuRec
NVIDIA Physical AI Data Factory Blueprint
Open-Source Simulation Tools and Technologies
Cosmos Curator and Dataset Search
Speed up data processing and generation for AV development using NVIDIA Cosmos Curator and Dataset Search (CDS). Curator filters and annotates large datasets while CDS quickly searches and retrieves data based on text, image, or video queries.
Cosmos Transfer
Discover faster and superior photorealistic world generation from text prompts and multiple spatial control inputs derived from real-world driving data or simulation.
Cosmos Predict
With improved speed, scalability, and flexibility, Cosmos Predict can be post-trained on AV data to generate single and multiview videos for accelerated development.
Omniverse NuRec
Reconstruct high-fidelity 3D worlds from real-world multi-sensor driving data. Then, render novel sensor views and trajectories for scalable replay, validation, and synthetic data generation.
Physical AI Open Datasets
Check out the largest open-source multimodal dataset for AV training, as well as Cosmos-generated videos and a starter pack of scenes for neural reconstruction.
Physical AI Data Factory Blueprint
Accelerate your AV development with a single workflow to curate, augment, and evaluate data at scale.
AlpaSim
Check out NVIDIA AlpaSim, an open-source AV simulation framework with realistic sensor modeling. It’s powered by Omniverse NuRec, configurable traffic and policy models, and scalable closed-loop testing for rapid policy iteration across millions of virtual miles.
Omniverse NuRec and Cosmos Transfer on CARLA
The leading open-source AV simulator is integrating NVIDIA NuRec neural reconstruction and Cosmos Transfer for scalable synthetic data generation in its latest release.
Autonomous Vehicle Simulation Learning Resources
Accelerate AV Simulation With Neural Reconstruction and World Models
In this tech blog, we highlight the latest NVIDIA APIs, Cosmos world foundation models, and NVIDIA NIM™ microservices to help you kickstart your data pipelines.
Simplify End-to-End AV Development With New NVIDIA Cosmos Transfer NIM
This blog showcases how you can create world models and generate synthetic data (SDG) to accelerate end-to-end AV training, as well as closed-loop training and in-vehicle inference.
Simulate and Scale Real-World AV Data With NuRec and Cosmos on CARLA
Deep dive into the latest open-source CARLA 0.9.16 release, and learn how to use AV simulation pipelines with NuRec and Cosmos Transfer. This session covers neural reconstruction and rendering workflows to bring real-world sensor data into simulation.
Enhance 3D Gaussian Reconstruction Quality for AV Simulation Using NuRec Fixer
Learn how to use NuRec Fixer to transform noisy 3D scenes into a crisp, artifact-free environment ready for AV simulation.