Autonomous Vehicle 
(AV) Simulation

Create rich 3D worlds for training, testing, and validation.

Build Autonomous Vehicles in Virtual Environments

Accelerate AV development with simulation and synthetic data generation (SDG) pipelines powered by NVIDIA’s advanced models, tools, and libraries. These include:

  • NVIDIA Cosmos World Foundation Models for post-training and data generation

  • NVIDIA NuRec for neural reconstruction

  • Synthetic datasets to kickstart AV workflows

Virtual environment simulation

Open-Source Autonomous Vehicle Simulation Tools and Technologies

NVIDIA Cosmos Transfer

Generate physics-aware video world states from text prompts and multiple spatial control inputs derived from real-world driving data or simulation.

NVIDIA NuRec and Cosmos Transfer on CARLA

The leading open-source AV simulator is integrating NVIDIA NuRec neural reconstruction and Cosmos Transfer for scalable synthetic data generation in its latest release.

NVIDIA Cosmos Predict-2

With improved speed, scalability, and flexibility, Cosmos Predict-2 can be post-trained on AV data to generate single and multiview videos to accelerate development.

NVIDIA Physical AI Dataset

Check out open-source synthetic data for AV training, including Cosmos-generated videos and a starter pack of scenes for neural reconstruction.

Autonomous Vehicle Simulation Learning Resources

Accelerate AV Simulation with Neural Reconstruction and World Foundation Models

In this tech blog, we highlight the latest NVIDIA APIs, Cosmos world foundation models, and NIM microservices for developers to kickstart their data pipelines.

Simplify End-to-End AV Development with New NVIDIA Cosmos Transfer NIM

This blog showcases how developers can create world models and generate synthetic data (SDG) to accelerate end-to-end AV training, as closed-loop training and in-vehicle inference.

Advancing AV Development With Sensor Simulation and NVIDIA Cosmos

This session features the workflows developed by NVIDIA AV simulation ecosystem partners for scenario creation, SDG, 3D reconstruction, and closed-loop simulation.

Autonomous Vehicle Sensor Simulation, Powered by NVIDIA Omniverse

See how Foretellix uses NVIDIA Omniverse Blueprint for AV simulation to generate high-fidelity sensor simulation for AV development.