NVIDIA OMNIVERSE AVATAR

NVIDIA Omniverse™ Avatar enables developers to generate, animate, simulate, and render state-of-the-art interactive avatars as well as the experiences that use them.

NOTIFY ME
Image alt text

Key Benefits of Omniverse Avatar

Simple to Build

Enjoy realistic, advanced Avatar building without the need for expertise, specialized equipment, or manually intensive workflows. With AI-enabled toolsets, accelerated rendering, and simulation technology, Omniverse Avatar enables you to build realistic Avatars quickly.

Ultra-Realistic Results

Render Avatars with stunning fidelity and quality using scalable, fast, realistic path traced shading, powered by Omniverse RTX Renderer. Realistic facial and body animation, and natural emotion and behavior, is automatically generated using inputs as simple as audio tracks.

Flexible Deployment

Whether you have real time or offline requirements, the Omniverse Avatar framework enables you to develop and freely deploy your Avatar depending on your use case.

An Omniverse Avatar app is currently under development. To sample the technology, download and get started with Omniverse Audio2Face today.

Interested in Omniverse Avatar Early Access?

NOTIFY ME

Application Frameworks

Developers can leverage the Omniverse Avatar technology platform to build their own domain-specific avatar solutions, or leverage Project Maxine for next-generation web conferencing, or Project Tokkio, for intelligent AI-service agents.

NVIDIA Maxine

Collaboration with global audiences can be dramatically improved when speaking in their language. To enable better communication and understanding, NVIDIA Maxine integrates NVIDIA Riva’s real-time translation and text-to-speech with photo animation “live portrait” and eye contact in real time to enable better communication and understanding.

LEARN MORE


NVIDIA Maxine helps to enable better communication and understanding.

Project Tokkio

Project Tokkio is an application built with Omniverse Avatar - bringing AI-powered customer service to retail stores, quick-service restaurants, and even the web. It comes to life using NVIDIA AI models and technology like NVIDIA Metropolis, NVIDIA Riva, and NVIDIA NeMO. Since it runs on NVIDIA’s unified computing framework (UCF), Tokkio can scale out from the cloud and go wherever customers need helpful avatars with responsive and natural behavior.

WATCH THE DEMO


Project Tokkio is built with Omniverse Avatar to bring AI-powered customer service to retail stores and restaurants.


See how customers interact with Project Tokkio, an AI talking kiosk.

QSR Customer Service

See customers interact with Project Tokkio, a Metropolis-powered AI talking kiosk. This reference application leverages NVIDIA Metropolis vision AI and NVIDIA Riva speech AI technology to communicate with the user. It uses NVIDIA’s NeMo Megatron-Turing 530B, a state-of-the-art language model for understanding intent, and NVIDIA Merlin to make meaningful recommendations. The 3D avatar is animated and visualized with Omniverse to deliver a visually stunning customer service experience—all in real-time.

WATCH DEMO
Project Tokkio features a natural, expert Q&A assistant.

Natural, Expert Q&A Assistant

In this demo, we see one example of Project Tokkio - a “talking kiosk” reference application featuring a photorealistic, life-like autonomous avatar responding to challenging domain-specific questions. The avatar, built in Omniverse, is a reference application that leverages several key NVIDIA technologies including, NVIDIA Riva for speech AI, NVIDIA’s NeMo Megatron Megatron-Turing 530B large language model, and a combination of NVIDIA Omniverse animation systems for facial and body animation.

WATCH DEMO
Omniverse Avatar enables DRIVE Concierge to serve as everyone’s digital assistant.

DRIVE Concierge

Omniverse Avatar enables DRIVE Concierge to serve as everyone’s digital assistant, helping them make recommendations, book reservations, make phone calls and provide alerts. It’s personalized to each driver and passenger, giving every vehicle occupant their own personal concierge. Passengers will be able to have a natural conversation with the vehicle and use voice to control many functions that previously required physical controls or touch screens.

WATCH DEMO

Latest Omniverse News


Upcoming Webinar: How Synthetic Data is Supercharging Vision AI Development

Upcoming Webinar: How Synthetic Data is Supercharging Vision AI Development

Join this webinar from Metropolis on May 18 or 19 to learn how synthetic data can transform your AI development efforts, including using the NVIDIA Omniverse Replicator.

Building Scientifically Accurate Digital Twins Using Modulus with Omniverse and AI

Building Scientifically Accurate Digital Twins Using Modulus with Omniverse and AI

The latest release features Omniverse integration for interactive visualization, new AI architectures to accelerate the scientific simulations using data, and more.

Shaping the Future of Graphics with NVIDIA Technologies in Unreal Engine 5

Shaping the Future of Graphics with NVIDIA Technologies in Unreal Engine 5

With the launch of Unreal Engine 5, NVIDIA announces support with key RTX technologies for developers to propel their games and experiences to the next level.

Latest Releases and Resources: NVIDIA GTC 2022

Latest Releases and Resources: NVIDIA GTC 2022

This GTC focused roundup features updates to the HPC SDK, cuQuantum SDK, Nsight Graphics and Systems 2022.2, CUDA 11.6, Update 1, cuNumeric, and Warp.

Become Part of Our Community

Access Tutorials

Take advantage of hundreds of free tutorials,sessions, or our beginner’s training to get started with USD.

RESOURCE CENTER

Become an Omnivore

Join our community! Attend our weekly live streams on Twitch and connect with us on Discord and our forums.

STREAMING CALENDAR

Get Technical Support

Having trouble? Post your questions in the forums for quick guidance from Omniverse experts, or refer to the platform documentation.

FORUMS

Live Training Sessions

Want to dive deeper into NVIDIA Omniverse? Attend a live training with a certified instructor from FMC.

REGISTER TODAY

Stay up-to-date on the latest NVIDIA Omniverse news

Subscribe