NVIDIA Omniverse ACE

NVIDIA Omniverse™ Avatar Cloud Engine (ACE), is a collection of cloud-based AI models and services for developers to easily build, customize and deploy engaging and interactive avatars.

Notify me

Key Benefits of Omniverse ACE

Simple to Build

Enjoy realistic, advanced Avatar development without the need for specialized expertise, equipment, or manually intensive workflows. With cloud-based AI models, toolsets, and pre-built application frameworks like Tokkio, Omniverse ACE enables you to build realistic Avatars quickly.

Realistic Results

Bring your avatars to life using rich software tools and APIs, including Omniverse Audio2Face for simplified character animation, Conversational AI solutions like NVIDIA Riva for natural speech-based interaction, NVIDIA Metropolis for computer vision, and NVIDIA Merlin for high-performance recommender systems.

Flexible Deployment

Build, configure, and deploy your avatar application across any engine in any public or private cloud. Whether you have real-time or offline requirements, Omniverse ACE enables you to develop and deploy your Avatar to suit your needs.

Real-Time AI Development

Omniverse ACE is built on NVIDIA’s Unified Compute Framework (UCF), enabling developers to seamlessly integrate NVIDIA’s suite of avatar technologies into their applications.


Application Frameworks

Developers can leverage Omniverse ACE to build their own domain-specific avatar solutions, or use NVIDIA’s suite of application frameworks for next-generation web conferencing, intelligent AI-service agents, and more.


NVIDIA Tokkio

Project Tokkio is an application built with Omniverse ACE - bringing AI-powered customer service to retail stores, quick-service restaurants, and even the web. It comes to life using NVIDIA AI models and technology like NVIDIA Metropolis, NVIDIA Riva, and NVIDIA NeMO. Since it runs on NVIDIA’s unified computing framework (UCF), NVIDIA Tokkio can scale out from the cloud and go wherever customers need helpful avatars with responsive and natural behavior.

Learn More About NVIDIA Tokkio


Omniverse Avatar Cloud Engine helps to build Project Tokkio.

NVIDIA Maxine

Collaboration with global audiences can be dramatically improved when speaking in their language. NVIDIA Maxine integrates NVIDIA Riva’s real-time translation and text-to-speech with real-time “live portrait” photo animation and eye contact to enable better communication and understanding.

Learn More About NVIDIA Maxine


NVIDIA Maxine

How Omniverse ACE Works

Diagram of the Tokkio AI pipeline workflow from user interface to avatar interaction

Example of the NVIDIA Tokkio avatar AI workflow pipeline built with Omniverse ACE


Explore NVIDIA Avatar Technologies

cloth-simulation-630x354.gif

Animation AI

Omniverse Audio2Face beta simplifies animation of a 3D character to match any voice-over track, whether you’re animating characters for a game, film, real-time digital assistants, or just for fun. You can use the app for interactive real-time applications or as a traditional facial animation authoring tool. Run the results live or bake them out, it’s up to you.

Learn More About AUDIO2FACE
newsletter-ai-for-dev-promo-package-riva-tokkio-600x338.jpg

Conversational AI

With NVIDIA’s conversational AI solutions–including NVIDIA Riva for speech AI and NVIDIA NeMo Megatron for natural language processing, developers can quickly build and deploy cutting-edge applications that deliver high-accuracy and respond in far less than 300 milliseconds, the speed for natural, real-time interactions.

Learn More About Conversational AI
Procedural Animation

Vision AI

NVIDIA Metropolis enables the end-to-end computer vision (CV) workflow—from model development to deployment—for individual developers, higher education and research, and enterprises. Start with NVIDIA pre-trained models, TAO, and DeepStream to make the end-to-end computer vision AI development process easier.

Learn More About Metropolis
Mesh Deformers

Recommendation AI

NVIDIA Merlin™ is an open-source framework for building high-performing recommender systems at scale. It includes libraries, methods, and tools that streamline the building of recommenders by addressing common preprocessing, feature engineering, training, inference, and deploying to production challenges.

Learn More About Merlin

Interested in learning more about NVIDIA Omniverse ACE and getting early access when it becomes available?
Sign up for the latest news.

Notify Me

See NVIDIA Omniverse ACE in Action

See how customers interact with Project Tokkio, an AI talking kiosk.

QSR Customer Service

See customers interact with Project Tokkio, an Omniverse ACE-powered conversational-AI kiosk. This reference application leverages NVIDIA Metropolis vision AI and NVIDIA Riva speech AI technology to communicate with the user. It uses NVIDIA’s NeMo Megatron-Turing 530B, a state-of-the-art language model for understanding intent, and NVIDIA Merlin to make meaningful recommendations. The 3D avatar is animated and visualized with Omniverse to deliver a visually stunning customer service experience—all in real time.

Watch the Customer Service Kiosk Demo
Project Tokkio features a natural, expert Q&A assistant.

Natural, Expert Q&A Assistant

In this demo, we see one example of Project Tokkio - a “talking kiosk” reference application featuring a photorealistic, life-like autonomous avatar responding to challenging domain-specific questions. The avatar, built in Omniverse, is a reference application that leverages several key NVIDIA technologies, including NVIDIA Riva for speech AI, NVIDIA’s NeMo Megatron Megatron-Turing 530B large language model, and a combination of NVIDIA Omniverse animation systems for facial and body animation.

Watch the Q&A Demo
Omniverse Avatar Cloud Engine (ACE) enables DRIVE Concierge.

DRIVE Concierge

Omniverse ACE enables DRIVE Concierge to serve as everyone’s digital assistant, helping them make recommendations, book reservations, make phone calls, and provide alerts. It’s personalized to each driver and passenger, giving every vehicle occupant their own personal concierge. Passengers can have a natural conversation with the vehicle and use voice to control many functions that previously required physical controls or touch screens.

Watch the DRIVE Concierge Demo

Become Part of Our Community

Access Tutorials

Take advantage of hundreds of free tutorials, sessions, or our beginner’s training to get started with USD.

Resource Center

Become an Omnivore

Join our community! Attend our weekly live streams on Twitch and connect with us on Discord and our forums.

Streaming Calendar

Get Technical Support

Having trouble? Post your questions in the forums for quick guidance from Omniverse experts, or refer to the platform documentation.

Support Forums

Live Training Sessions

Want to dive deeper into NVIDIA Omniverse? Attend a live training with a certified instructor from FMC.

Register Now

Stay up-to-date on the latest NVIDIA Omniverse news

Subscribe