NVIDIA Omniverse ACE
NVIDIA Omniverse™ Avatar Cloud Engine (ACE), is a collection of cloud-based AI models and services for developers to easily build, customize and deploy engaging and interactive avatars.Notify me
Key Benefits of Omniverse ACE
Simple to Build
Enjoy realistic, advanced Avatar development without the need for specialized expertise, equipment, or manually intensive workflows. With cloud-based AI models, toolsets, and pre-built application frameworks like Tokkio, Omniverse ACE enables you to build realistic Avatars quickly.
Bring your avatars to life using rich software tools and APIs, including Omniverse Audio2Face for simplified character animation, Conversational AI solutions like NVIDIA Riva for natural speech-based interaction, NVIDIA Metropolis for computer vision, and NVIDIA Merlin for high-performance recommender systems.
Build, configure, and deploy your avatar application across any engine in any public or private cloud. Whether you have real-time or offline requirements, Omniverse ACE enables you to develop and deploy your Avatar to suit your needs.
Real-Time AI Development
Omniverse ACE is built on NVIDIA’s Unified Compute Framework (UCF), enabling developers to seamlessly integrate NVIDIA’s suite of avatar technologies into their applications.
Developers can leverage Omniverse ACE to build their own domain-specific avatar solutions, or use NVIDIA’s suite of application frameworks for next-generation web conferencing, intelligent AI-service agents, and more.
Project Tokkio is an application built with Omniverse ACE - bringing AI-powered customer service to retail stores, quick-service restaurants, and even the web. It comes to life using NVIDIA AI models and technology like NVIDIA Metropolis, NVIDIA Riva, and NVIDIA NeMO. Since it runs on NVIDIA’s unified computing framework (UCF), NVIDIA Tokkio can scale out from the cloud and go wherever customers need helpful avatars with responsive and natural behavior.Learn More About NVIDIA Tokkio
Collaboration with global audiences can be dramatically improved when speaking in their language. NVIDIA Maxine integrates NVIDIA Riva’s real-time translation and text-to-speech with real-time “live portrait” photo animation and eye contact to enable better communication and understanding.Learn More About NVIDIA Maxine
How Omniverse ACE Works
Example of the NVIDIA Tokkio avatar AI workflow pipeline built with Omniverse ACE
Explore NVIDIA Avatar Technologies
Omniverse Audio2Face beta simplifies animation of a 3D character to match any voice-over track, whether you’re animating characters for a game, film, real-time digital assistants, or just for fun. You can use the app for interactive real-time applications or as a traditional facial animation authoring tool. Run the results live or bake them out, it’s up to you.Learn More About AUDIO2FACE
With NVIDIA’s conversational AI solutions–including NVIDIA Riva for speech AI and NVIDIA NeMo Megatron for natural language processing, developers can quickly build and deploy cutting-edge applications that deliver high-accuracy and respond in far less than 300 milliseconds, the speed for natural, real-time interactions.Learn More About Conversational AI
NVIDIA Metropolis enables the end-to-end computer vision (CV) workflow—from model development to deployment—for individual developers, higher education and research, and enterprises. Start with NVIDIA pre-trained models, TAO, and DeepStream to make the end-to-end computer vision AI development process easier.Learn More About Metropolis
NVIDIA Merlin™ is an open-source framework for building high-performing recommender systems at scale. It includes libraries, methods, and tools that streamline the building of recommenders by addressing common preprocessing, feature engineering, training, inference, and deploying to production challenges.Learn More About Merlin
Interested in learning more about NVIDIA Omniverse ACE and getting early access when it becomes available?
Sign up for the latest news.
See NVIDIA Omniverse ACE in Action
QSR Customer Service
See customers interact with Project Tokkio, an Omniverse ACE-powered conversational-AI kiosk. This reference application leverages NVIDIA Metropolis vision AI and NVIDIA Riva speech AI technology to communicate with the user. It uses NVIDIA’s NeMo Megatron-Turing 530B, a state-of-the-art language model for understanding intent, and NVIDIA Merlin to make meaningful recommendations. The 3D avatar is animated and visualized with Omniverse to deliver a visually stunning customer service experience—all in real time.Watch the Customer Service Kiosk Demo
Natural, Expert Q&A Assistant
In this demo, we see one example of Project Tokkio - a “talking kiosk” reference application featuring a photorealistic, life-like autonomous avatar responding to challenging domain-specific questions. The avatar, built in Omniverse, is a reference application that leverages several key NVIDIA technologies, including NVIDIA Riva for speech AI, NVIDIA’s NeMo Megatron Megatron-Turing 530B large language model, and a combination of NVIDIA Omniverse animation systems for facial and body animation.Watch the Q&A Demo
Omniverse ACE enables DRIVE Concierge to serve as everyone’s digital assistant, helping them make recommendations, book reservations, make phone calls, and provide alerts. It’s personalized to each driver and passenger, giving every vehicle occupant their own personal concierge. Passengers can have a natural conversation with the vehicle and use voice to control many functions that previously required physical controls or touch screens.Watch the DRIVE Concierge Demo
Become Part of Our Community
Stay up-to-date on the latest NVIDIA Omniverse news