New NVIDIA NIM Agent Blueprints now available   Get Started

NVIDIA Tokkio Reference Workflow

Intelligent interactive avatars for customer service



Meet James, an interactive digital human knowledgeable about NVIDIA and our products. James uses a collection of NVIDIA NIM microservices, NVIDIA ACE, and ElevenLabs digital human technologies to provide natural and immersive responses. To create your own digital human, developers can access the digital human NIM Agent Blueprint.


Interact with James

Built on NVIDIA ACE

Tokkio is an NVIDIA ACE customer service reference workflow. NVIDIA ACE is a suite of technologies for bringing digital humans to life with generative AI. Built on NVIDIA AI, graphics, and simulation technologies, NVIDIA ACE encompasses technology for every part of the digital human—from speech and translation, vision and intelligence, to realistic animation and behavior, to lifelike appearance.

Omniverse Audio2Face supports animation AI

Animation AI

Audio2Face™ simplifies animation of a 3D character to match any voice-over track—whether you’re animating characters for a game, film, real-time digital assistants, or just for fun. You can use the app for interactive real-time applications or as a traditional facial animation authoring tool. Run the results live or bake them out—it’s up to you.

Learn More About Audio2Face
A customer service representative is using  NVIDIA’s conversational AI solutions

Conversational AI

With NVIDIA’s conversational AI solutions—including NVIDIA® Riva for speech AI and NeMo™ framework for natural language processing—developers can quickly build and deploy cutting-edge applications that deliver high accuracy and respond in far less than 300 milliseconds, the speed for real-time interactions.

Learn More About Conversational AI
NVIDIA Metropolis enables end-to-end computer vision (CV) workflow

Vision AI

NVIDIA Metropolis enables the end-to-end computer vision (CV) workflow—from model development to deployment—for individual developers, higher education, research, and enterprises. Start with NVIDIA pretrained models, TAO, and DeepStream to make the end-to-end computer vision AI development process easier.

Learn More About Metropolis
 NVIDIA Merlin helps build high-performing recommender systems at scale

Recommendation AI

NVIDIA Merlin™ is an open-source framework for building high-performing recommender systems at scale. It includes libraries, methods, and tools that streamline the building of recommenders by addressing common preprocessing, feature engineering, training, inference, and deploying to production challenges.

Learn More About Merlin

See Customer Service Agents in Action

See how customers interact with Project Tokkio, an AI talking kiosk

QSR Customer Service

See customers interact with Project Tokkio, an ACE-powered conversational-AI kiosk. This reference application utilizes NVIDIA Metropolis vision AI and NVIDIA Riva speech AI technology to communicate with the user. It uses NVIDIA’s NeMo Megatron-Turing 530B, a state-of-the-art language model for understanding intent, and NVIDIA Merlin to make meaningful recommendations. The 3D avatar is animated and visualized with NVIDIA Omniverse™ to deliver a visually stunning customer service experience—all in real time.

Watch the Customer Service Kiosk Demo
Project Tokkio features a natural, expert Q&A assistant

Natural, Expert Q&A Assistant

In this demo, we see one example of Project Tokkio—a “talking kiosk” reference application featuring a photorealistic, lifelike autonomous avatar responding to challenging domain-specific questions. The avatar, built in Omniverse, is a reference application that uses several key NVIDIA technologies, including NVIDIA Riva for speech AI, NVIDIA’s NeMo Megatron Megatron-Turing 530B large language model, and a combination of NVIDIA Omniverse animation systems for facial and body animation.

Watch the Q&A Demo
Omniverse Avatar Cloud Engine (ACE) enables DRIVE Concierge

DRIVE Concierge

ACE enables NVIDIA DRIVE Concierge™ to serve as everyone’s digital assistant—helping them make recommendations, book reservations, make phone calls, and provide alerts. It’s personalized to each driver and passenger, giving every vehicle occupant their own personal concierge. Passengers can have a natural conversation with the vehicle and use voice to control many functions that previously required physical controls or touch screens.

Watch the DRIVE Concierge Demo