A new GPU-based facial reenactment technique tracks the expression of a source actor and transfers it to a target actor in real-time – which translates into you being able to control another human’s expressions. The project is a collaboration of researchers from Stanford University, Max Planck Institute for Informatics and University of Erlangen-Nuremberg.
The novelty of the approach lies in the transfer and photorealistic re-rendering of facial deformations and detail into the target video in a way that the newly-synthesized expressions are virtually indistinguishable from a real video.
The video demo uses a setup consisting of a GeForce GTX 980 GPU and is something definitely worth watching – it’s a matter of time before Disney adopts this technology!
You can read more about the project in their paper titled “Real-time Expression Transfer for Facial Reenactment.“
AI-Generated Summary
- A GPU-based facial reenactment technique tracks a source actor's expression and transfers it to a target actor in real time.
- The method transfers and photorealistically re-renders facial deformations and detail so that newly synthesized expressions are virtually indistinguishable from real video.
- Researchers from Stanford University, Max Planck Institute for Informatics, and University of Erlangen-Nuremberg collaborated on the project.
- A demonstration runs on a GeForce GTX 980 GPU.
Next Step
- Read the Real-time Expression Transfer for Facial Reenactment paper for full technical details.
Powered by NVIDIA Nemotron. AI-generated content may summarize information incompletely. Verify important information. Learn more
About the Authors
