Researchers from The University of Hong Kong developed a deep learning-based sketching system that lets users easily create a 3D face in minutes.
The low-cost interactive face modeling system allows the user to draw freehand imprecise 2D lines and then with the help of deep learning, they’re able to further manipulate the expressions of the 3D model.
According to the researcher’s paper, the key issue in gesture-based 3D face refinement is achieving high accuracy in gesture classification. Using a TITAN X GPU, CUDA and the cuDNN accelerated Caffe deep learning framework, they trained their convolutional neural network on thousands of 3D face models with varying shapes and expressions that were rendered into sketches.
For future work, the researchers plan to take advantage of Generative Adversarial Networks (GANs) to help with the pixel-to-pixel prediction which will be used to create geometric details such as wrinkles.
Read more >
Create a 3D Caricature in Minutes with Deep Learning
May 15, 2017
Discuss (0)
AI-Generated Summary
- Researchers from The University of Hong Kong created a deep learning-based system that allows users to create 3D faces by drawing 2D lines.
- The system uses a convolutional neural network trained on thousands of 3D face models to achieve high accuracy in gesture classification.
- The researchers plan to use Generative Adversarial Networks (GANs) in future work to improve the creation of geometric details such as wrinkles.
AI-generated content may summarize information incompletely. Verify important information. Learn more
About the Authors
