Animation Setup Transfer

Local Control Editing Paradigms for Part-Based 3D Face Morphable Models

Donya Ghafourzadeh, Sahel Fallahdoust, Cyrus Rahgoshay, Andre Beauchamp, Tiberiu Popa, and Eric Paquette,
Computer Animation and Virtual Worlds, 2021.

 

Abstract

We propose an approach to construct realistic 3D facial morphable models (3DMM) that allows an intuitive facial attribute editing workflow. Current face modeling methods using 3DMM suffer from a lack of local control. We thus create a 3DMM by combining local part-based 3DMM for the eyes, nose, mouth, ears, and facial mask regions. Our local PCA-based approach uses a novel method to select the best eigenvectors from the local 3DMM to ensure that the combined 3DMM is expressive, while allowing accurate reconstruction. We provide different editing paradigms, all designed from the analysis of the data set. Some use anthropometric measurements from the literature and others allow the user to control the dominant modes of variation extracted from the data set. Our part-based 3DMM is compact, yet accurate, and compared to other 3DMM methods, it provides a new trade-off between local and global control. We tested our approach on a data set of 135 scans used to derive the 3DMM, plus 19 scans that served for validation. The results show that our part-based 3DMM approach has excellent generative properties and allows the user intuitive local control.

Keywords

3DMM, 3D facial morphable models, modeling, polygon mesh, face modeling

BibTeX entry

@article{Ghafourzadeh2021,
author = {Ghafourzadeh, Donya and Fallahdoust, Sahel and Rahgoshay, Cyrus and Beauchamp, Andre and Aubame, Adeline and Popa, Tiberiu and Paquette, Eric},
title = {Local control editing paradigms for part-based {3D} face morphable models},
journal = {Computer Animation and Virtual Worlds},
volume = {32},
number = {6},
pages = {e2028},
}

Online version

Official published paper.

Additional material

Pre-print version of the video: