Image-based photorealistic 3-D face modeling

초록

In this paper, we describe a system for 3-D photorealistic face modeling from frontal and profile images taken by an uncalibrated handheld digital camera. The system employs a generic model adaptation framework. That is, after the fiducial features are detected from both images, a generic head model is deformed to match with the detected features. Realistic texture is created by combining the augmented facial textures from input images and synthesized texture, and mapped onto the deformed generic head model. Our shape deformation and texture generation algorithms have several advantages: (1) The proposed preprocessing and model deformation algorithm generate photorealistic models even when the orthogonal assumption of input image pairs is not satisfied. (2) The generated ear has smooth shape and improves the quality of the whole face model dramatically. (3) Different techniques on texture processing are employed to improve the appearance.