A Robust Method for Facial Shape and Texture Reconstruction Overcoming the Influence of Shadow and Highlight

This paper presents a robust method for facial shape and texture reconstruction based-on the model of polyhedron and the technology of photometric stereo. Using the continuity restrictions and error-reduced operator, the presented method can overcome the influence of shadow and highlight. First, we reconstruct the 2.5D shape and texture of human face by solving a linear equations system established by the corresponding relationships between faces of polyhedron and pixels of human facial images under three independent illuminations. Then, we synthesize three virtual photometric stereo images from reconstructed shape and texture using computer graphics. The local shadow analysis and specular reflection are used to make the synthesized images approach to the real images. We reconstruct facial shape and texture again from synthesized virtual photometric stereo images. Finally, these two reconstruction results are combined to reduce the reconstruction error and produce a superior result. Experimental results on YaleB database show that this method can reconstruct the 2.5D shape and texture of human face rapidly overcoming the influence of shadow and highlight.

[1]  Tomaso A. Poggio,et al.  Linear Object Classes and Image Synthesis From a Single Example Image , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Gao Wen,et al.  Pose and Illumination Invariant Face Recognition Based on 3D Face Reconstruction , 2006 .

[3]  Maria Petrou,et al.  The 4-Source Photometric Stereo Technique for Three-Dimensional Surfaces in the Presence of Highlights and Shadows , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Peter W. Hallinan.  A low-dimensional representation of human faces for arbitrary lighting conditions , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Sang Uk Lee,et al.  Illumination Invariant Face Recognition Using Photometric Stereo , 1998, MVA.

[6]  David J. Kriegman,et al.  What Is the Set of Images of an Object Under All Possible Illumination Conditions? , 1998, International Journal of Computer Vision.

[7]  Liu Ze-yi.  Facial Feature Contour Extraction for 3D Head Modeling , 2006 .

[8]  Qing Lai.  Face Recognition under Varying Lighting Based on the Harmonic Images , 2006 .

[9]  David J. Kriegman,et al.  From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Thomas Vetter,et al.  Face Recognition Based on Fitting a 3D Morphable Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Li Zhang,et al.  An error-reduction-based algorithm for cone-beam computed tomography. , 2004, Medical physics.

[12]  Anil K. Jain,et al.  3D Face Reconstruction from Stereo Video , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[13]  Remco C. Veltkamp,et al.  A Survey of 3D Face Recognition Methods , 2005, AVBPA.