Automatic pose estimation of 3D facial models

Pose estimation plays an essential role in many computer vision applications, such as human computer interaction (HCI), driver attentiveness monitoring, face recognition, automatic face model editing, etc. In this paper, we propose a geometric feature based pose estimation approach based on 3D facial models. By identifying two clusters of inner eye corners of a 3D facial model, we find the nose tip with the aid of a facial reference plane. Then, a symmetry plane is generated and the pose orientation can be estimated. Our proposed algorithm is robust with respect to different persons, large pose variations, different expressions, partial facial data missing, and non-facial outliers. All computation is based on the pure 3D mesh model of a face without texture information. We tested our approach using 1,200 3D raw facial models and 1,200 corresponding clean facial models, and achieved 92.1% and 96.4% correct pose estimation rate, respectively.

[1]  Anil K. Jain,et al.  Matching 2.5D face scans to 3D models , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Michael G. Strintzis,et al.  Real-time head tracking and 3D pose estimation from range data , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[3]  Patrick J. Flynn,et al.  A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition , 2006, Comput. Vis. Image Underst..

[4]  Luc Van Gool,et al.  Real-time face pose estimation from single range images , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Vincent Lepetit,et al.  Fusing online and offline information for stable 3D tracking in real-time , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[6]  Anil K. Jain,et al.  Automatic feature extraction for multiview 3D face recognition , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[7]  Lijun Yin,et al.  3D Face Recognition Using Two Views Face Modeling and Labeling , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[8]  Trevor Darrell,et al.  Pose estimation using 3D view-based eigenspaces , 2003, 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443).

[9]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Jun Wang,et al.  A 3D facial expression database for facial behavior research , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[11]  Qiang Ji,et al.  Real-Time Eye, Gaze, and Face Pose Tracking for Monitoring Driver Vigilance , 2002, Real Time Imaging.

[12]  Qiang Ji,et al.  Real time 3D face pose discrimination based on active IR illumination , 2002, Object recognition supported by user interaction for service robots.

[13]  Thomas Vetter,et al.  Face Recognition Based on Fitting a 3D Morphable Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Alex Pentland,et al.  View-based and modular eigenspaces for face recognition , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[15]  David G. Stork,et al.  Pattern Classification , 1973 .

[16]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.