Evaluation of spatio-temporal regional features For 3D face analysis

3D facial representations have been widely used for face recognition and facial expression recognition. Both local and global features can be extracted from either static or dynamic models in both spatial and temporal domains. 3D local features are referred to the features in regional facial areas while 3D global features are referred to the features from the entire facial region. In this paper, we address the issue of performance assessment of facial analysis in terms of global features versus local features, static models versus dynamic models, and spatial domain versus temporal domain. Based on the existing work of using 3D spatio-temporal HMM for facial analysis, we propose to extend it to a local-temporal HMM in order to provide an explicit comparison of global features and local features. A dynamic 3D facial expression database and a static facial expression database are used for experiments. The performance for six prototypic facial expression classification and face identification is analyzed and reported.

[1]  Patrick J. Flynn,et al.  An evaluation of multimodal 2D+3D face biometrics , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Alexander M. Bronstein,et al.  Three-Dimensional Face Recognition , 2005, International Journal of Computer Vision.

[3]  Ioannis A. Kakadiaris,et al.  Intraclass Retrieval of Nonrigid 3D Objects: Application to Face Recognition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Patrick J. Flynn,et al.  Multiple Nose Region Matching for 3D Face Recognition under Varying Facial Expression , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Jun Wang,et al.  3D Facial Expression Recognition Based on Primitive Surface Feature Distribution , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[6]  Lijun Yin,et al.  A high-resolution 3D dynamic facial expression database , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[7]  Gwen Littlewort,et al.  Fully Automatic Facial Action Recognition in Spontaneous Behavior , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[8]  Jun Wang,et al.  A 3D facial expression database for facial behavior research , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[9]  Zhihong Zeng,et al.  A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions , 2009, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Thomas Vetter,et al.  Face Recognition Based on Fitting a 3D Morphable Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Sen Wang,et al.  3D Surface Matching and Recognition Using Conformal Geometry , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[12]  Lijun Yin,et al.  3D Spatio-Temporal face recognition using dynamic range model sequences , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[13]  Alexander M. Bronstein,et al.  Expression-Invariant Representations of Faces , 2007, IEEE Transactions on Image Processing.

[14]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[15]  Josef Kittler,et al.  3D Assisted Face Recognition: A Survey of 3D Imaging, Modelling and Recognition Approachest , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[16]  John J. B. Allen,et al.  The handbook of emotion elicitation and assessment , 2007 .

[17]  Shaogang Gong,et al.  Constructing Facial Identity Surfaces for Recognition , 2003, International Journal of Computer Vision.

[18]  Anuj Srivastava,et al.  Three-Dimensional Face Recognition Using Shapes of Facial Curves , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Anil K. Jain,et al.  Matching 2.5D face scans to 3D models , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Ahmed M. Elgammal,et al.  High Resolution Acquisition, Learning and Transfer of Dynamic 3‐D Facial Expressions , 2004, Comput. Graph. Forum.

[21]  Alexander M. Bronstein,et al.  Expression-invariant three-dimensional face recognition , 2005 .

[22]  Monson H. Hayes,et al.  A hidden markov model-based approach for face detection and recognition , 1999 .

[23]  Maja Pantic,et al.  Automatic Analysis of Facial Expressions: The State of the Art , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Remco C. Veltkamp,et al.  A Survey of 3D Face Recognition Methods , 2005, AVBPA.

[25]  Patrick J. Flynn,et al.  A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition , 2006, Comput. Vis. Image Underst..

[26]  Luiz Velho,et al.  Automatic 3D Facial Expression Analysis in Videos , 2005, AMFG.

[27]  Sen Wang,et al.  Conformal Geometry and Its Applications on 3D Shape Matching, Recognition, and Stitching , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Lijun Yin,et al.  Facial Expression Recognition Based on 3D Dynamic Range Model Sequences , 2008, ECCV.

[29]  Anil K. Jain,et al.  Handbook of Face Recognition, 2nd Edition , 2011 .

[30]  J. Cohn,et al.  Use of Automated Facial Image Analysis for Measurement of Emotion Expression , 2004 .

[31]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).