Face recognition from one example view

To create a pose-invariant face recognizer, one strategy is the view-based approach, which uses a set of real example views at different poses. But what if we only have one real view available, such as a scanned passport photo-can we still recognize faces under different poses? Given one real view at a known pose, it is still possible to use the view-based approach by exploiting prior knowledge of faces to generate virtual views, or views of the face as seen from different poses. To represent prior knowledge, we use 2D example views of prototype faces under different rotations. We develop example-based techniques for applying the rotation seen in the prototypes to essentially "rotate" the single real view which is available. Next, the combined set of one real and multiple virtual views is used as example views for a view-based, pose-invariant face recognizer. Oar experiments suggest that among the techniques for expressing prior knowledge of faces, 2D example-based approaches should be considered alongside the more standard 3D modeling techniques.<<ETX>>

[1]  Living Pictures , Nature.

[2]  Robert J. Baron,et al.  Mechanisms of Human Facial Recognition , 1981, Int. J. Man Mach. Stud..

[3]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[4]  V. Bruce Changing faces: visual and non-visual coding processes in face recognition. , 1982, British journal of psychology.

[5]  Kiyoharu Aizawa,et al.  Model-based analysis synthesis image coding (MBASIC) system for a person's face , 1989, Signal Process. Image Commun..

[6]  Demetri Terzopoulos,et al.  Analysis of facial images using physical and anatomical models , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[7]  George Wolberg,et al.  Digital image warping , 1990 .

[8]  T. Poggio,et al.  A network that learns to recognize three-dimensional objects , 1990, Nature.

[9]  Lance Williams,et al.  Performance-driven facial animation , 1990, SIGGRAPH.

[10]  WilliamsLance Performance-driven facial animation , 1990 .

[11]  Peter C. Litwinowicz,et al.  Facial Animation by Spatial Mapping , 1991 .

[12]  Ian Craw,et al.  Synthetic Images of Faces — An Approach to Model-Based Face Recognition , 1991 .

[13]  A. Shashua Correspondence and Affine Shape from Two Orthographic Views: Motion and Recognition , 1991 .

[14]  Ian Craw,et al.  Parameterising Images for Recognition and Reconstruction , 1991 .

[15]  M. Bichsel Strategies of robust object recognition for the automatic identification of human faces , 1991 .

[16]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[17]  W. J. Welsh,et al.  Classification of facial features for recognition , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  Ian Craw,et al.  Synthetic Images of Faces - An Approach to Model-Based Face Recognition , 1991, BMVC.

[19]  Ronen Basri,et al.  Recognition by Linear Combinations of Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  A. Shashua Geometry and Photometry in 3D Visual Recognition , 1992 .

[21]  P. Anandan,et al.  Hierarchical Model-Based Motion Estimation , 1992, ECCV.

[22]  Timothy F. Cootes,et al.  Active Shape Models - 'smart snakes' , 1992, BMVC.

[23]  T. Poggio,et al.  Recognition and Structure from one 2D Model View: Observations on Prototypes, Object Classes and Symmetries , 1992 .

[24]  Rama Chellappa,et al.  A feature based approach to face recognition , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[25]  Thaddeus Beier,et al.  Feature-based image metamorphosis , 1992, SIGGRAPH.

[26]  Ian Craw,et al.  Face Recognition by Computer , 1992, BMVC.

[27]  Tomaso Poggio,et al.  A Novel Approach to Graphics , 1992 .

[28]  Yung-Sheng Chen,et al.  Mapping a lifelike 2.5 D human face via an automatic approach , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Roberto Brunelli,et al.  Face Recognition: Features Versus Templates , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Joachim M. Buhmann,et al.  Distortion Invariant Object Recognition in the Dynamic Link Architecture , 1993, IEEE Trans. Computers.

[31]  J. M. Gilbert,et al.  A real-time face recognition system using custom VLSI hardware , 1993, 1993 Computer Architectures for Machine Perception.

[32]  Tomaso Poggio,et al.  Example Based Image Analysis and Synthesis , 1993 .

[33]  Timothy F. Cootes,et al.  Building and using flexible models incorporating grey-level information , 1993, 1993 (4th) International Conference on Computer Vision.

[34]  Takaaki Akimoto,et al.  Automatic creation of 3D facial models , 1993, IEEE Computer Graphics and Applications.

[35]  Peter W. Hallinan A low-dimensional representation of human faces for arbitrary lighting conditions , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Larry S. Davis,et al.  Computing spatio-temporal representations of human faces , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[37]  Lance Williams,et al.  Animating images with drawings , 1994, SIGGRAPH.

[38]  Alex Pentland,et al.  A vision system for observing and extracting facial action parameters , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[39]  David Beymer,et al.  Face recognition under varying pose , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Alex Pentland,et al.  View-based and modular eigenspaces for face recognition , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Yehezkel Yeshurun,et al.  Normalization of face images using few anchors , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[42]  Christoph von der Malsburg,et al.  Single-View Based Recognition of Faces Rotated in Depth , 1995 .

[43]  David Beymer,et al.  Vectorizing Face Images by Interleaving Shape and Texture Computations , 1995 .

[44]  T Poggio,et al.  View-based models of 3D object recognition: invariance to imaging transformations. , 1995, Cerebral cortex.

[45]  Tomaso A. Poggio,et al.  Model-based matching of line drawings by linear combinations of prototypes , 1995, Proceedings of IEEE International Conference on Computer Vision.

[46]  Shimon Edelman,et al.  Receptive field spaces and class-based generalization from a single view in face recognition , 1995 .

[47]  Timothy F. Cootes,et al.  A unified approach to coding and interpreting face images , 1995, Proceedings of IEEE International Conference on Computer Vision.

[48]  Tomaso A. Poggio,et al.  Regularization Theory and Neural Networks Architectures , 1995, Neural Computation.

[49]  S. Ullman,et al.  Generalization to Novel Images in Upright and Inverted Faces , 1993, Perception.

[50]  Tomaso A. Poggio,et al.  Linear Object Classes and Image Synthesis From a Single Example Image , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[51]  Roberto Brunelli,et al.  Estimation of pose and illuminant direction for face processing , 1994, Image Vis. Comput..