Audio- and Video-Based Biometric Person Authentication

We propose a novel approach to face identification and verification based on the Error Correcting Output Coding (ECOC) classifier design concept. In the training phase the client set is repeatedly divided into two ECOC specified sub-sets (super-classes) to train a set of binary classifiers. The output of the classifiers defines the ECOC feature space, in which it is easier to separate transformed patterns representing clients and impostors. As a matching score in this space we propose the average first order Minkowski distance between the probe and gallery images. The proposed method exhibits superior verification performance on the well known XM2VTS data set as compared with previously reported results.

[1]  Biing-Hwang Juang,et al.  Pattern recognition using a family of design algorithms based upon the generalized probabilistic descent method , 1998, Proc. IEEE.

[2]  Kiyoharu Aizawa,et al.  An intelligent facial image coding driven by speech and phoneme , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[3]  Anil K. Jain,et al.  Combining multiple matchers for a high security fingerprint verification system , 1999, Pattern Recognit. Lett..

[4]  Anil K. Jain,et al.  Fingerprint Image Enhancement: Algorithm and Performance Evaluation , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  King-Sun Fu,et al.  A Tree System Approach for Fingerprint Pattern Recognition , 1976, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  James L. Wayman,et al.  Technical Testing and Evaluation of Biometric Identification Devices , 1996 .

[7]  Robert P. Chiralo,et al.  Adaptive Digital Enhancement Of Latent Fingerprints , 1978, Optics & Photonics.

[8]  B. Sherlock,et al.  Fingerprint enhancement by directional Fourier filtering , 1994 .

[9]  A.S. Sherstinsky,et al.  M-lattice: from morphogenesis to image processing , 1996, IEEE Trans. Image Process..

[10]  Dario Maio,et al.  Synthetic fingerprint-image generation , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[11]  Anil K. Jain,et al.  FVC2000: Fingerprint Verification Competition , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Homer H. Chen,et al.  Speech recognition for image animation and coding , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[13]  F T Gamble,et al.  Real-time fingerprint verification system. , 1992, Applied optics.

[14]  Gerasimos Potamianos,et al.  Discriminative training of HMM stream exponents for audio-visual speech recognition , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[15]  Anil K. Jain,et al.  A Real-Time Matching System for Large Fingerprint Databases , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Rama Chellappa,et al.  A feature based approach to face recognition , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Sharath Pankanti,et al.  Minutia verification and classification for fingerprint matching , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[18]  J. Daugman Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[19]  MITCHELL TRAURING,et al.  Automatic Comparison of Finger-Ridge Patterns , 1963, Nature.

[20]  T. Parthasarathy,et al.  Development of a Mathematical Formula for the Calculation of Fingerprint Probabilities Based on Individual Characteristics , 1977 .

[21]  Ruud M. Bolle Improved Fingerprint Matching by Distortion Removal , 2001 .

[22]  Sharath Pankanti,et al.  Filterbank-based fingerprint matching , 2000, IEEE Trans. Image Process..

[23]  Lawrence O'Gorman 2 FINGERPRINT VERIFICATION , 1998 .

[24]  Anil K. Jain,et al.  Decision-Level Fusion in Fingerprint Verification , 2001, Multiple Classifier Systems.

[25]  Takefumi Inagaki,et al.  Holographic Fingerprint Sensor , 1989, Photonics West - Lasers and Applications in Science and Engineering.

[26]  Tsuhan Chen,et al.  Audio-visual interaction in multimedia communication , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[27]  T. Minami,et al.  Fingerprint classification by directional distribution patterns , 1982 .

[28]  Alexander H. Waibel,et al.  See Me, Hear Me: Integrating Automatic Speech Recognition and Lip-reading , 1994 .

[29]  James A. McHugh,et al.  Automated fingerprint recognition using structural matching , 1990, Pattern Recognit..

[30]  Anil K. Jain,et al.  Integrating Faces and Fingerprints for Personal Identification , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Stanley Coren,et al.  Are fingerprints a genetic marker for handedness? , 1994, Behavior genetics.

[32]  Craig I. Watson,et al.  Neural Network Fingerprint Classification , 1994 .

[33]  Javier Hernando,et al.  Maximum likelihood weighting of dynamic speech features for CDHMM speech recognition , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[34]  D. McCulloch,et al.  Novel fingerprint scanning arrays using polysilicon TFT's on glass and polymer substrates , 1997, IEEE Electron Device Letters.

[35]  T Inagaki,et al.  Real-time fingerprint sensor using a hologram. , 1992, Applied optics.

[36]  Sunanda Mitra,et al.  A Novel Approach to Fourier Spectral Enhancement of Laser-Luminescent Fingerprint Images , 1993 .

[37]  L. Hong,et al.  Can multibiometrics improve performance , 1999 .

[38]  Tai Sing Lee,et al.  Image Representation Using 2D Gabor Wavelets , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  B. Chatterjee,et al.  Automatic Fingerprint Identification , 1991 .

[40]  King-Sun Fu,et al.  An application of stochastic languages to fingerprint pattern recognition , 1976, Pattern Recognit..

[41]  Robert S. Germain,et al.  Fingerprint matching using transformation parameter clustering , 1997 .

[42]  Anil K. Jain,et al.  Classification of Fingerprint Images , 1999 .

[43]  Lawrence O'Gorman,et al.  An approach to fingerprint filter design , 1989, Pattern Recognit..

[44]  Donald H. McMahon,et al.  A Hybrid Optical Computer Processing Technique for Fingerprint Identification , 1975, IEEE Transactions on Computers.

[45]  Anil K. Jain,et al.  Fingerprint classification , 1996, Pattern Recognit..

[46]  Sharath Pankanti,et al.  Twin Test: On Discriminability of Fingerprints , 2001, AVBPA.

[47]  Vladimír Székely,et al.  Image recognition problems of fingerprint identification , 1993, Microprocess. Microsystems.

[48]  Qin-Zhong Ye,et al.  Rotation-invariant operators applied to enhancement of fingerprints , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[49]  Alexandrina Rogozan,et al.  Asynchronous integration of visual information in an automatic speech recognition system , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[50]  Arun Ross,et al.  Fingerprint matching using minutiae and texture features , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[51]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[52]  Pierre Baldi,et al.  Neural Networks for Fingerprint Recognition , 1993, Neural Computation.

[53]  A. Senior,et al.  A hidden Markov model fingerprint classifier , 1997, Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136).

[54]  J H Wegstein,et al.  The M40 fingerprint matcher , 1975 .

[55]  Sharath Pankanti,et al.  Hierarchical partitioned least squares filter-bank for fingerprint enhancement , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[56]  Satoshi Nakamura,et al.  Speech to lip movement synthesis by HMM , 1997, AVSP ...

[57]  Martin J. Russell,et al.  Integrating audio and visual information to provide highly robust speech recognition , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[58]  Weimin Huang,et al.  A robust approach to face and eyes detection from images with cluttered background , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[59]  Michael J. Lyons,et al.  Automatic Classification of Single Facial Images , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[60]  Anil K. Jain,et al.  On-line fingerprint verification , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[61]  Anil K. Jain,et al.  A Multichannel Approach to Fingerprint Classification , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[62]  F. Lavagetto,et al.  Converting speech into lip movements: a multimedia telephone for hard of hearing people , 1995 .

[63]  Malcolm K. Sparrow,et al.  A topological approach to the matching of single fingerprints: development of algorithms for use on latent fingermarks , 1985 .

[64]  Craig I. Watson,et al.  PCASYS- A Pattern-Level Classification Automation System for Fingerprints | NIST , 1995 .

[65]  H. Imai,et al.  A Fast Automatic Fingerprint Identification Method Based on a Weighted-Mean of Binary Image , 1993 .

[66]  Dario Maio,et al.  Combining Fingerprint Classifiers , 2000, Multiple Classifier Systems.

[67]  D.C.D. Hung,et al.  Enhancement and feature purification of fingerprint images , 1993, Pattern Recognit..

[68]  B. Sherlock,et al.  Algorithm for enhancing fingerprint images , 1992 .

[69]  Akio Tojo,et al.  Fingerprint pattern classification , 1984, Pattern Recognit..

[70]  Sharath Pankanti,et al.  An identity-authentication system using fingerprints , 1997, Proc. IEEE.

[71]  Dario Maio,et al.  A structural approach to fingerprint classification , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[72]  Sharath Pankanti,et al.  Verification watermarks on fingerprint recognition and retrieval , 1999, Electronic Imaging.

[73]  Louis Coetzee,et al.  Fingerprint recognition in low quality images , 1993, Pattern Recognit..

[74]  R. J. Green,et al.  Fingerprint classification using a hexagonal fast fourier transform , 1996, Pattern Recognit..

[75]  C. V. Kameswara Rao,et al.  Type Classification of Fingerprints: A Syntactic Approach , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[76]  T. Kamei,et al.  Image filter design for fingerprint enhancement , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[77]  Anil K. Jain,et al.  Adaptive flow orientation-based feature extraction in fingerprint images , 1995, Pattern Recognit..

[78]  Bernhard Fröba,et al.  SESAM: A Biometric Person Identification System Using Sensor Fusion , 1997, AVBPA.

[79]  Norbert Krüger,et al.  Face Recognition by Elastic Bunch Graph Matching , 1997, CAIP.

[80]  Sargur N. Srihari,et al.  On multiple classifier systems for pattern recognition , 1992, Proceedings., 11th IAPR International Conference on Pattern Recognition. Vol.II. Conference B: Pattern Recognition Methodology and Systems.

[81]  Tsuhan Chen,et al.  Cross-modal prediction in audio-visual communication , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[82]  Hiroshi Harashima,et al.  A Media Conversion from Speech to Facial Image for Intelligent Man-Machine Interface , 1991, IEEE J. Sel. Areas Commun..

[83]  Keiichi Tokuda,et al.  Audio-visual speech recognition using MCE-based hmms and model-dependent stream weights , 2000, INTERSPEECH.

[84]  Dario Maio,et al.  Direct Gray-Scale Minutiae Detection In Fingerprints , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[85]  Keith Waters,et al.  Driving synthetic mouth gestures: phonetic recognition for faceme! , 1997, EUROSPEECH.