An HMM-Based Approach for Off-Line Unconstrained Handwritten Word Modeling and Recognition

Describes a hidden Markov model-based approach designed to recognize off-line unconstrained handwritten words for large vocabularies. After preprocessing, a word image is segmented into letters or pseudoletters and represented by two feature sequences of equal length, each consisting of an alternating sequence of shape-symbols and segmentation-symbols, which are both explicitly modeled. The word model is made up of the concatenation of appropriate letter models consisting of elementary HMMs and an HMM-based interpolation technique is used to optimally combine the two feature sets. Two rejection mechanisms are considered depending on whether or not the word image is guaranteed to belong to the lexicon. Experiments carried out on real-life data show that the proposed approach can be successfully used for handwritten word recognition.

[1]  Fumitaka Kimura,et al.  Improvements of a lexicon directed algorithm for recognition of unconstrained handwritten words , 1993, Proceedings of 2nd International Conference on Document Analysis and Recognition (ICDAR '93).

[2]  J.-C. Simon,et al.  Off-line cursive word recognition , 1992, Proc. IEEE.

[3]  J. Picone,et al.  Continuous speech recognition using hidden Markov models , 1990, IEEE ASSP Magazine.

[4]  Louis A. Liporace,et al.  Maximum likelihood estimation for multivariate observations of Markov sources , 1982, IEEE Trans. Inf. Theory.

[5]  Paul D. Gader,et al.  Handwritten Word Recognition Using Segmentation-Free Hidden Markov Modeling and Segmentation-Based Dynamic Programming Techniques , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Kin Hong Wong,et al.  Script recognition using hidden Markov models , 1986, ICASSP '86. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[7]  Sargur N. Srihari,et al.  Off-Line Cursive Script Word Recognition , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Abdenaim El Yacoubi,et al.  Improved model architecture and training phase in an off-line HMM-based word recognition system , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[9]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[10]  Xuedong Huang,et al.  Semi-continuous hidden Markov models for speech signals , 1990 .

[11]  T. Moon The expectation-maximization algorithm , 1996, IEEE Signal Process. Mag..

[12]  Horst Bunke,et al.  Off-line cursive handwriting recognition using hidden markov models , 1995, Pattern Recognit..

[13]  Jin Hyung Kim,et al.  Recognition of Unconstrained Handwritten English Words with Character and Ligature Modeling , 1995, Int. J. Pattern Recognit. Artif. Intell..

[14]  Lalit R. Bahl,et al.  A Maximum Likelihood Approach to Continuous Speech Recognition , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Jin Hyung Kim,et al.  Modeling and recognition of cursive words with hidden Markov models , 1995, Pattern Recognit..

[16]  Jian Zhou,et al.  Off-Line Handwritten Word Recognition Using a Hidden Markov Model Type Stochastic Network , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Amlan Kundu,et al.  HANDWRITTEN WORD RECOGNITION USING HIDDEN MARKOV MODEL , 1997 .

[18]  Sargur N. Srihari,et al.  Variable duration hidden Markov model and morphological segmentation for handwritten word recognition , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Jr. G. Forney,et al.  The viterbi algorithm , 1973 .

[20]  S. Srihari,et al.  Variable duration hidden markov model and morphological segmentation for handwritten word recognition , 1995, IEEE Transactions on Image Processing.

[21]  L. Yang,et al.  Application of hidden Markov models for signature verification , 1995, Pattern Recognit..

[22]  R. Gray,et al.  Vector quantization , 1984, IEEE ASSP Magazine.

[23]  Ching Y. Suen,et al.  Bank check processing system , 1996 .

[24]  Heinrich Niemann,et al.  Das ISADORA-System - ein akustisch-phonetisches Netzwerk zur automatischen Spracherkennung , 1991, DAGM-Symposium.