A 2-D HMM Method for Offline Handwritten Character Recognition

In this paper we consider a hidden Markov mesh random field (HMMRF) for character recognition. The model consists of a "hidden" Markov mesh random field (MMRF) and on overlying probabilistic observation function of the MMRF. Just like the 1-D HMM, the hidden layer is characterized by the initial and the transition probability distributions, and the ovservation layer is defined by distribution functions for vector-quantized (VQ) observations. The HMMRF-based method consists of two phases: decoding and training. The decoding and the training algorithms are developed using dynamic programming and maximum likelihood estimation methods. To accelerate the computation in both phases, we employed a look-ahead scheme based on maximum marginal a posteriori probability criterion for third-order HMMRF. Tested on a largetst-set handwritten Korean Hangul character database, the model showed a promising result: up to 87.2% recognition rate with 8 state HMMRF and 128 VQ levels.

[1]  Jinhai Cai,et al.  Markov random field models for handwritten word recognition , 1997, 1997 IEEE International Conference on Intelligent Processing Systems (Cat. No.97TH8335).

[2]  Seong-Whan Lee,et al.  Off-line recognition of large-set handwritten characters with multiple hidden Markov models , 1996, Pattern Recognition.

[3]  Angelo Chianese,et al.  Recovering dynamic information from static handwriting , 1993, Pattern Recognit..

[4]  Robert Sabourin,et al.  An HMM-Based Approach for Off-Line Unconstrained Handwritten Word Modeling and Recognition , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Abdel Belaïd,et al.  Performance evaluation of an HMM based OCR system , 1992, Proceedings., 11th IAPR International Conference on Pattern Recognition. Vol.II. Conference B: Pattern Recognition Methodology and Systems.

[6]  Jin Hyung Kim,et al.  Modeling and recognition of cursive words with hidden Markov models , 1995, Pattern Recognit..

[7]  Oscar E. Agazzi,et al.  Keyword Spotting in Poorly Printed Documents using Pseudo 2-D Hidden Markov Models , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[9]  Oscar E. Agazzi,et al.  Hidden markov model based optical character recognition in the presence of deterministic transformations , 1993, Pattern Recognit..

[10]  A. Kundu,et al.  Recognition of handwritten script: a hidden Markov model based approach , 1988, ICASSP-88., International Conference on Acoustics, Speech, and Signal Processing.

[11]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[12]  Shyh-shiaw Kuo,et al.  Degraded Gray-Scale Text Recognition Using Pseudo-2D Hidden Markov Models and N-Best Hypotheses , 1995, CVGIP Graph. Model. Image Process..

[13]  Pierre A. Devijver,et al.  Hidden Markov mesh random field models in image analysis , 1993 .

[14]  Chinmoy B. Bose,et al.  Connected and degraded text recognition using hidden Markov model , 1992, Proceedings., 11th IAPR International Conference on Pattern Recognition. Vol.II. Conference B: Pattern Recognition Methodology and Systems.

[15]  Rolf-Dieter Bippus 1-dimensional and pseudo 2-dimensional HMMs for the recognition of German literal amounts , 1997, Proceedings of the Fourth International Conference on Document Analysis and Recognition.

[16]  F. Jelinek,et al.  Continuous speech recognition by statistical methods , 1976, Proceedings of the IEEE.

[17]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[18]  Roberto Pieraccini,et al.  Dynamic planar warping for optical character recognition , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[19]  Jian Zhou,et al.  Off-Line Handwritten Word Recognition Using a Hidden Markov Model Type Stochastic Network , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Paramvir Bahl,et al.  Recognition of handwritten word: first and second order hidden Markov model based approach , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Seong-Whan Lee,et al.  Gray-Scale Nonlinear Shape Normalization Method for Handwritten Oriental Character Recognition , 1998, Int. J. Pattern Recognit. Artif. Intell..

[22]  Seong-Whan Lee,et al.  A truly 2-D hidden Markov model for off-line handwritten character recognition , 1998, Pattern Recognit..