Handwriting recognition or reading? What is the situation at the dawn of the 3rd millenium?

Abstract. During the last forty years, Human Handwriting Processing (HHP) has most often been investigated under the frameworks of character (OCR) and pattern recognition. In recent years considerable progress has been made, and to date HHP can be viewed much more as an automatic Handwriting Reading (HR) task for the machine. In this paper we propose the use of handwriting invariants, a physical model for a first segmentation, a logical model for segmentation and recognition, a fundamental equation of handwriting, and to integrate several sources of perception and of knowledge in order to design Handwriting Reading Systems (HRS), which would be more universal systems than is currently the case. At the dawn of the 3rd millennium, we guess that HHP will be considered more as a perceptual and interpretation task requiring knowledge gained from studies on human language. This paper gives some guidelines and presents examples to design systems able to perceive and interpret, i.e., read, handwriting automatically.

[1]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[2]  Stefan Jäger,et al.  Recovering writing traces in off-line handwriting recognition: using a global optimization technique , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[3]  G. Lorette,et al.  COHERENT KNOWLEDGE SOURCE INTEGRATION THROUGH PERCEPTUAL CYCLE FRAMEWORK FOR HANDWRITING RECOGNITION , 1999 .

[4]  M. Berthod,et al.  Automatic recognition of handprinted characters—The state of the art , 1980, Proceedings of the IEEE.

[5]  F. J. Maarse,et al.  Produced and perceived writing slant: difference between up and down strokes. , 1983, Acta psychologica.

[6]  Patrick S.-P. Wang.  Character And Handwriting Recognition: Expanding Frontiers , 1991 .

[7]  Eric Wagner,et al.  Open computing , 1991 .

[8]  Paul D. Gader,et al.  A fuzzy logic system for the detection and recognition of handwritten street numbers , 1995, IEEE Trans. Fuzzy Syst..

[9]  Ching Y. Suen,et al.  The State of the Art in Online Handwriting Recognition , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  C. Viard-Gaudin,et al.  OFF-LINE HANDWRITING MODELING AS A TRAJECTORY TRACKING PROBLEM , 1999 .

[11]  Manfredo P. do Carmo,et al.  Differential geometry of curves and surfaces , 1976 .

[12]  R. Thom.  Structural stability and morphogenesis , 1977, Pattern Recognition.

[13]  LAMBERT R. B. SCHOMAKER,et al.  A computational model of cursive handwriting , 1987 .

[14]  Isabelle Guyon,et al.  Design of a linguistic postprocessor using variable memory length Markov models , 1995, Proceedings of 3rd International Conference on Document Analysis and Recognition.

[15]  Roger W. Ehrich,et al.  Experiments in the Contextual Recognition of Cursive Script , 1975, IEEE Transactions on Computers.

[16]  Andrew W. Ellis,et al.  “Afferent dysgraphia” in a patient and in normal subjects , 1987 .

[17]  Chikahito Nakajima,et al.  Extraction of salient apexes from an image by using the function at the primary visual cortex , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[18]  Lindsay J. Evett,et al.  Fast dictionary look-up for contextual word recognition , 1990, Pattern Recognit..

[19]  René Thom,et al.  Modèles mathématiques de la morphogénèse , 1971 .

[20]  Georges Jean,et al.  L'écriture, mémoire des hommes , 1987 .

[21]  F. Mermelstein,et al.  A System for Automatic Recognition of Handwritten Words , 1899 .

[22]  Réjean Plamondon,et al.  A kinematic theory of rapid human movements , 1995, Biological Cybernetics.

[23]  Éric Anquetil,et al.  Perceptual model of handwriting drawing. Application to the handwriting segmentation problem , 1997, Proceedings of the Fourth International Conference on Document Analysis and Recognition.

[24]  Guy Lorette,et al.  A new modeling method for on-line handwriting recognition , 1995, Proceedings of 3rd International Conference on Document Analysis and Recognition.

[25]  F. Attneave.  Some informational aspects of visual perception. , 1954, Psychological review.

[26]  David Malcolm Ford,et al.  On-line recognition of connected handwriting , 1991 .

[27]  R. Thom.  Stabilité structurelle et morphogénèse : essai d'une théorie générale des modèles , 1977 .

[28]  Ching Y. Suen,et al.  Automatic reading of cursive scripts using a reading model and perceptual concepts , 1998, International Journal on Document Analysis and Recognition.

[29]  Nasser Sherkat,et al.  Multiple recognizer combination topologies , 1996 .

[30]  Robert S. Ledley,et al.  Special issue on Optical Character Recognition , 1970, Pattern Recognit..

[31]  Almuth Grésillon.  Éléments de critique génétique : lire les manuscrits modernes , 1994 .

[32]  C. B. Wilson,et al.  The mathematical description of shape and form , 1984 .

[33]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Azriel Rosenfeld,et al.  Recovery of temporal information from static images of handwriting , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[35]  R. Thom.  Stabilité structurelle et morphogenèse , 1974 .

[36]  Réjean Plamondon,et al.  A kinematic theory of rapid human movements , 1995, Biological Cybernetics.

[37]  George M. Miller.  Real-Time Classification of Handwritten Script Words , 1971, IFIP Congress.

[38]  Kenneth C Hayes,et al.  Reading handwritten words using hierarchical relaxation , 1980 .

[39]  Graham Leedham.  AUTOMATIC RECOGNITION AND TRANSCRIPTION OF PITMAN'S HANDWRITTEN SHORTHAND , 1990 .

[40]  C. H. Chen,et al.  Handbook of Pattern Recognition and Computer Vision , 1993 .

[41]  Yi Lu,et al.  Character segmentation in handwritten words - An overview , 1996, Pattern Recognit..

[42]  Kenneth M. Sayre,et al.  Machine recognition of handwritten words: A project report , 1973, Pattern Recognit..

[43]  David J. Burr,et al.  Designing a Handwriting Reader , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.