Reading cursive handwriting by alignment of letter prototypes

We describe a new approach to the visual recognition of cursive handwriting. An effort is made to attain human-like performance by using a method based on pictorial alignment and on a model of the process of handwriting. The alignment approach permits recognition of character instances that appear embedded in connected strings. A system embodying this approach has been implemented and tested on five different word sets. The performance was stable both across words and across writers. The system exhibited a substantial ability to interpret cursive connected strings without recourse to lexical knowledge.

[1]  Murray Eden.  On the formalization of handwriting , 1961 .

[2]  Kenneth N. Stevens,et al.  Speech recognition: A model and a program for research , 1962, IRE Trans. Inf. Theory.

[3]  C. Zwikker.  The Advanced Geometry of Plane Curves and Their Applications , 1963 .

[4]  C. D. Boor,et al.  On splines and their minimum properties , 1966 .

[5]  S. Karlin,et al.  The fundamental theorem of algebra for monosplines satisfying boundary conditions , 1972 .

[6]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[7]  Alfred V. Aho,et al.  The Design and Analysis of Computer Algorithms , 1974 .

[8]  Adi Ben-Israel,et al.  Generalized inverses: theory and applications , 1974 .

[9]  Allen R. Hanson,et al.  Context in word recognition , 1976, Pattern Recognition.

[10]  Theodosios Pavlidis,et al.  Structural pattern recognition , 1977 .

[11]  King-Sun Fu,et al.  Shape Discrimination Using Fourier Descriptors , 1977, IEEE Trans. Syst. Man Cybern..

[12]  King-Sun Fu,et al.  Shape Discrimination Using Fourier Descriptors , 1977, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  D. C. Olivier,et al.  Pronounceability and Statistical "Englishness" as Determinants of Letter Identification , 1978 .

[14]  F. Bookstein,et al.  The Measurement of Biological Shape and Shape Change. , 1980 .

[15]  A. Paivio.  THE RELATIONSHIP BETWEEN VERBAL AND PERCEPTUAL CODES , 1978 .

[16]  F. Bookstein,et al.  The Measurement of Biological Shape and Shape Change. , 1979 .

[17]  Jacques Duvernoy,et al.  Stability and stationarity of cursive handwriting , 1979, Pattern Recognit..

[18]  Kenneth C Hayes,et al.  Reading handwritten words using hierarchical relaxation , 1980 .

[19]  M. Berthod,et al.  Automatic recognition of handprinted characters—The state of the art , 1980, Proceedings of the IEEE.

[20]  David J. Burr,et al.  Elastic Matching of Line Drawings , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Eric L. W. Grimson,et al.  From Images to Surfaces: A Computational Study of the Human Early Visual System , 1981 .

[22]  Neville Hogan,et al.  Control and Coordination of Voluntary Arm Movements , 1982, 1982 American Control Conference.

[23]  Jean Serra,et al.  Image Analysis and Mathematical Morphology , 1983 .

[24]  C Y Suen,et al.  Handwriting generation, perception and recognition. , 1983, Acta psychologica.

[25]  D. J. Burr,et al.  Matching Elastic Templates , 1983 .

[26]  Tamar Yashin-Flash,et al.  Organizing principles underlying the formation of arm trajectories , 1983 .

[27]  N. Hogan.  An organizing principle for a class of voluntary movements , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[28]  Irving Biederman,et al.  Human image understanding: Recent research and a theory , 1985, Comput. Vis. Graph. Image Process..

[29]  Fred Stentiford,et al.  Automatic Feature Design for Optical Character Recognition Using an Evolutionary Search Procedure , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[31]  Su-Shing Chen,et al.  Shape and motion of nonrigid bodies , 1986, Comput. Vis. Graph. Image Process..

[32]  Shimon Ullman,et al.  An Approach to Object Recognition: Aligning Pictorial Descriptions , 1986 .

[33]  Tomaso A. Poggio,et al.  On Edge Detection , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Theodosios Pavlidis,et al.  On the Recognition of Printed Characters of Any Font and Size , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  W. Eric L. Grimson,et al.  Localizing Overlapping Parts by Searching the Interpretation Tree , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Sargur N. Srihari,et al.  A Multi-Level Perception Approach to Reading Cursive Script , 1987, IJCAI.

[37]  Shimon Ullman,et al.  Structural Saliency: The Detection Of Globally Salient Structures using A Locally Connected Network , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[38]  D. Foster.  An approach to the analysis of the underlying structure of visual space using a generalized notion of visual pattern recognition , 2004, Biological Cybernetics.

[39]  Shimon Edelman,et al.  A model of handwriting , 2004, Biological Cybernetics.