Learning-based cursive handwriting synthesis

In this paper an integrated approach for modeling, learning and synthesizing personal cursive handwriting is proposed. Cursive handwriting is modeled by a tri-unit handwriting model, which focuses on both the handwritten letters and the interconnection strokes of adjacent letters. Handwriting strokes are formed from generative models that are based on control points and B-spline curves. In the two-step learning process, a template-based matching algorithm and a data congealing algorithm are first proposed to extract training vectors from handwriting samples, and then letter style models and concatenation style models are trained separately. In the synthesis process, isolated letters and ligature strokes are generated from the learned models and concatenated with each other to produce the whole word trajectory, with guidance from a deformable model. Experimental results show that the proposed system can effectively learn the individual style of cursive handwriting and has the ability to generate novel handwriting of the same style.

[1]  Geoffrey E. Hinton,et al.  Using Generative Models for Handwritten Digit Recognition , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Homayoon Sadr Mohammed Beigi,et al.  Pre-Processing The Dynamics Of On-Line Handwriting Data, Feature Extraction And Recognition , 1996 .

[3]  Réjean Plamondon,et al.  An evaluation of motor models of handwriting , 1989, IEEE Trans. Syst. Man Cybern..

[4]  Mehdi Hatamian,et al.  Optical character recognition by the method of moments , 1987 .

[5]  Anil K. Jain,et al.  Representation and Recognition of Handwritten Digits Using Deformable Templates , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Réjean Plamondon,et al.  The Delta LogNormal theory for the generation and modeling of cursive characters , 1995, Proceedings of 3rd International Conference on Document Analysis and Recognition.

[7]  Yoram Singer,et al.  Dynamical encoding of cursive handwriting , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[8]  K Fukushima,et al.  Handwritten alphanumeric character recognition by the neocognitron , 1991, IEEE Trans. Neural Networks.

[9]  Paul Taylor,et al.  Automatically clustering similar units for unit selection in speech synthesis , 1997, EUROSPEECH.

[10]  Isabelle Guyon Handwriting Synthesis From Handwritten Glyphs , 1996 .

[11]  Paul A. Viola,et al.  Learning from one example through shared densities on transforms , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[12]  Dit-Yan Yeung,et al.  A Bayesian Framework for Deformable Pattern Recognition With Application to Handwritten Character Recognition , 1998, IEEE Trans. Pattern Anal. Mach. Intell..