Experiments with adaptation strategies for a prototype-based recognition system for isolated handwritten characters

Abstract. This paper describes an adaptive recognition system for isolated handwritten characters and the experiments carried out with it. The characters used in our experiments are alphanumeric characters, including both the upper- and lower-case versions of the Latin alphabets and three Scandinavian diacriticals. The writers are allowed to use their own natural style of writing. The recognition system is based on the k-nearest neighbor rule. The six character similarity measures applied by the system are all based on dynamic time warping. The aim of the first experiments is to choose the best combination of the simple preprocessing and normalization operations and the dissimilarity measure for a multi-writer system. However, the main focus of the work is on online adaptation. The purpose of the adaptations is to turn a writer-independent system into writer-dependent and increase recognition performance. The adaptation is carried out by modifying the prototype set of the classifier according to its recognition performance and the user's writing style. The ways of adaptation include: (1) adding new prototypes; (2) inactivating confusing prototypes; and (3) reshaping existing prototypes. The reshaping algorithm is based on the Learning Vector Quantization. Four different adaptation strategies, according to which the modifications of the prototype set are performed, have been studied both offline and online. Adaptation is carried out in a self-supervised fashion during normal use and thus remains unnoticed by the user.

[1]  Isabelle Guyon,et al.  UNIPEN project of on-line data exchange and recognizer benchmarks , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[2]  Shane S. Sturrock,et al.  Time Warps, String Edits, and Macromolecules – The Theory and Practice of Sequence Comparison . David Sankoff and Joseph Kruskal. ISBN 1-57586-217-4. Price £13.95 (US$22·95). , 2000 .

[3]  Erkki Oja,et al.  Adaptation of Prototype Sets in On-line Recognition of Isolated Handwritten Latin Characters , 1999 .

[4]  Ulric Neisser,et al.  A Note on Human Recognition of Hand-Printed Characters , 1960, Inf. Control..

[5]  Hiroki Arakawa On-line recognition of handwritten characters - alphanumerics, Hiragana, Katakana, Kanji , 1983, Pattern Recognit..

[6]  Charles C. Tappert Speed, Accuracy, and Flexibility Trade-Offs in on-Line Character Recognition , 1991, Int. J. Pattern Recognit. Artif. Intell..

[7]  Clive Frankish,et al.  Recognition accuracy and user acceptance of pen interfaces , 1995, CHI '95.

[8]  Erkki Oja,et al.  Comparison of Adaptive Strategies for On-Line Character Recognition , 1998 .

[9]  Marc Parizeau,et al.  Machine vs humans in a cursive script reading experiment without linguistic knowledge , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[10]  C. G. Hilborn,et al.  The Condensed Nearest Neighbor Rule , 1967 .

[11]  J. L. Hodges,et al.  Discriminatory Analysis - Nonparametric Discrimination: Consistency Properties , 1989 .