Decision Combination in Multiple Classifier Systems

A multiple classifier system is a powerful solution to difficult pattern recognition problems involving large class sets and noisy input because it allows simultaneous use of arbitrary feature descriptors and classification procedures. Decisions by the classifiers can be represented as rankings of classifiers and different instances of a problem. The rankings can be combined by methods that either reduce or rerank a given set of classes. An intersection method and union method are proposed for class set reduction. Three methods based on the highest rank, the Borda count, and logistic regression are proposed for class set reranking. These methods have been tested in applications of degraded machine-printed characters and works from large lexicons, resulting in substantial improvement in overall correctness. >

[1]  D. Black.  The theory of committees and elections , 1959 .

[2]  G. Thompson,et al.  The Theory of Committees and Elections. , 1959 .

[3]  David R. Cox.  The analysis of binary data , 1970 .

[4]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[5]  B. Efron.  The Efficiency of Logistic Regression Compared to Normal Discriminant Analysis , 1975 .

[6]  R. Haralick.  The table look-up rule , 1976 .

[7]  S. J. Press,et al.  Choosing between Logistic Regression and Discriminant Analysis , 1978 .

[8]  J. Anderson,et al.  Regression, Discrimination and Measurement Models for Ordered Categorical Variables , 1981 .

[9]  J. Anderson.  Regression and Ordered Categorical Variables , 1984 .

[10]  D. Pregibon,et al.  Graphical Methods for Assessing Logistic Regression Models , 1984 .

[11]  R. Meddis.  Statistics Using Ranks: A Unified Approach , 1984 .

[12]  S. Hora.  Statistical Inference Based on Ranks , 1986 .

[13]  Vladimir D. Mazurov,et al.  Solving of optimization and identification problems by the committee methods , 1987, Pattern Recognit..

[14]  E. Mandler,et al.  Combining the Classification Results of Independent Classifiers Based on the Dempster/Shafer Theory of Evidence , 1988 .

[15]  David W. Hosmer,et al.  Applied Logistic Regression , 1991 .

[16]  D. Cox,et al.  Analysis of Binary Data (2nd ed.). , 1990 .

[17]  Ching Y. Suen,et al.  Complementary algorithms for the recognition of totally unconstrained handwritten numerals , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[18]  Sargur N. Srihari,et al.  Combination of Structural Classifiers , 1990 .

[19]  Fumitaka Kimura,et al.  Handwritten numerical recognition based on multiple algorithms , 1991, Pattern Recognit..

[20]  Sargur N. Srihari,et al.  A word shape analysis approach to lexicon based word recognition , 1992, Pattern Recognit. Lett..

[21]  Sargur N. Srihari,et al.  Regression approach to combination of decisions by multiple character recognition algorithms , 1992, Electronic Imaging.

[22]  T. Ho.  A theory of multiple classifier systems and its application to visual word recognition , 1992 .

[23]  Sargur N. Srihari,et al.  Combination of Decisions by Multiple Classifiers , 1992 .

[24]  Sargur N. Srihari,et al.  On multiple classifier systems for pattern recognition , 1992, Proceedings., 11th IAPR International Conference on Pattern Recognition. Vol.II. Conference B: Pattern Recognition Methodology and Systems.

[25]  K D Wernecke,et al.  A coupling procedure for the discrimination of mixed data. , 1992, Biometrics.

[26]  Adam Krzyżak,et al.  Methods of combining multiple classifiers and their applications to handwriting recognition , 1992, IEEE Trans. Syst. Man Cybern..

[27]  D. Hosmer,et al.  Applied Logistic Regression , 1991 .