Using Dempster-Shafer Theory in MCF Systems to Reject Samples

In this paper the Dempster-Shafer theory of evidence is utilised in multiple classifier systems to define rejection criteria for samples presented for classification. The DS theory offers the possibility to derive a measure of contradiction between the classifier decisions to be fused. Moreover, assigning positive belief mass to the universal hypothesis Θ in the basic probability assignments produced by the classifiers, allows to quantify the belief in their correctness. Both criteria have been evaluated by numerical simulations on two different benchmark data sets. The results are compared to standard static classifier combination schemes and basic classifiers. It is shown that DS classifier fusion can boost the combined classifier accuracy to 100% on the set of accepted data points (~ 70%). This behaviour could be of interest in applications with high costs for a miss, e.g. in medical screening tests.

[1]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[2]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[3]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[4]  E. Mandler,et al.  Combining the Classification Results of Independent Classifiers Based on the Dempster/Shafer Theory of Evidence , 1988 .

[5]  Adam Krzyżak,et al.  Methods of combining multiple classifiers and their applications to handwriting recognition , 1992, IEEE Trans. Syst. Man Cybern..

[6]  L. Zadeh Fuzzy sets as a basis for a theory of possibility , 1999 .

[7]  James C. Bezdek,et al.  Decision templates for multiple classifier fusion: an experimental comparison , 2001, Pattern Recognit..

[8]  Günther Palm,et al.  Decision templates for the classification of bioacoustic time series , 2003, Inf. Fusion.

[9]  Mongi A. Abidi,et al.  Data fusion in robotics and machine intelligence , 1992 .

[10]  Isabelle Bloch Information combination operators for data fusion: a comparative review with classification , 1996, IEEE Trans. Syst. Man Cybern. Part A.

[11]  Thierry Denoeux,et al.  A neural network classifier based on Dempster-Shafer theory , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[12]  G. McLachlan,et al.  Pattern Classification: A Unified View of Statistical and Neural Approaches. , 1998 .

[13]  Isabelle Bloch,et al.  Sensor fusion in anti-personnel mine detection using a two-level belief function model , 2003, IEEE Trans. Syst. Man Cybern. Part C.

[14]  Galina L. Rogova,et al.  Combining the results of several neural network classifiers , 1994, Neural Networks.

[15]  Ludmila I. Kuncheva Using degree of consensus in two-level fuzzy pattern recognition , 1995 .

[16]  Friedhelm Schwenker,et al.  Learning Object Recognition in a NeuroBotic System , 2004 .

[17]  David J. Spiegelhalter,et al.  Machine Learning, Neural and Statistical Classification , 2009 .

[18]  Mohamed A. Deriche,et al.  A New Technique for Combining Multiple Classifiers using The Dempster-Shafer Theory of Evidence , 2002, J. Artif. Intell. Res..

[19]  Ching Y. Suen,et al.  A Method of Combining Multiple Experts for the Recognition of Unconstrained Handwritten Numerals , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  J. Grzymala-Busse Managing uncertainty in expert systems , 1991 .

[21]  Philippe Smets,et al.  The Nature of the Unnormalized Beliefs Encountered in the Transferable Belief Model , 1992, UAI.

[22]  Alvy Ray Smith,et al.  Color gamut transform pairs , 1978, SIGGRAPH.

[23]  K. Karhunen Zur Spektraltheorie stochastischer prozesse , 1946 .

[24]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[25]  Friedhelm Schwenker,et al.  Three learning phases for radial-basis-function networks , 2001, Neural Networks.

[26]  Lotfi A. Zadeh,et al.  Review of A Mathematical Theory of Evidence , 1984 .

[27]  Michel Loève,et al.  Probability Theory I , 1977 .

[28]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[29]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[30]  Catherine Ottlé,et al.  Multi-scale data fusion using Dempster-Shafer evidence theory , 2003 .