Combining Correlated Data from Multiple Classifiers

Real time data collected from sensors and then having been processed by multiple classifiers are correlated due to common, inherent noise resulting from the sensor. The data is collected at different ranges and may have different statistical distributions and characteristics. Measurements from different classifiers are fused together to obtain more information about the phenomenon or environment under observation. Since the classifier fusion is attempting to improve the data through processing only, this chapter focuses on object refinement or fusion level 1 within the Joint Directors of Laboratories (JDL) data fusion process model and taxonomy of algorithms. Before fusion, the correlated data is normalized using a variety of normalization techniques such as z-score and min-max normalization. Further, by dynamically weighting and combining the measurements from these classifiers, performance is improved. Weights are found using a Particle Swarm Optimization search algorithm and are a function of required accuracy and degree of correlation. Results are presented for (a) synthetic data generated using conditional multivariate normal distribution with different covariance matrices and (b) NIST BSSR dataset. For correlated classifiers, the performance of the particle swarm optimization technique outperforms the traditional data level fusion i.e., z-normalization and min-max.

[1]  Arun Ross,et al.  Information fusion in biometrics , 2003, Pattern Recognit. Lett..

[2]  Ludmila I. Kuncheva,et al.  A Theoretical Study on Six Classifier Fusion Strategies , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  L. Darrell Whitley,et al.  Genetic Approach to Feature Selection for Ensemble Creation , 1999, GECCO.

[4]  James Llinas,et al.  Multisensor Data Fusion , 1990 .

[5]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[6]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Pramod K. Varshney,et al.  Distributed Detection and Data Fusion , 1996 .

[8]  Kalyan Veeramachaneni,et al.  Dynamic sensor management using multi-objective particle swarm optimizer , 2004, SPIE Defense + Commercial Sensing.

[9]  P. Peebles Probability, Random Variables and Random Signal Principles , 1993 .

[10]  D. Opitz,et al.  Popular Ensemble Methods: An Empirical Study , 1999, J. Artif. Intell. Res..

[11]  Leon G. Higley,et al.  Forensic Entomology: An Introduction , 2009 .

[12]  Arun Ross,et al.  Decision-level fusion strategies for correlated biometric classifiers , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[13]  Pramod K. Varshney,et al.  An Evolutionary Algorithm Based Approach for Dynamic Thresholding in Multimodal Biometrics , 2004, ICBA.

[14]  David W. Opitz,et al.  Feature Selection for Ensembles , 1999, AAAI/IAAI.

[15]  Fabio Roli,et al.  Methods for Designing Multiple Classifier Systems , 2001, Multiple Classifier Systems.

[16]  Adam Krzyżak,et al.  Methods of combining multiple classifiers and their applications to handwriting recognition , 1992, IEEE Trans. Syst. Man Cybern..

[17]  Nils Sandell,et al.  Detection with Distributed Sensors , 1980, IEEE Transactions on Aerospace and Electronic Systems.

[18]  Pramod K. Varshney,et al.  An adaptive multimodal biometric management algorithm , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[19]  Anders Krogh,et al.  Neural Network Ensembles, Cross Validation, and Active Learning , 1994, NIPS.

[20]  Arun Ross,et al.  Score normalization in multimodal biometric systems , 2005, Pattern Recognit..

[21]  Rick S. Blum,et al.  The good, bad and ugly: distributed detection of a known signal in dependent Gaussian noise , 2000, IEEE Trans. Signal Process..

[22]  P.K. Varshney,et al.  Optimal Data Fusion in Multiple Sensor Detection Systems , 1986, IEEE Transactions on Aerospace and Electronic Systems.