Improving Classifier Fusion Using Particle Swarm Optimization

Both experimental and theoretical studies have proved that classifier fusion can be effective in improving overall classification performance. Classifier fusion can be performed on either score (raw classifier outputs) level or decision level. While tremendous research interests have been on score-level fusion, research work for decision-level fusion is sparse. This paper presents a particle swarm optimization based decision-level fusion scheme for optimizing classifier fusion performance. Multiple classifiers are fused at the decision level, and the particle swarm optimization algorithm finds optimal decision threshold for each classifier and the optimal fusion rule. Specifically, we present an optimal fusion strategy for fusing multiple classifiers to satisfy accuracy performance requirements, as applied to a real-world classification problem. The optimal decision fusion technique is found to perform significantly better than the conventional classifier fusion methods, i.e., traditional decision level fusion and averaged sum rule

[1]  Kalyan Veeramachaneni,et al.  Dynamic sensor management using multi-objective particle swarm optimizer , 2004, SPIE Defense + Commercial Sensing.

[2]  Arun Ross,et al.  Information fusion in biometrics , 2003, Pattern Recognit. Lett..

[3]  Pramod K. Varshney,et al.  Distributed Detection and Data Fusion , 1996 .

[4]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Pramod K. Varshney,et al.  An Evolutionary Algorithm Based Approach for Dynamic Thresholding in Multimodal Biometrics , 2004, ICBA.

[6]  Weizhong Yan,et al.  Designing classifier ensembles with constrained performance requirements , 2004, SPIE Defense + Commercial Sensing.

[7]  David W. Opitz,et al.  Feature Selection for Ensembles , 1999, AAAI/IAAI.

[8]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.

[9]  P.K. Varshney,et al.  Optimal Data Fusion in Multiple Sensor Detection Systems , 1986, IEEE Transactions on Aerospace and Electronic Systems.

[10]  W. Gray,et al.  Optimal data fusion of correlated local decisions in multiple sensor detection systems , 1992 .

[11]  John N. Tsitsiklis,et al.  On the complexity of decentralized decision making and detection problems , 1985 .

[12]  Kalyan Veeramachaneni,et al.  Optimization Using Particle Swarms with Near Neighbor Interactions , 2003, GECCO.

[13]  Krishna R. Pattipati,et al.  An algorithm for determining the decision thresholds in a distributed detection problem , 1989, Conference Proceedings., IEEE International Conference on Systems, Man and Cybernetics.

[14]  C. W. Therrien,et al.  Decision, Estimation and Classification: An Introduction to Pattern Recognition and Related Topics , 1989 .

[15]  R. Cogill,et al.  Decentralized stochastic decision problems and polynomial optimization , 2005, Proceedings of the 2005, American Control Conference, 2005..