Competitive interaction reasoning: A bio-inspired reasoning method for fuzzy rule based classification systems

In designing fuzzy rule based classification systems (FRBCSs), complex fuzzy rule extraction techniques and tuning membership functions are frequently used to enhance classification accuracy. However, these approaches not only decrease system's transparency which is the hallmark of fizzy design, but also are oftentimes computationally expensive and require multiple parameters to be optimized using a large amount of training data. In this paper, inspired by the so-called competitive behavior of mini-columns in the brain neuronal circuitry, we proposed a new reasoning method for fuzzy classifiers referred to as Competitive Interaction Reasoning (CIR) that employs the cumulative information provided by all fuzzy rules and adjusts the decision boundaries as if the membership functions are directly modified. This mechanism is mathematically implemented by a linear transformation and resembles the competitive interaction observed in brain neuronal columns. Cross-rule competition weights are optimized using Hebbian reinforcement learning. Using a large number of simulations on benchmark data sets, we show that the proposed CIR significantly improves classification accuracy without compromising interpretability of the fuzzy classifier. In addition, CIR can further facilitate formation of the fuzzy rules and incorporation of the expert knowledge by confining the destructive effects of noisy rules or expert inconsistencies. Experiments on 23 well-known benchmark data sets confirm high performance of CIR in comparison with a number of popular classifiers.

[1]  Ashish Ghosh,et al.  Fuzzy clustering algorithms for unsupervised change detection in remote sensing images , 2011, Inf. Sci..

[2]  G. Joós,et al.  A Fuzzy Rule-Based Approach for Islanding Detection in Distributed Generation , 2010, IEEE Transactions on Power Delivery.

[3]  R. Douglas,et al.  Neuronal circuits of the neocortex. , 2004, Annual review of neuroscience.

[4]  Elif Derya Übeyli,et al.  Adaptive neuro-fuzzy inference system for classification of EEG signals using wavelet coefficients , 2005, Journal of Neuroscience Methods.

[5]  Teemu Roos,et al.  Discriminative Learning of Bayesian Networks via Factorized Conditional Log-Likelihood , 2011, J. Mach. Learn. Res..

[6]  Arjen Ysbert Hoekstra,et al.  Assessment of uncertainties in expert knowledge, illustrated in fuzzy rule-based models , 2010 .

[7]  Hisao Ishibuchi,et al.  Rule weight specification in fuzzy rule-based classification systems , 2005, IEEE Transactions on Fuzzy Systems.

[8]  Gerald Schaefer,et al.  Thermography based breast cancer analysis using statistical features and fuzzy classification , 2009, Pattern Recognit..

[9]  Hongxing Li,et al.  Hierarchical TS fuzzy system and its universal approximation , 2005, Inf. Sci..

[10]  Carson C. Chow,et al.  Competitive dynamics in cortical responses to visual stimuli. , 2005, Journal of neurophysiology.

[11]  Radu-Emil Precup,et al.  Nature-inspired optimal tuning of input membership functions of Takagi-Sugeno-Kang fuzzy models for Anti-lock Braking Systems , 2015, Appl. Soft Comput..

[12]  F. Herrera,et al.  A proposal on reasoning methods in fuzzy rule-based classification systems , 1999 .

[13]  Francisco Herrera,et al.  Interpretability of linguistic fuzzy rule-based systems: An overview of interpretability measures , 2011, Inf. Sci..

[14]  Bernhard Sendhoff,et al.  Knowledge Incorporation into Neural Networks From Fuzzy Rules , 2004, Neural Processing Letters.

[15]  Plamen P. Angelov,et al.  On line learning fuzzy rule-based system structure from data streams , 2008, 2008 IEEE International Conference on Fuzzy Systems (IEEE World Congress on Computational Intelligence).

[16]  Oscar Castillo,et al.  A review on type-2 fuzzy logic applications in clustering, classification and pattern recognition , 2014, Appl. Soft Comput..

[17]  Majid Nili Ahmadabadi,et al.  Computational model of excitatory/inhibitory ratio imbalance role in attention deficit disorders , 2012, Journal of Computational Neuroscience.

[18]  Witold Pedrycz,et al.  Granular Computing: Analysis and Design of Intelligent Systems , 2013 .

[19]  Luciano Sánchez,et al.  Boosting fuzzy rules in classification problems under single‐winner inference , 2007, Int. J. Intell. Syst..

[20]  Francisco Herrera,et al.  A proposal for evolutionary fuzzy systems using feature weighting: Dealing with overlapping in imbalanced datasets , 2015, Knowl. Based Syst..

[21]  Hisao Ishibuchi,et al.  Analysis of interpretability-accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning , 2007, Int. J. Approx. Reason..

[22]  Yu-Hsiu Lin,et al.  Non-Intrusive Load Monitoring by Novel Neuro-Fuzzy Classification Considering Uncertainties , 2014, IEEE Transactions on Smart Grid.

[23]  Luciano Sánchez,et al.  Boosting fuzzy rules in classification problems under single-winner inference: Research Articles , 2007 .

[24]  Hisao Ishibuchi,et al.  Effect of rule weights in fuzzy rule-based classification systems , 2000, Ninth IEEE International Conference on Fuzzy Systems. FUZZ- IEEE 2000 (Cat. No.00CH37063).

[25]  Eghbal G. Mansoori,et al.  Weighting fuzzy classification rules using receiver operating characteristics (ROC) analysis , 2007, Inf. Sci..

[26]  Oscar Castillo,et al.  Fuzzy granular gravitational clustering algorithm for multivariate data , 2014, Inf. Sci..

[27]  Witold Pedrycz,et al.  Fuzzy sets in pattern recognition: Methodology and methods , 1990, Pattern Recognit..

[28]  Ludmila I. Kuncheva,et al.  How good are fuzzy If-Then classifiers? , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[29]  Bo Yang,et al.  Automatic Design of Hierarchical Takagi–Sugeno Type Fuzzy Systems Using Evolutionary Algorithms , 2007, IEEE Transactions on Fuzzy Systems.

[30]  Hisao Ishibuchi,et al.  Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining , 2004, Fuzzy Sets Syst..

[31]  Majid Nili Ahmadabadi,et al.  Learning Active Fusion of Multiple Experts' Decisions , 2011 .

[32]  H. B. Mitchell Pattern recognition using type-II fuzzy sets , 2005, Inf. Sci..

[33]  Maximilian Eibl,et al.  Wrappers for Feature Subset Selection in CRF-based Clinical Information Extraction , 2016, CLEF.

[34]  Francisco Herrera,et al.  Improving the performance of fuzzy rule-based classification systems with interval-valued fuzzy sets and genetic amplitude tuning , 2010, Inf. Sci..

[35]  Marcin Korytkowski,et al.  Fast image classification by boosting fuzzy classifiers , 2016, Inf. Sci..

[36]  Eugene M. Izhikevich,et al.  Dynamical Systems in Neuroscience: The Geometry of Excitability and Bursting , 2006 .

[37]  S. T. Buckland,et al.  An Introduction to the Bootstrap , 1994 .

[38]  Andri Riid,et al.  Adaptability, interpretability and rule weights in fuzzy rule-based systems , 2014, Inf. Sci..

[39]  Walmir M. Caminhas,et al.  Adaptive fault detection and diagnosis using an evolving fuzzy classifier , 2013, Inf. Sci..

[40]  Sankar K. Pal,et al.  Fuzzy sets in pattern recognition and machine intelligence , 2005, Fuzzy Sets Syst..

[41]  Enrique Herrera-Viedma,et al.  A statistical comparative study of different similarity measures of consensus in group decision making , 2013, Inf. Sci..

[42]  John Q. Gan,et al.  Low-level interpretability and high-level interpretability: a unified view of data-driven interpretable fuzzy system modelling , 2008, Fuzzy Sets Syst..

[43]  M. Paradiso,et al.  Neuroscience: Exploring the Brain , 1996 .

[44]  Rui Pedro Paiva,et al.  Interpretability and learning in neuro-fuzzy systems , 2004, Fuzzy Sets Syst..