A PSO-aided neuro-fuzzy classifier employing linguistic hedge concepts

The present paper proposes the development of an adaptive neuro-fuzzy classifier which employs two relatively less explored and comparatively new problem solving domains in fuzzy systems. The relatively less explored field is the domain of the fuzzy linguistic hedges which has been employed here to define the flexible shapes of the fuzzy membership functions (MFs). To achieve finer and finer adaptation, and hence control, over the fuzzy MFs, each MF is composed of several piecewise MF sections and the shape of each such MF section is varied by applying a fuzzy linguistic operator on it. The system employs a Takagi-Sugeno based neuro-fuzzy system where the rule consequences are described by zero order elements. This proposed linguistic hedge based neuro-fuzzy classifier (LHBNFC) employs a relatively new field in the area of combinatorial metaheuristics, called particle swarm optimization (PSO), for its efficient learning. PSO has been employed in this scheme to simultaneously tune the shape of the fuzzy MFs as well as the rule consequences for the entire fuzzy rule base. The performance of the proposed system is demonstrated by implementing it for two classical benchmark data sets: (i) the iris data and (ii) the thyroid data. Performance comparison vis-a-vis other available algorithms shows the effectiveness of our proposed algorithm.

[1]  Rudolf Kruse,et al.  A neuro-fuzzy method to learn fuzzy classification rules from data , 1997, Fuzzy Sets Syst..

[2]  P. Siarry,et al.  A centered formulation of Takagi-Sugeno rules for improved learning efficiency , 1994 .

[3]  Oliver Nelles,et al.  Genetic programming for model selection of TSK-fuzzy systems , 2001, Inf. Sci..

[4]  Bin-Da Liu,et al.  Design of adaptive fuzzy logic controller based on linguistic-hedge concepts and genetic algorithms , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[5]  Patrick Siarry,et al.  Fuzzy rule base learning through simulated annealing , 1999, Fuzzy Sets Syst..

[6]  Russell C. Eberhart,et al.  Implementation of evolutionary fuzzy systems , 1999, IEEE Trans. Fuzzy Syst..

[7]  Francisco Herrera,et al.  Generating the knowledge base of a fuzzy rule-based system by the genetic learning of the data base , 2001, IEEE Trans. Fuzzy Syst..

[8]  Rudy Setiono.  Extracting M-of-N rules from trained neural networks , 2000, IEEE Trans. Neural Networks Learn. Syst..

[9]  Elie Sanchez,et al.  Soft computing perspectives , 1994, Proceedings of 24th International Symposium on Multiple-Valued Logic (ISMVL'94).

[10]  Hisao Ishibuchi,et al.  Three-objective genetics-based machine learning for linguistic rule extraction , 2001, Inf. Sci..

[11]  Bogdan Gabrys,et al.  Learning hybrid neuro-fuzzy classifier models from data: to combine or not to combine? , 2004, Fuzzy Sets Syst..

[12]  Andrzej Bargiela,et al.  General fuzzy min-max neural network for clustering and classification , 2000, IEEE Trans. Neural Networks Learn. Syst..

[13]  Bart Kosko,et al.  Neural networks for signal processing , 1992 .

[14]  B. Scholkopf,et al.  Fisher discriminant analysis with kernels , 1999, Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468).

[15]  John H. Lilly,et al.  Evolutionary design of a fuzzy classifier from data , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[16]  Patrick Siarry,et al.  A genetic algorithm for optimizing Takagi-Sugeno fuzzy rule bases , 1998, Fuzzy Sets Syst..

[17]  F. Gomide,et al.  Ten years of genetic fuzzy systems: current framework and new trends , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[18]  Haesun Park,et al.  Nonlinear feature extraction based on centroids and kernel functions , 2004, Pattern Recognit..

[19]  M. E. El-Hawary,et al.  Fuzzy short-term electric load forecasting , 2004 .

[20]  Frank Hoffmann.  Combining boosting and evolutionary algorithms for learning of fuzzy classification rules , 2004, Fuzzy Sets Syst..

[21]  Piero P. Bonissone,et al.  Soft computing: the convergence of emerging reasoning technologies , 1997, Soft Comput..

[22]  Witold Pedrycz,et al.  Fuzzy evolutionary computation , 1997 .

[23]  Ferenc Szeifert,et al.  Data-driven generation of compact, accurate, and linguistically sound fuzzy classifiers based on a decision-tree initialization , 2003, Int. J. Approx. Reason..

[24]  Tzung-Pei Hong,et al.  Learning discriminant functions with fuzzy attributes for classification using genetic programming , 2002, Expert systems with applications.

[25]  Abraham Kandel,et al.  Compensatory neurofuzzy systems with fast learning algorithms , 1998, IEEE Trans. Neural Networks.

[26]  Magne Setnes,et al.  GA-fuzzy modeling and classification: complexity and performance , 2000, IEEE Trans. Fuzzy Syst..

[27]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[28]  Francisco Herrera,et al.  Ten years of genetic fuzzy systems: current framework and new trends , 2004, Fuzzy Sets Syst..

[29]  Antonio González Muñoz,et al.  SLAVE: a genetic learning system based on an iterative approach , 1999, IEEE Trans. Fuzzy Syst..

[30]  Francisco Herrera,et al.  Genetic Algorithms and Soft Computing , 1996 .

[31]  Tzung-Pei Hong,et al.  Processing individual fuzzy attributes for fuzzy rule induction , 2000, Fuzzy Sets Syst..

[32]  R. Eberhart,et al.  Comparing inertia weights and constriction factors in particle swarm optimization , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[33]  Francisco Herrera,et al.  Building fuzzy graphs: Features and taxonomy of learning for non-grid-oriented fuzzy rule-based systems , 2001, J. Intell. Fuzzy Syst..

[34]  H. B. Gürocak,et al.  A genetic-algorithm-based method for tuning fuzzy logic controllers , 1999, Fuzzy Sets Syst..

[35]  A. Morris,et al.  Fuzzy neural networks for nonlinear systems modelling , 1995 .

[36]  Chuen-Tsai Sun,et al.  Neuro-fuzzy modeling and control , 1995, Proc. IEEE.

[37]  Magne Setnes,et al.  Compact and transparent fuzzy models and classifiers through iterative complexity reduction , 2001, IEEE Trans. Fuzzy Syst..

[38]  Amitava Chatterjee,et al.  Influential rule search scheme (IRSS) - a new fuzzy pattern classifier , 2004, IEEE Transactions on Knowledge and Data Engineering.

[39]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[40]  Frank Hoffmann,et al.  Evolutionary design of a fuzzy knowledge base for a mobile robot , 1997, Int. J. Approx. Reason..

[41]  Francisco Herrera,et al.  Linguistic modeling by hierarchical systems of linguistic rules , 2002, IEEE Trans. Fuzzy Syst..

[42]  Christopher J. Merz,et al.  UCI Repository of Machine Learning Databases , 1996 .

[43]  Hisao Ishibuchi,et al.  Performance evaluation of fuzzy classifier systems for multidimensional pattern classification problems , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[44]  Simon Parsons,et al.  Soft computing: fuzzy logic, neural networks and distributed artificial intelligence by F. Aminzadeh and M. Jamshidi (Eds.), PTR Prentice Hall, Englewood Cliffs, NJ, pp 301, ISBN 0-13-146234-2 , 1996, Knowl. Eng. Rev..

[45]  Lotfi A. Zadeh,et al.  Outline of a New Approach to the Analysis of Complex Systems and Decision Processes , 1973, IEEE Trans. Syst. Man Cybern..

[46]  C. L. Karr,et al.  Fuzzy control of pH using genetic algorithms , 1993, IEEE Trans. Fuzzy Syst..

[47]  N. C. Ho,et al.  Extended hedge algebras and their application to fuzzy logic , 1992 .

[48]  Chun-Yueh Huang,et al.  Current-mode linguistic hedge circuit for adaptive fuzzy logic controllers , 1995 .

[49]  R. Eberhart,et al.  Empirical study of particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).