A Fuzzy Rule-Based Penalty Function Approach for Constrained Evolutionary Optimization

This paper proposes a novel fuzzy rule-based penalty function approach for solving single-objective nonlinearly constrained optimization problems. Of all the existing state-of-the-art constraint handling techniques, the conventional method of penalty can be easily implemented because of its simplicity but suffers from the lack of robustness. To mitigate the problem of parameter dependency, several forms of adaptive penalties have been suggested in literature. Instead of identifying a complex mathematical function to compute the penalty for constraint violation, we propose a Mamdani type IF-THEN rule-based fuzzy inference system that incorporates all the required criteria of self-adaptive penalty without formulating an explicit mapping. Effectiveness of the proposed constrained optimization algorithm has been empirically validated on the basis of the standard optimality theorems from the literature on mathematical programming. Simulation results show that fuzzy penalty not only surpasses its existing counterpart i.e., self adaptive penalty, but also remain competitive against several other standard as well as currently developed complex constraint handling strategies.

[1]  Wenyin Gong,et al.  Adaptive Ranking Mutation Operator Based Differential Evolution for Constrained Optimization , 2015, IEEE Transactions on Cybernetics.

[2]  Christopher R. Houck,et al.  On the use of non-stationary penalty functions to solve nonlinear constrained optimization problems with GA's , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[3]  X. Yu,et al.  Fuzzy Penalty Function Approach for Constrained Function Optimization with Evolutionary Algorithms , 2001 .

[4]  Gary G. Yen,et al.  A Self Adaptive Penalty Function Based Algorithm for Constrained Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[5]  P. Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2010 Competition on Constrained Real- Parameter Optimization , 2010 .

[6]  Carlos A. Coello Coello,et al.  Constraint-handling in nature-inspired numerical optimization: Past, present and future , 2011, Swarm Evol. Comput..

[7]  Carlos Artemio Coello-Coello,et al.  Theoretical and numerical constraint-handling techniques used with evolutionary algorithms: a survey of the state of the art , 2002 .

[8]  Tapabrata Ray,et al.  Performance of infeasibility empowered memetic algorithm for CEC 2010 constrained optimization problems , 2010, IEEE Congress on Evolutionary Computation.

[9]  L. A. Zedeh Knowledge representation in fuzzy logic , 1989 .

[10]  João Matias,et al.  Penalty Fuzzy Function for Derivative-Free Optimization , 2011, Eurofuse.

[11]  M. Friedman The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance , 1937 .

[12]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[13]  Keigo Watanabe,et al.  Evolutionary Optimization of Constrained Problems , 2004 .

[14]  Robert LIN,et al.  NOTE ON FUZZY SETS , 2014 .

[15]  Kalyanmoy Deb,et al.  Hybrid gradient projection based Genetic Algorithms for constrained optimization , 2010, IEEE Congress on Evolutionary Computation.

[16]  Gary G. Yen,et al.  A generic framework for constrained optimization using genetic algorithms , 2005, IEEE Transactions on Evolutionary Computation.

[17]  Helio J. C. Barbosa,et al.  An Adaptive Penalty Scheme In Genetic Algorithms For Constrained Optimiazation Problems , 2002, GECCO.

[18]  Jing J. Liang,et al.  Problem Deflnitions and Evaluation Criteria for the CEC 2006 Special Session on Constrained Real-Parameter Optimization , 2006 .

[19]  N. Hansen,et al.  Markov Chain Analysis of Cumulative Step-Size Adaptation on a Linear Constrained Problem , 2015, Evolutionary Computation.

[20]  R. Courant Variational methods for the solution of problems of equilibrium and vibrations , 1943 .

[21]  E. H. Mamdani,et al.  An Experiment in Linguistic Synthesis with a Fuzzy Logic Controller , 1999, Int. J. Man Mach. Stud..

[22]  Pascal Bouvry,et al.  Improving Classical and Decentralized Differential Evolution With New Mutation Operator and Population Topologies , 2011, IEEE Transactions on Evolutionary Computation.

[23]  K. Deb An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[24]  Xiaojun Wu,et al.  Convergence analysis and improvements of quantum-behaved particle swarm optimization , 2012, Inf. Sci..

[25]  Zbigniew Michalewicz,et al.  A Survey of Constraint Handling Techniques in Evolutionary Computation Methods , 1995 .

[26]  Zbigniew Michalewicz,et al.  Evolutionary optimization of constrained problems , 1994 .

[27]  Zbigniew Michalewicz,et al.  Evolutionary Algorithms, Homomorphous Mappings, and Constrained Parameter Optimization , 1999, Evolutionary Computation.

[28]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[29]  Sanyang Liu,et al.  A Dual-Population Differential Evolution With Coevolution for Constrained Optimization , 2015, IEEE Transactions on Cybernetics.

[30]  H Myung,et al.  Hybrid evolutionary programming for heavily constrained problems. , 1996, Bio Systems.

[31]  Tetsuyuki Takahama,et al.  Constrained Optimization by the ε Constrained Differential Evolution with Gradient-Based Mutation and Feasible Elites , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[32]  P. N. Suganthan,et al.  Ensemble of Constraint Handling Techniques , 2010, IEEE Transactions on Evolutionary Computation.

[33]  Efrén Mezura-Montes,et al.  Elitist Artificial Bee Colony for constrained real-parameter optimization , 2010, IEEE Congress on Evolutionary Computation.

[34]  Lotfi A. Zadeh,et al.  Knowledge Representation in Fuzzy Logic , 1996, IEEE Trans. Knowl. Data Eng..

[35]  H. Adeli,et al.  Augmented Lagrangian genetic algorithm for structural optimization , 1994 .

[36]  Piero P. Bonissone,et al.  Fuzzy Logic Controlled Multi-Objective Differential Evolution , 2005, The 14th IEEE International Conference on Fuzzy Systems, 2005. FUZZ '05..

[37]  Janez Brest,et al.  An improved self-adaptive differential evolution algorithm in single objective constrained real-parameter optimization , 2010, IEEE Congress on Evolutionary Computation.

[38]  Xin Yao,et al.  Stochastic ranking for constrained evolutionary optimization , 2000, IEEE Trans. Evol. Comput..

[39]  Tetsuyuki Takahama,et al.  Constrained optimization by the ε constrained differential evolution with an archive and gradient-based mutation , 2010, IEEE Congress on Evolutionary Computation.

[40]  Abdollah Homaifar,et al.  Constrained Optimization Via Genetic Algorithms , 1994, Simul..

[41]  Anthony V. Fiacco,et al.  Generalized Penalty Methods in Topological Spaces , 1969 .

[42]  Jonathan A. Wright,et al.  Self-adaptive fitness formulation for constrained optimization , 2003, IEEE Trans. Evol. Comput..