When non-elitism meets time-linkage problems

Many real-world applications have the time-linkage property, and the only theoretical analysis is recently given by Zheng, et al. (TEVC 2021) on their proposed time-linkage OneMax problem, OneMax(0,1n). However, only two elitist algorithms (1 + 1) EA and (μ + 1) EA are analyzed, and it is unknown whether the non-elitism mechanism could help to escape the local optima existed in OneMax(0,1n). In general, there are few theoretical results on the benefits of the non-elitism in evolutionary algorithms. In this work, we analyze on the influence of the non-elitism via comparing the performance of the elitist (1 + λ) EA and its non-elitist counterpart (1, λ) EA. We prove that with probability 1 - o(1) (1 + λ) EA will get stuck in the local optima and cannot find the global optimum, but with probability 1, (1, λ) EA can reach the global optimum and its expected runtime is O(n3+c log n) with [EQUATION] for the constant c ≥ 1. Noting that a smaller offspring size is helpful for escaping from the local optima, we further resort to the compact genetic algorithm where only two individuals are sampled to update the probabilistic model, and prove its expected runtime of O(n3 log n). Our computational experiments also verify the efficiency of the two non-elitist algorithms.

[1]  Benjamin Doerr,et al.  From understanding genetic drift to a smart-restart parameter-less compact genetic algorithm , 2020, GECCO.

[2]  Pietro Simone Oliveto,et al.  When Hypermutations and Ageing Enable Artificial Immune Systems to Outperform Evolutionary Algorithms , 2018, Theor. Comput. Sci..

[3]  Per Kristian Lehre,et al.  On the limitations of the univariate marginal distribution algorithm to deception and where bivariate EDAs might help , 2019, FOGA '19.

[4]  Benjamin Doerr Does Comma Selection Help to Cope with Local Optima? , 2020, GECCO.

[5]  Carsten Witt,et al.  Theory of estimation-of-distribution algorithms , 2018, GECCO.

[6]  Weijie Zheng,et al.  Working principles of binary differential evolution , 2018, GECCO.

[7]  Huanhuan Chen,et al.  Analysis of Evolutionary Algorithms on Fitness Function with Time-linkage Property , 2020, ArXiv.

[8]  Stefan Droste,et al.  A rigorous analysis of the compact genetic algorithm for linear functions , 2006, Natural Computing.

[9]  Andrew M. Sutton,et al.  The Compact Genetic Algorithm is Efficient Under Extreme Gaussian Noise , 2017, IEEE Transactions on Evolutionary Computation.

[10]  Dirk Sudholt,et al.  The Benefits of Population Diversity in Evolutionary Algorithms: A Survey of Rigorous Runtime Analyses , 2018, Theory of Evolutionary Computation.

[11]  Dirk Sudholt,et al.  The Complex Parameter Landscape of the Compact Genetic Algorithm , 2020, Algorithmica.

[12]  Andrew M. Sutton,et al.  On the runtime dynamics of the compact genetic algorithm on jump functions , 2018, GECCO.

[13]  Trung Thanh Nguyen,et al.  Continuous dynamic optimisation using evolutionary algorithms , 2011 .

[14]  Xin Yao,et al.  Analysis of Computational Time of Simple Estimation of Distribution Algorithms , 2010, IEEE Transactions on Evolutionary Computation.

[15]  Peter A. N. Bosman,et al.  Learning, anticipation and time-deception in evolutionary online dynamic optimization , 2005, GECCO '05.

[16]  Benjamin Doerr,et al.  The Runtime of the Compact Genetic Algorithm on Jump Functions , 2019, Algorithmica.

[17]  Dirk Sudholt,et al.  Towards a Runtime Comparison of Natural and Artificial Evolution , 2015, Algorithmica.

[18]  Weijie Zheng,et al.  Sharp Bounds for Genetic Drift in Estimation of Distribution Algorithms , 2020, IEEE Transactions on Evolutionary Computation.

[19]  Jens Jägersküpper,et al.  When the Plus Strategy Outperforms the Comma Strategyand When Not , 2007, 2007 IEEE Symposium on Foundations of Computational Intelligence.

[20]  Andrei Lissovoi,et al.  On the Time Complexity of Algorithm Selection Hyper-Heuristics for Multimodal Optimisation , 2019, AAAI.

[21]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[22]  Benjamin Doerr,et al.  Analyzing randomized search heuristics via stochastic domination , 2019, Theor. Comput. Sci..

[23]  Pietro Simone Oliveto,et al.  How to Escape Local Optima in Black Box Optimisation: When Non-elitism Outperforms Elitism , 2017, Algorithmica.

[24]  Thomas Jansen,et al.  On the analysis of the (1+1) evolutionary algorithm , 2002, Theor. Comput. Sci..

[25]  Benjamin Doerr,et al.  The Univariate Marginal Distribution Algorithm Copes Well with Deception and Epistasis , 2020, Evolutionary Computation.

[26]  Marc Schoenauer,et al.  Rigorous Hitting Times for Binary Mutations , 1999, Evolutionary Computation.

[27]  Dirk Sudholt,et al.  The choice of the offspring population size in the (1, λ) evolutionary algorithm , 2014, Theor. Comput. Sci..

[28]  Pietro Simone Oliveto,et al.  Fast Artificial Immune Systems , 2018, PPSN.

[29]  Thomas Jansen,et al.  A comparison of simulated annealing with a simple evolutionary algorithm on pseudo-boolean functions of unitation , 2007, Theor. Comput. Sci..

[30]  Dirk Sudholt,et al.  On the Choice of the Update Strength in Estimation-of-Distribution Algorithms and Ant Colony Optimization , 2018, Algorithmica.

[31]  Xin Yao,et al.  A Large Population Size Can Be Unhelpful in Evolutionary Algorithms a Large Population Size Can Be Unhelpful in Evolutionary Algorithms , 2022 .