Evolutionary Multitask Optimization: Are we Moving in the Right Direction?

Transfer Optimization, understood as the exchange of information among solvers to improve their performance, has gained a remarkable attention from the Swarm and Evolutionary Computation community in the last years. This research area is young but grows at a fast pace, being at the core of a corpus of literature that expands day after day. It is undeniable that the concepts underlying Transfer Optimization are formulated on solid grounds. However, evidences observed in recent contributions and our own experience in this field confirm that there are critical aspects that are not properly addressed to date. This short communication aims to engage the readership around a reflection on these issues, to provide rationale why they remain unsolved, and to call for an urgent action to overcome them fully. Specifically, we emphasize on three critical points of Evolutionary Multitasking Optimization, which is arguably the paradigm in Transfer Optimization that has been most actively investigated in the literature: i) the plausibility of the multitask optimization concept; ii) the acclaimed novelty of some proposed multitasking methods relying on Evolutionary Computation and Swarm Intelligence; and iii) methodologies used for evaluating newly proposed multitasking algorithms. Our ultimate purpose with this critique is to unveil weaknesses observed in these three problematic aspects, so that prospective works can avoid stumbling on the same stones and eventually achieve valuable advances in the right directions.

[1]  Hui Xiong,et al.  A Comprehensive Survey on Transfer Learning , 2019, Proceedings of the IEEE.

[2]  Qingzheng Xu,et al.  Multi-Task Optimization and Multi-Task Evolutionary Computation in the Past Five Years: A Brief Review , 2021, Mathematics.

[3]  Kay Chen Tan,et al.  Multiobjective Multifactorial Optimization in Evolutionary Multitasking , 2017, IEEE Transactions on Cybernetics.

[4]  Javier Del Ser,et al.  Evolutionary Multitask Optimization: a Methodological Overview, Challenges, and Future Research Directions , 2021, Cognitive Computation.

[5]  Liang Feng,et al.  An Adaptive Archive-Based Evolutionary Framework for Many-Task Optimization , 2020, IEEE Transactions on Emerging Topics in Computational Intelligence.

[6]  Javier Del Ser,et al.  A Tutorial On the design, experimentation and application of metaheuristic algorithms to real-World optimization problems , 2021, Swarm Evol. Comput..

[7]  Yew-Soon Ong Towards Evolutionary Multitasking: A New Paradigm in Evolutionary Computation , 2016 .

[8]  Tinne Tuytelaars,et al.  A Continual Learning Survey: Defying Forgetting in Classification Tasks , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Yew-Soon Ong,et al.  Multifactorial Evolution: Toward Evolutionary Multitasking , 2016, IEEE Transactions on Evolutionary Computation.

[10]  Yi Mei,et al.  Surrogate-Assisted Evolutionary Multitask Genetic Programming for Dynamic Flexible Job Shop Scheduling , 2021, IEEE Transactions on Evolutionary Computation.

[11]  Kenneth Sörensen,et al.  Metaheuristics - the metaphor exposed , 2015, Int. Trans. Oper. Res..

[12]  Xin-She Yang,et al.  Bio-inspired computation: Where we stand and what's next , 2019, Swarm Evol. Comput..

[13]  Mei Wang,et al.  Deep Visual Domain Adaptation: A Survey , 2018, Neurocomputing.

[14]  Jürgen Branke,et al.  Evolutionary Optimization in Dynamic Environments , 2001, Genetic Algorithms and Evolutionary Computation.

[15]  Liang Feng,et al.  Insights on Transfer Optimization: Because Experience is the Best Teacher , 2018, IEEE Transactions on Emerging Topics in Computational Intelligence.