Parallelism in divide-and-conquer non-dominated sorting: a theoretical study considering the PRAM-CREW model

Non-dominated sorting is a crucial component of Pareto-based multi- and many-objective evolutionary algorithms. As the number of objectives increases, the execution time of a multi-objective evolutionary algorithm increases, too. Since multi-objective evolutionary algorithms normally have a low data dependency, research-ers have increasingly adopted parallel programming techniques to reduce their execution time. Evidently, it is also desirable to parallelize non-dominated sorting. There are some recent proposals which focus on the parallelization of non-dominated sorting, with a particular emphasis on a very well-known approach called fast non-dominated sorting. In this paper, however, we explore the scope of parallelism in an approach called divide-and-conquer based non-dominated sorting (DCNS), which we recently introduced. This paper explores the parallelism from a theoretical point of view. The parallelization of the DCNS approach has been explored considering the PRAM-CREW (Parallel Random Access Machine, Concurrent Read Exclusive Write) model. The analysis of parallel algorithms is usually carried out under the assumption that an unbounded number of processors are available. So, in our analysis, we have also considered the same assumption. The time and space complexities of the parallel version of the DCNS approach is obtained in different scenarios. The time complexity of the parallel version of the DCNS approach in different scenarios is proved to be $$\mathcal {O}(\log M + N)$$O(logM+N). We have also obtained the maximum number of processors which can be required by the parallel version of the DCNS approach. The comparison of the parallel version of the DCNS approach with respect to some other approaches is also performed.

[1]  Anna Syberfeldt,et al.  A New Algorithm Using the Non-Dominated Tree to Improve Non-Dominated Sorting , 2017, Evolutionary Computation.

[2]  Leocadio G. Casado,et al.  Non-dominated sorting procedure for Pareto dominance ranking on multicore CPU and/or GPU , 2017, J. Glob. Optim..

[3]  Ye Tian,et al.  A Decision Variable Clustering-Based Evolutionary Algorithm for Large-Scale Many-Objective Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[4]  George Karypis,et al.  Introduction to Parallel Computing , 1994 .

[5]  Kalyanmoy Deb,et al.  Best Order Sort: A New Algorithm to Non-dominated Sorting for Evolutionary Multi-objective Optimization , 2016, GECCO.

[6]  Dominik Zelazny,et al.  Very Fast Non-dominated Sorting , 2014 .

[7]  Qian Wang,et al.  An Efficient Non-dominated Sorting Method for Evolutionary Algorithms , 2008, Evolutionary Computation.

[8]  Virginia Niculescu,et al.  Data-Distributions in PowerList Theory , 2007, ICTAC.

[9]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[10]  Vadim E. Kotov,et al.  Algorithms, Software and Hardware of Parallel Computers , 1984, Springer Berlin Heidelberg.

[11]  Kalyana Chakravarthy Veluvolu,et al.  Nondominated sorting based on sum of objectives , 2017, 2017 IEEE Symposium Series on Computational Intelligence (SSCI).

[12]  Erik D. Goodman,et al.  A novel non-dominated sorting algorithm for evolutionary multi-objective optimization , 2017, J. Comput. Sci..

[13]  Maxim Buzdalov,et al.  A Provably Asymptotically Fast Version of the Generalized Jensen Algorithm for Non-dominated Sorting , 2014, PPSN.

[14]  José A. Martínez,et al.  Improving the performance and energy of Non-Dominated Sorting for evolutionary multiobjective optimization on GPU/CPU platforms , 2018, Journal of Global Optimization.

[15]  Carlos A. Coello Coello,et al.  A divide-and-conquer based efficient non-dominated sorting approach , 2019, Swarm Evol. Comput..

[16]  Kiyoshi Tanaka,et al.  Computational Cost Reduction of Nondominated Sorting Using the M-Front , 2015, IEEE Transactions on Evolutionary Computation.

[17]  Weikang Ning,et al.  Constrained multi-objective optimization using constrained non-dominated sorting combined with an improved hybrid multi-objective evolutionary algorithm , 2017 .

[18]  Sriparna Saha,et al.  Divide and conquer based non-dominated sorting for parallel environment , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[19]  Marc Parizeau,et al.  Generalizing the improved run-time complexity algorithm for non-dominated sorting , 2013, GECCO '13.

[20]  Kent McClymont,et al.  Deductive Sort and Climbing Sort: New Methods for Non-Dominated Sorting , 2012, Evolutionary Computation.

[21]  Sriparna Saha,et al.  MBOS: Modified Best Order Sort Algorithm for Performing Non-Dominated Sorting , 2018, 2018 IEEE Congress on Evolutionary Computation (CEC).

[22]  Gary B. Lamont,et al.  Considerations in engineering parallel multiobjective evolutionary algorithms , 2003, IEEE Trans. Evol. Comput..

[23]  Ye Tian,et al.  An Efficient Approach to Nondominated Sorting for Evolutionary Multiobjective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[24]  Yuren Zhou,et al.  Ranking Vectors by Means of the Dominance Degree Matrix , 2017, IEEE Transactions on Evolutionary Computation.

[25]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[26]  Carlos A. Coello Coello,et al.  GBOS: Generalized Best Order Sort algorithm for non-dominated sorting , 2018, Swarm Evol. Comput..

[27]  Carlos A. Coello Coello,et al.  P-ENS: Parallelism in Efficient Non-Dominated Sorting , 2018, 2018 IEEE Congress on Evolutionary Computation (CEC).

[28]  Samarth Gupta,et al.  A scalable parallel implementation of evolutionary algorithms for multi-objective optimization on GPUs , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[29]  Kalyanmoy Deb,et al.  An Efficient Nondominated Sorting Algorithm for Large Number of Fronts , 2019, IEEE Transactions on Cybernetics.

[30]  Kalyanmoy Deb,et al.  Muiltiobjective Optimization Using Nondominated Sorting in Genetic Algorithms , 1994, Evolutionary Computation.

[31]  Joseph JáJá,et al.  An Introduction to Parallel Algorithms , 1992 .

[32]  Mikkel T. Jensen,et al.  Reducing the run-time complexity of multiobjective EAs: The NSGA-II and other algorithms , 2003, IEEE Trans. Evol. Comput..