D-RadVis Antenna : Visualization and Performance Measure for Many-objective Optimization

So far the focus of almost all multior many-objective performance metrics has been the convergence and distribution of solutions in the objective space (Pareto-surface). Pareto-surface metrics such as IGD, HV, and Spread are simple and provide knowledge about the overall performance of the solution set. However, these measures do not provide any insight into the distribution or spread of a solution set with respect to each objective. Further, in many-objective optimization, visualization of true Pareto fronts or obtained non-dominated solutions is difficult. A proper visualization tool must be able to show the location, range, shape, and distribution of obtained non-dominated solutions (both Pareto-surface and objective-wise distribution). Existing commonly used visualization tools in many-objective optimization (e.g., parallel coordinates) fail to show the shape of the Pareto front or distribution of solutions along each objective. In this paper, we propose an extension of recently proposed visualization method called 3D-RadVis (we call it 3D-RadVis Antenna) to visualize the distribution of solutions along each objective. 3D-RadVis Antenna is capable of mapping Mdimensional objective space to a 3-dimensional radial coordinate plot while seeking to preserve the relative location of solutions, shape of the Pareto front, and distribution of solutions along each objective. Furthermore, 3D-RadVis Antenna can be used by decisionmakers to visually navigate large many-objective solution sets, to observe the evolutionary process, to visualize the relative location of a solution, to evaluate trade-offs among objectives, and to select preferred solutions. Along with this visualization tool, we propose two novel performance measures, named objective-wise inverse generational distance (ObjIGD) and line distribution ( ) to measure the convergence and distribution of solutions along each objective as well as the overall performance of approximate solutions. The effectiveness of the proposed methods are demonstrated on widely used many-objective benchmark problems containing a variety of Pareto fronts (linear, concave, convex, mixed, and disconnected). In addition, for a case study, we have demonstrated the capability of 3D-RadVis Antenna combined with the proposed performance measures for visual progress tracking of the NSGA-III algorithm through generations. Experimental results show that the proposed visualization method can effectively be used to compare and track the performance of many-objective algorithms. Moreover, the proposed measures can be used as reliable complementary measures along with other widely used performance measures to compare many-objective solution sets.

[1]  H. Scheffé Experiments with Mixtures , 1958 .

[2]  W. L. Nicholson,et al.  Evaluation of graphical techniques for data in dimensions 3 to 5: scatter plot matrix, glyph and stereo examples , 1985 .

[3]  Georges G. Grinstein,et al.  DNA visual and analytic data mining , 1997 .

[4]  Peter J. Fleming,et al.  Multiobjective optimization and multiple constraint handling with evolutionary algorithms. II. Application example , 1998, IEEE Trans. Syst. Man Cybern. Part A.

[5]  John E. Dennis,et al.  Normal-Boundary Intersection: A New Method for Generating the Pareto Surface in Nonlinear Multicriteria Optimization Problems , 1998, SIAM J. Optim..

[6]  Lothar Thiele,et al.  Multiobjective Optimization Using Evolutionary Algorithms - A Comparative Case Study , 1998, PPSN.

[7]  Gary B. Lamont,et al.  Multiobjective evolutionary algorithms: classifications, analyses, and new innovations , 1999 .

[8]  Gary B. Lamont,et al.  Multiobjective evolutionary algorithm test suites , 1999, SAC '99.

[9]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[10]  M. Ashby MULTI-OBJECTIVE OPTIMIZATION IN MATERIAL DESIGN AND SELECTION , 2000 .

[11]  Shapour Azarm,et al.  Metrics for Quality Assessment of a Multiobjective Design Optimization Solution Set , 2001 .

[12]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[13]  Marco Laumanns,et al.  Scalable multi-objective optimization test problems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[14]  Daisuke Sasaki,et al.  Visualization and Data Mining of Pareto Solutions Using Self-Organizing Map , 2003, EMO.

[15]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[16]  Alfred Ultsch,et al.  U *-Matrix : a Tool to visualize Clusters in high dimensional Data , 2004 .

[17]  Peter J. Fleming,et al.  Many-Objective Optimization: An Engineering Design Perspective , 2005, EMO.

[18]  Jouni Lampinen,et al.  GDE3: the third evolution step of generalized differential evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[19]  R. Lyndon While,et al.  A Scalable Multi-objective Test Problem Toolkit , 2005, EMO.

[20]  Alfred Inselberg,et al.  The plane with parallel coordinates , 1985, The Visual Computer.

[21]  Sanaz Mostaghim,et al.  Heatmap Visualization of Population Based Multi Objective Algorithms , 2007, EMO.

[22]  Qingfu Zhang,et al.  Combining Model-based and Genetics-based Offspring Generation for Multi-objective Optimization Using a Convergence Criterion , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[23]  Silvia Poles,et al.  MOGA-II for an Automotive Cooling Duct Optimization on Distributed Resources , 2006, EMO.

[24]  Carlos M. Fonseca,et al.  An Improved Dimension-Sweep Algorithm for the Hypervolume Indicator , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[25]  R. Lyndon While,et al.  A faster algorithm for calculating hypervolume , 2006, IEEE Transactions on Evolutionary Computation.

[26]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[27]  Carlos A. Coello Coello,et al.  Some techniques to deal with many-objective problems , 2009, GECCO '09.

[28]  Nicola Beume,et al.  On the Complexity of Computing the Hypervolume Indicator , 2009, IEEE Transactions on Evolutionary Computation.

[29]  Sumit Ghosh,et al.  Immersive Virtual Reality Simulations in Nursing Education , 2010, Nursing education perspectives.

[30]  Massimo Bergamasco,et al.  Beyond virtual museums: experiencing immersive virtual reality in real museums , 2010 .

[31]  Franck Multon,et al.  Using Virtual Reality to Analyze Sports Performance , 2010, IEEE Computer Graphics and Applications.

[32]  Albert Rizzo,et al.  Use of immersive virtual reality for treating anger. , 2010, Studies in health technology and informatics.

[33]  Jiang Siwei,et al.  Multiobjective optimization by decomposition with Pareto-adaptive weight vectors , 2011, 2011 Seventh International Conference on Natural Computation.

[34]  Lucas Bradstreet,et al.  A Fast Way of Calculating Exact Hypervolumes , 2012, IEEE Transactions on Evolutionary Computation.

[35]  Jonathan E. Fieldsend,et al.  Visualizing Mutually Nondominating Solution Sets in Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[36]  Shengxiang Yang,et al.  A Grid-Based Evolutionary Algorithm for Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[37]  Shengxiang Yang,et al.  Shift-Based Density Estimation for Pareto-Based Algorithms in Many-Objective Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[38]  Jun Zhang,et al.  Fuzzy-Based Pareto Optimality for Many-Objective Evolutionary Algorithms , 2014, IEEE Transactions on Evolutionary Computation.

[39]  Jie Zhang,et al.  Consistencies and Contradictions of Performance Metrics in Multiobjective Optimization , 2014, IEEE Transactions on Cybernetics.

[40]  Mayur Gondhalekar,et al.  CAVE: An Emerging Immersive Technology -- A Review , 2014, 2014 UKSim-AMSS 16th International Conference on Computer Modelling and Simulation.

[41]  Tea Tusar,et al.  Visualization of Pareto Front Approximations in Evolutionary Multiobjective Optimization: A Critical Review and the Prosection Method , 2015, IEEE Transactions on Evolutionary Computation.

[42]  Gary G. Yen,et al.  Visualization and Performance Metric in Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[43]  Shahryar Rahnamayan,et al.  3D-RadVis: Visualization of Pareto front in many-objective optimization , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).