A Topologically Consistent Visualization of High Dimensional Pareto-front for Multi-Criteria Decision Making

There are a good number of different algorithms to solve multi- and many-objective optimization problems and the final outcome of these algorithms is a set of trade-off solutions that are expected to span the entire Pareto-front. Visualization of a Pareto-front is vital for an initial decision-making task, as it provides a number of useful information, such as closeness of one solution to another, trade-off among conflicting objectives, localized shape of the Pareto-front vis-a-vis the entire front, and others. Two and three-dimensional Pareto-fronts are trivial to visualize and allow all the above analysis to be done comprehensively. However, for four or more objectives, visualization for extracting above decision-making information gets challenging and new and innovative methods are long overdue. Not only does a trivial visualization becomes difficult, the number of points needed to represent a higher-dimensional front increase exponentially. The existing high-dimensional visualization techniques, such as parallel coordinate plots, scatter plots, RadVis, etc., do not offer a clear and natural view of the Pareto-front in terms of trade-off and other vital localized information needed for a convenient decision-making task. In this paper, we propose a novel way to map a high-dimensional Pareto-front in two and three dimensions. The proposed method tries to capture some of the basic topological properties of the Pareto points and retain them in the mapped lower dimensional space. Therefore, the proposed method can produce faithful representation of the topological primitives of the high-dimensional data points in terms of the basic shape (and structure) of the Pareto-front, its boundary, and visual classification of the relative trade-offs of the solutions. As a proof-of-principle demonstration, we apply our proposed palette visualization method to a few problems.

[1]  Kalyanmoy Deb,et al.  Finding Knees in Multi-objective Optimization , 2004, PPSN.

[2]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[3]  Ray A. Jarvis,et al.  On the Identification of the Convex Hull of a Finite Set of Points in the Plane , 1973, Inf. Process. Lett..

[4]  Qing Li,et al.  Multiobjective optimization for crash safety design of vehicles using stepwise regression model , 2008 .

[5]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[6]  David P. Dobkin,et al.  The quickhull algorithm for convex hulls , 1996, TOMS.

[7]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[8]  Leland Wilkinson,et al.  The History of the Cluster Heat Map , 2009 .

[9]  Georges G. Grinstein,et al.  Dimensional anchors: a graphic primitive for multidimensional multivariate information visualizations , 1999, NPIVM '99.

[10]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[11]  John W. Sammon,et al.  A Nonlinear Mapping for Data Structure Analysis , 1969, IEEE Transactions on Computers.

[12]  Geoffrey E. Hinton,et al.  Stochastic Neighbor Embedding , 2002, NIPS.

[13]  Tea Tusar,et al.  Visualization of Pareto Front Approximations in Evolutionary Multiobjective Optimization: A Critical Review and the Prosection Method , 2015, IEEE Transactions on Evolutionary Computation.

[14]  David G. Kirkpatrick,et al.  On the shape of a set of points in the plane , 1983, IEEE Trans. Inf. Theory.

[15]  Lily Rachmawati,et al.  Multiobjective Evolutionary Algorithm With Controllable Focus on the Knees of the Pareto Front , 2009, IEEE Transactions on Evolutionary Computation.

[16]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point Based Nondominated Sorting Approach, Part II: Handling Constraints and Extending to an Adaptive Approach , 2014, IEEE Transactions on Evolutionary Computation.

[17]  Alfred Inselberg,et al.  Parallel Coordinates: Visual Multidimensional Geometry and Its Applications , 2003, KDIR.

[18]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[19]  Jonathan E. Fieldsend,et al.  Visualizing Mutually Nondominating Solution Sets in Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[20]  Indraneel Das On characterizing the “knee” of the Pareto curve based on Normal-Boundary Intersection , 1999 .

[21]  Shahryar Rahnamayan,et al.  3D-RadVis: Visualization of Pareto front in many-objective optimization , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[22]  Gary G. Yen,et al.  Visualization and Performance Metric in Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.