Brain-Computer Evolutionary Multiobjective Optimization: A Genetic Algorithm Adapting to the Decision Maker

The centrality of the decision maker (DM) is widely recognized in the multiple criteria decision-making community. This translates into emphasis on seamless human-computer interaction, and adaptation of the solution technique to the knowledge which is progressively acquired from the DM. This paper adopts the methodology of reactive search optimization (RSO) for evolutionary interactive multiobjective optimization. RSO follows to the paradigm of “learning while optimizing,” through the use of online machine learning techniques as an integral part of a self-tuning optimization scheme. User judgments of couples of solutions are used to build robust incremental models of the user utility function, with the objective to reduce the cognitive burden required from the DM to identify a satisficing solution. The technique of support vector ranking is used together with a k-fold cross-validation procedure to select the best kernel for the problem at hand, during the utility function training procedure. Experimental results are presented for a series of benchmark problems.

[1]  Hong-Zhong Huang,et al.  Intelligent interactive multiobjective optimization method and its application to reliability optimization , 2005 .

[2]  Robert F. Dell,et al.  An interactive MCDM weight space reduction method utilizing a tchebycheff utility function , 1990 .

[3]  Yuesheng Xu,et al.  Universal Kernels , 2006, J. Mach. Learn. Res..

[4]  Andrea Passerini,et al.  Adapting to a Realistic Decision Maker: Experiments towards a Reactive Multi-objective Optimizer , 2010, LION.

[5]  R. S. Laundy,et al.  Multiple Criteria Optimisation: Theory, Computation and Application , 1989 .

[6]  Thomas Gärtner,et al.  Kernels for structured data , 2008, Series in Machine Perception and Artificial Intelligence.

[7]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[8]  Charles A. Micchelli,et al.  Learning Multiple Tasks with Kernel Methods , 2005, J. Mach. Learn. Res..

[9]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[10]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[11]  Minghe Sun,et al.  Solving Multiple Objective Programming Problems Using Feed-Forward Artificial Neural Networks: The Interactive FFANN Procedure , 1996 .

[12]  Paolo Toth,et al.  Knapsack Problems: Algorithms and Computer Implementations , 1990 .

[13]  Donald R. Jones,et al.  A Taxonomy of Global Optimization Methods Based on Response Surfaces , 2001, J. Glob. Optim..

[14]  Indraneel Das A preference ordering among various Pareto optimal alternatives , 1999 .

[15]  Leena Tanner Selecting a text-processing system as a qualitative multiple criteria problem , 1991 .

[16]  Michael Collins,et al.  Convolution Kernels for Natural Language , 2001, NIPS.

[17]  Ralph E. Steuer,et al.  An interactive weighted Tchebycheff procedure for multiple objective programming , 1983, Math. Program..

[18]  Hideyuki Takagi,et al.  Interactive evolutionary computation: fusion of the capabilities of EC optimization and human evaluation , 2001, Proc. IEEE.

[19]  Garrison W. Greenwood,et al.  Searching for multiobjective preventive maintenance schedules: Combining preferences with evolutionary algorithms , 2007, Eur. J. Oper. Res..

[20]  Yoshua Bengio,et al.  Scaling learning algorithms towards AI , 2007 .

[21]  Jürgen Branke,et al.  Consideration of Partial User Preferences in Evolutionary Multiobjective Optimization , 2008, Multiobjective Optimization.

[22]  T. Saaty Axiomatic foundation of the analytic hierarchy process , 1986 .

[23]  Kaisa Miettinen,et al.  Introduction to Multiobjective Optimization: Interactive Approaches , 2008, Multiobjective Optimization.

[24]  Yoram Singer,et al.  Learning to Order Things , 1997, NIPS.

[25]  Craig Boutilier,et al.  Minimax regret based elicitation of generalized additive utilities , 2007, UAI.

[26]  Marco Laumanns,et al.  Scalable multi-objective optimization test problems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[27]  Stanley Zionts,et al.  An improved method for solving multiple criteria problems involving discrete alternatives , 1984, IEEE Transactions on Systems, Man, and Cybernetics.

[28]  Jason Weston,et al.  Curriculum learning , 2009, ICML '09.

[29]  J. March Bounded rationality, ambiguity, and the engineering of choice , 1978 .

[30]  Minghe Sun,et al.  Interactive multiple objective programming using Tchebycheff programs and artificial neural networks , 2000, Comput. Oper. Res..

[31]  Rich Caruana,et al.  Multitask Learning , 1998, Encyclopedia of Machine Learning and Data Mining.

[32]  Mauro Brunato,et al.  Reactive Search and Intelligent Optimization , 2008 .

[33]  Kaisa Miettinen,et al.  Introduction to Multiobjective Optimization: Noninteractive Approaches , 2008, Multiobjective Optimization.

[34]  Michael C. Burl,et al.  Active learning for directed exploration of complex systems , 2009, ICML '09.

[35]  Aravind Seshadri,et al.  A FAST ELITIST MULTIOBJECTIVE GENETIC ALGORITHM: NSGA-II , 2000 .

[36]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2003, ICTAI.

[37]  Dirk Thierens,et al.  The balance between proximity and diversity in multiobjective evolutionary algorithms , 2003, IEEE Trans. Evol. Comput..

[38]  B. Roy,et al.  A Theoretical Framework for Analysing the Notion of Relative Importance of Criteria , 1996 .

[39]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[40]  C. Cinel,et al.  P300-Based BCI Mouse With Genetically-Optimized Analogue Control , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[41]  Carlos A. Coello Coello,et al.  Handling preferences in evolutionary multiobjective optimization: a survey , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[42]  Michael Collins,et al.  New Ranking Algorithms for Parsing and Tagging: Kernels over Discrete Structures, and the Voted Perceptron , 2002, ACL.

[43]  V. V. Podinovskii The Quantitative Importance of Criteria with Discrete First-Order Metric Scale , 2004 .

[44]  Jürgen Branke,et al.  Interactive Multiobjective Evolutionary Algorithms , 2008, Multiobjective Optimization.

[45]  Andrew P. Sage,et al.  A model of multiattribute decisionmaking and trade-off weight determination under uncertainty , 1984, IEEE Transactions on Systems, Man, and Cybernetics.

[46]  Murat Köksalan,et al.  An Interactive Evolutionary Metaheuristic for Multiobjective Combinatorial Optimization , 2003, Manag. Sci..

[47]  Dana Angluin,et al.  Queries and concept learning , 1988, Machine Learning.

[48]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[49]  Jason Weston,et al.  Scaling Learning Algorithms toward AI , 2007 .

[50]  Dana Angluin,et al.  Learning with hints , 1988, COLT '88.

[51]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[52]  Soon-Thiam Khu,et al.  An Investigation on Preference Order Ranking Scheme for Multiobjective Evolutionary Optimization , 2007, IEEE Transactions on Evolutionary Computation.

[53]  José Rui Figueira,et al.  Interactive Multiobjective Optimization Using a Set of Additive Value Functions , 2008, Multiobjective Optimization.

[54]  Kalyanmoy Deb,et al.  Muiltiobjective Optimization Using Nondominated Sorting in Genetic Algorithms , 1994, Evolutionary Computation.