Evolution of neural networks

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author. GECCO ’18 Companion, July 15-19, 2018, Kyoto, Japan 2018 Copyright is held by the owner/author(s). ACM ISBN 978-1-4503-5764-7/18/07. https://doi.org/10.1145/3205651.3207857

[1]  Risto Miikkulainen,et al.  Hierarchical evolution of neural networks , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[2]  Masanori Suganuma,et al.  A genetic programming approach to designing convolutional neural network architectures , 2017, GECCO.

[3]  Stefano Nolfi,et al.  Good teaching inputs do not correspond to desired responses in ecological neural networks , 1994, Neural Processing Letters.

[4]  L. Darrell Whitley,et al.  Adding Learning to the Cellular Development of Neural Networks: Evolution and the Baldwin Effect , 1993, Evolutionary Computation.

[5]  David Pfau,et al.  Convolution by Evolution: Differentiable Pattern Producing Networks , 2016, GECCO.

[6]  Dario Floreano,et al.  Neuroevolution: from architectures to learning , 2008, Evol. Intell..

[7]  Risto Miikkulainen,et al.  Constructing controllers for physical multilegged robots using the ENSO neuroevolution approach , 2012, Evol. Intell..

[8]  Kenneth O. Stanley,et al.  Learning to Dance through Interactive Evolution , 2010, EvoApplications.

[9]  Shimon Whiteson,et al.  Evolutionary Function Approximation for Reinforcement Learning , 2006, J. Mach. Learn. Res..

[10]  Dario Floreano,et al.  Evolutionary robots with on-line self-organization and behavioral fitness , 2000, Neural Networks.

[11]  Risto Miikkulainen,et al.  Task decomposition with neuroevolution in extended predator-prey domain , 2012, ALIFE.

[12]  Risto Miikkulainen,et al.  Evolving Symmetry for Modular System Design , 2011, IEEE Trans. Evol. Comput..

[13]  Risto Miikkulainen,et al.  Accelerated Neural Evolution through Cooperatively Coevolved Synapses , 2008, J. Mach. Learn. Res..

[14]  Vijay Vasudevan,et al.  Learning Transferable Architectures for Scalable Image Recognition , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[15]  Shimon Whiteson,et al.  Comparing evolutionary and temporal difference methods in a reinforcement learning domain , 2006, GECCO.

[16]  Alexis P. Wieland,et al.  Evolving Controls for Unstable Systems , 1991 .

[17]  Karl Sims,et al.  Evolving 3D Morphology and Behavior by Competition , 1994, Artificial Life.

[18]  J. D. Schaffer,et al.  Combinations of genetic algorithms and neural networks: a survey of the state of the art , 1992, [Proceedings] COGANN-92: International Workshop on Combinations of Genetic Algorithms and Neural Networks.

[19]  R. Miikkulainen,et al.  Learning Behavior Characterizations for Novelty Search , 2016, GECCO.

[20]  Jeffrey L. Elman,et al.  Learning and Evolution in Neural Networks , 1994, Adapt. Behav..

[21]  Risto Miikkulainen,et al.  Incremental Evolution of Complex General Behavior , 1997, Adapt. Behav..

[22]  Kenneth O. Stanley,et al.  A Case Study on the Critical Role of Geometric Regularity in Machine Learning , 2008, AAAI.

[23]  Risto Miikkulainen,et al.  A Taxonomy for Artificial Embryogeny , 2003, Artificial Life.

[24]  Alok Aggarwal,et al.  Regularized Evolution for Image Classifier Architecture Search , 2018, AAAI.

[25]  Chrisantha Fernando,et al.  PathNet: Evolution Channels Gradient Descent in Super Neural Networks , 2017, ArXiv.

[26]  Kenneth O. Stanley,et al.  A novel generative encoding for exploiting neural network sensor and output geometry , 2007, GECCO '07.

[27]  Frank Hutter,et al.  CMA-ES for Hyperparameter Optimization of Deep Neural Networks , 2016, ArXiv.

[28]  Risto Miikkulainen,et al.  Cultural enhancement of neuroevolution , 2002 .

[29]  Shimon Whiteson,et al.  Neuroevolutionary reinforcement learning for generalized control of simulated helicopters , 2011, Evol. Intell..

[30]  Risto Miikkulainen,et al.  Acquiring Visibly Intelligent Behavior with Example-Guided Neuroevolution , 2007, AAAI.

[31]  Risto Miikkulainen,et al.  Evolving Neural Networks through Augmenting Topologies , 2002, Evolutionary Computation.

[32]  L. D. Whitley,et al.  Genetic Reinforcement Learning for Neurocontrol Problems , 2004, Machine Learning.

[33]  Elliot Meyerson,et al.  Discovering evolutionary stepping stones through behavior domination , 2017, GECCO.

[34]  Risto Miikkulainen,et al.  A neuro-evolution method for dynamic resource allocation on a chip multiprocessor , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[35]  Donald E. Waagen,et al.  Evolving recurrent perceptrons for time-series modeling , 1994, IEEE Trans. Neural Networks.

[36]  Xin Yao,et al.  Evolutionary ensembles with negative correlation learning , 2000, IEEE Trans. Evol. Comput..

[37]  Geoffrey E. Hinton,et al.  How Learning Can Guide Evolution , 1996, Complex Syst..

[38]  Ronald J. Williams,et al.  Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning , 2004, Machine Learning.

[39]  Simon M. Lucas,et al.  A comparison of matrix rewriting versus direct encoding for evolving neural networks , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[40]  Kenneth O. Stanley,et al.  Abandoning Objectives: Evolution Through the Search for Novelty Alone , 2011, Evolutionary Computation.

[41]  Risto Miikkulainen,et al.  Numerical optimization with neuroevolution , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[42]  Risto Miikkulainen,et al.  Evolving Keepaway Soccer Players through Task Decomposition , 2003, GECCO.

[43]  Holger H. Hoos,et al.  Programming by optimization , 2012, Commun. ACM.

[44]  Risto Miikkulainen,et al.  Evolving neural network ensembles for control problems , 2005, GECCO '05.

[45]  Risto Miikkulainen,et al.  Trading control intelligence for physical intelligence: muscle drives in evolved virtual creatures , 2014, GECCO.

[46]  Risto Miikkulainen,et al.  Dynamic Adaptation and Opponent Exploitation in Computer Poker , 2018, AAAI Workshops.

[47]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[48]  Risto Miikkulainen,et al.  Constructing good learners using evolved pattern generators , 2005, GECCO '05.

[49]  Kenneth A. De Jong,et al.  Cooperative Coevolution: An Architecture for Evolving Coadapted Subcomponents , 2000, Evolutionary Computation.

[50]  Elliot Meyerson,et al.  Evolutionary architecture search for deep multitask networks , 2018, GECCO.

[51]  Risto Miikkulainen,et al.  Evolving adaptive neural networks with and without adaptive synapses , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[52]  Kenneth O. Stanley,et al.  On the Relationship Between the OpenAI Evolution Strategy and Stochastic Gradient Descent , 2017, ArXiv.

[53]  Magnus Thor Jonsson,et al.  Evolution and design of distributed learning rules , 2000, 2000 IEEE Symposium on Combinations of Evolutionary Computation and Neural Networks. Proceedings of the First IEEE Symposium on Combinations of Evolutionary Computation and Neural Networks (Cat. No.00.

[54]  H. P. de Vladar.  Why Greatness Cannot Be Planned: The Myth of the Objective , 2016, Leonardo.

[55]  Risto Miikkulainen,et al.  From Nodes to Networks: Evolving Recurrent Neural Networks , 2018, ArXiv.

[56]  Richard K. Belew,et al.  Evolution, Learning, and Culture: Computational Metaphors for Adaptive Algorithms , 1990, Complex Syst..

[57]  Risto Miikkulainen,et al.  Efficient evolution of neural networks through complexification , 2004 .

[58]  Risto Miikkulainen,et al.  Human-Like Combat Behaviour via Multiobjective Neuroevolution , 2012, Believable Bots.

[59]  Risto Miikkulainen,et al.  Modular neuroevolution for multilegged locomotion , 2008, GECCO '08.

[60]  Kenneth O. Stanley,et al.  ES is more than just a traditional finite-difference approximator , 2017, GECCO.

[61]  Xi Chen,et al.  Evolution Strategies as a Scalable Alternative to Reinforcement Learning , 2017, ArXiv.

[62]  Peter J. Angeline,et al.  An evolutionary algorithm that constructs recurrent neural networks , 1994, IEEE Trans. Neural Networks.

[63]  David H. Sharp,et al.  Scaling, machine learning, and genetic neural nets , 1989 .

[64]  Chris Aldrich,et al.  Intelligent process control utilising symbiotic memetic neuro-evolution , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[65]  Kenneth O. Stanley,et al.  Generative encoding for multiagent learning , 2008, GECCO '08.

[66]  Marco Colombetti,et al.  Incremental Robot Shaping , 1998, Connect. Sci..

[67]  Brad Fullmer and Risto Miikkulainen.  Using Marker-Based Genetic Encoding Of Neural Networks To Evolve Finite-State Behaviour , 1991 .

[68]  Christian Igel,et al.  Neuroevolution for reinforcement learning using evolution strategies , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[69]  Kenneth O. Stanley,et al.  Simple Evolutionary Optimization Can Rival Stochastic Gradient Descent in Neural Networks , 2016, GECCO.

[70]  Lawrence Davis,et al.  Training Feedforward Neural Networks Using Genetic Algorithms , 1989, IJCAI.

[71]  Risto Miikkulainen,et al.  Evolving Strategies for Social Innovation Games , 2015, GECCO.

[72]  Risto Miikkulainen,et al.  Evolutionary Bilevel Optimization for Complex Control Tasks , 2015, GECCO.

[73]  Risto Miikkulainen,et al.  Evolving symmetric and modular neural networks for distributed control , 2009, GECCO.

[74]  X. Yao.  Evolving Artificial Neural Networks , 1999 .

[75]  David J. Chalmers,et al.  The Evolution of Learning: An Experiment in Genetic Connectionism , 1991 .

[76]  Kenneth O. Stanley,et al.  Picbreeder: A Case Study in Collaborative Evolutionary Exploration of Design Space , 2011, Evolutionary Computation.

[77]  Quoc V. Le,et al.  Large-Scale Evolution of Image Classifiers , 2017, ICML.

[78]  Elliot Meyerson,et al.  Beyond Shared Hierarchies: Deep Multitask Learning through Soft Layer Ordering , 2017, ICLR.

[79]  Risto Miikkulainen,et al.  Accelerating evolution via egalitarian social learning , 2012, GECCO '12.

[80]  Risto Miikkulainen,et al.  Acquiring evolvability through adaptive representations , 2007, GECCO '07.

[81]  Risto Miikkulainen,et al.  Open-ended behavioral complexity for evolved virtual creatures , 2013, GECCO '13.

[82]  Samy Bengio,et al.  Show and tell: A neural image caption generator , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[83]  Risto Miikkulainen,et al.  Efficient credit assignment through evaluation function decomposition , 2005, GECCO '05.

[84]  Risto Miikkulainen,et al.  Evolving Deep LSTM-based Memory Networks using an Information Maximization Objective , 2016, GECCO.

[85]  Risto Miikkulainen,et al.  Creating melodies with evolving recurrent neural networks , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[86]  J. Baldwin.  A New Factor in Evolution , 1896, The American Naturalist.

[87]  Shimon Whiteson,et al.  Stochastic Optimization for Collision Selection in High Energy Physics , 2006, AAAI.

[88]  Risto Miikkulainen,et al.  Evolving Reusable Neural Modules , 2004, GECCO.

[89]  Kenneth O. Stanley,et al.  Scaffolding for Interactively Evolving Novel Drum Tracks for Existing Songs , 2008, EvoWorkshops.

[90]  Jen Jen Chung,et al.  Evolving memory-augmented neural architecture for deep memory problems , 2017, GECCO.

[91]  Risto Miikkulainen,et al.  Robust non-linear control through neuroevolution , 2003 .

[92]  Quoc V. Le,et al.  Neural Architecture Search with Reinforcement Learning , 2016, ICLR.

[93]  Risto Miikkulainen,et al.  Adaptive Control Utilising Neural Swarming , 2002, GECCO.

[94]  Risto Miikkulainen,et al.  Evolving Adaptive Poker Players for Effective Opponent Exploitation , 2017, AAAI Workshops.

[95]  Risto Miikkulainen,et al.  Forming Neural Networks Through Efficient and Adaptive Coevolution , 1997, Evolutionary Computation.

[96]  Risto Miikkulainen,et al.  Neuro-evolution and natural deduction , 2000, 2000 IEEE Symposium on Combinations of Evolutionary Computation and Neural Networks. Proceedings of the First IEEE Symposium on Combinations of Evolutionary Computation and Neural Networks (Cat. No.00.

[97]  Risto Miikkulainen,et al.  Evolving agent behavior in multiobjective domains using fitness-based shaping , 2010, GECCO '10.

[98]  Kenneth O. Stanley,et al.  Deep Neuroevolution: Genetic Algorithms Are a Competitive Alternative for Training Deep Neural Networks for Reinforcement Learning , 2017, ArXiv.