Intrinsic Motivation and Mental Replay enable Efficient Online Adaptation in Stochastic Recurrent Networks

[1]  Brad E. Pfeiffer,et al.  Hippocampal place cell sequences depict future paths to remembered goals , 2013, Nature.

[2]  Pierre-Yves Oudeyer,et al.  Motivational principles for visual know-how development , 2003 .

[3]  Andrew G. Barto,et al.  Intrinsically Motivated Reinforcement Learning: A Promising Framework for Developmental Robot Learning , 2005 .

[4]  Shuzhi Sam Ge,et al.  Dynamic Motion Planning for Mobile Robots Using Potential Field Method , 2002, Auton. Robots.

[5]  Abdelhamid Tayebi.  Adaptive iterative learning control for robot manipulators , 2003, Proceedings of the 2003 American Control Conference, 2003..

[6]  Doina Precup,et al.  Between MDPs and Semi-MDPs: A Framework for Temporal Abstraction in Reinforcement Learning , 1999, Artif. Intell..

[7]  Marco Mirolli,et al.  GRAIL: A Goal-Discovering Robotic Architecture for Intrinsically-Motivated Learning , 2016, IEEE Transactions on Cognitive and Developmental Systems.

[8]  Jochen J. Steil,et al.  Neural learning and dynamical selection of redundant solutions for inverse kinematic control , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[9]  A.G. Alleyne,et al.  A survey of iterative learning control , 2006, IEEE Control Systems.

[10]  A. Barto,et al.  Novelty or Surprise? , 2013, Front. Psychol..

[11]  L. Festinger.  Cognitive dissonance. , 1962, Scientific American.

[12]  Antoine Cully,et al.  Robots that can adapt like animals , 2014, Nature.

[13]  Andrew G. Barto,et al.  Competence progress intrinsic motivation , 2010, 2010 IEEE 9th International Conference on Development and Learning.

[14]  Marc Toussaint,et al.  Learned graphical models for probabilistic planning provide a new class of movement primitives , 2013, Front. Comput. Neurosci..

[15]  Marko Bacic,et al.  Model predictive control , 2003 .

[16]  M. Botvinick,et al.  Planning as inference , 2012, Trends in Cognitive Sciences.

[17]  Giulio Sandini,et al.  Autonomous Online Learning of Reaching Behavior in a humanoid Robot , 2012, Int. J. Humanoid Robotics.

[18]  Jürgen Schmidhuber,et al.  Developmental robotics, optimal artificial curiosity, creativity, music, and the fine arts , 2006, Connect. Sci..

[19]  Jürgen Schmidhuber,et al.  Formal Theory of Creativity, Fun, and Intrinsic Motivation (1990–2010) , 2010, IEEE Transactions on Autonomous Mental Development.

[20]  Benjamin Schrauwen,et al.  Feedback Control by Online Learning an Inverse Model , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[21]  David Kappel,et al.  STDP Installs in Winner-Take-All Circuits an Online Approximation to Hidden Markov Model Learning , 2014, PLoS Comput. Biol..

[22]  E. Deci,et al.  Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. , 2000, The American psychologist.

[23]  Jan Peters,et al.  Recurrent Spiking Networks Solve Planning Tasks , 2016, Scientific Reports.

[24]  Jean-Claude Latombe,et al.  Numerical potential field techniques for robot path planning , 1991, Fifth International Conference on Advanced Robotics 'Robots in Unstructured Environments.

[25]  Stephen Hart,et al.  Learning Generalizable Control Programs , 2011, IEEE Transactions on Autonomous Mental Development.

[26]  Pierre-Brice Wieber,et al.  Stabilization of the Capture Point Dynamics for Bipedal Walking Based on Model Predictive Control , 2012, SyRoCo.

[27]  R. W. White.  Motivation reconsidered: the concept of competence. , 1959, Psychological review.

[28]  J. Michael Herrmann,et al.  Learning predictive representations , 2000, Neurocomputing.

[29]  Jean-Pascal Pfister,et al.  Sequence learning with hidden units in spiking neural networks , 2011, NIPS.

[30]  R. Elliott,et al.  Arthritic pain is processed in brain areas concerned with emotions and fear. , 2007, Arthritis and rheumatism.

[31]  Mark B. Ring.  CHILD: A First Step Towards Continual Learning , 1997, Machine Learning.

[32]  Samuel Gershman,et al.  Design Principles of the Hippocampal Cognitive Map , 2014, NIPS.

[33]  David Johan Christensen,et al.  A distributed and morphology-independent strategy for adaptive locomotion in self-reconfigurable modular robots , 2013, Robotics Auton. Syst..

[34]  James L. McClelland,et al.  Autonomous Mental Development by Robots and Animals , 2001, Science.

[35]  Sebastian Thrun,et al.  Lifelong robot learning , 1993, Robotics Auton. Syst..

[36]  S. M. Arnsten.  Intrinsic motivation. , 1990, The American journal of occupational therapy : official publication of the American Occupational Therapy Association.

[37]  Juyang Weng,et al.  Developmental Robotics: Theory and Experiments , 2004, Int. J. Humanoid Robotics.

[38]  G. Crombez,et al.  The Fear-Avoidance Model of Musculoskeletal Pain: Current State of Scientific Evidence , 2006, Journal of Behavioral Medicine.

[39]  David J. Foster,et al.  Reverse replay of behavioural sequences in hippocampal place cells during the awake state , 2006, Nature.

[40]  Wulfram Gerstner,et al.  Spiking Neuron Models: Single Neurons, Populations, Plasticity , 2002 .

[41]  Lydia Tapia,et al.  Path-guided artificial potential fields with stochastic reachable sets for motion planning in highly dynamic environments , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[42]  Nuttapong Chentanez,et al.  Intrinsically Motivated Learning of Hierarchical Collections of Skills , 2004 .

[43]  Eric Eaton,et al.  ELLA: An Efficient Lifelong Learning Algorithm , 2013, ICML.

[44]  Min Cheol Lee,et al.  Artificial potential field based path planning for mobile robots using a virtual obstacle concept , 2003, Proceedings 2003 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM 2003).

[45]  Max Lungarella,et al.  Developmental Robotics , 2009, Encyclopedia of Artificial Intelligence.

[46]  Jan Peters,et al.  Online Learning with Stochastic Recurrent Neural Networks using Intrinsic Motivation Signals , 2017, CoRL.

[47]  Geoffrey E. Hinton.  Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[48]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[49]  Vicenç Gómez,et al.  Optimal control as a graphical model inference problem , 2009, Machine Learning.

[50]  Byoung-Tak Zhang,et al.  Online learning of a full body push recovery controller for omnidirectional walking , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[51]  Sridhar Mahadevan,et al.  Recent Advances in Hierarchical Reinforcement Learning , 2003, Discret. Event Dyn. Syst..

[52]  Marco Mirolli,et al.  Intrinsically Motivated Learning in Natural and Artificial Systems , 2013 .

[53]  E. Deci,et al.  Self-determination theory and the facilitation of intrinsic motivation , 2000 .

[54]  Uğur M Erdem,et al.  A goal‐directed spatial navigation model using forward trajectory planning based on grid cells , 2012, The European journal of neuroscience.

[55]  Dongbing Gu,et al.  Neural predictive control for a car-like mobile robot , 2002, Robotics Auton. Syst..

[56]  E. Deci,et al.  Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions. , 2000, Contemporary educational psychology.

[57]  Vincent Padois,et al.  Emergence of humanoid walking behaviors from mixed-integer model predictive control , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[58]  Pierre-Yves Oudeyer,et al.  Intrinsic motivation, curiosity, and learning: Theory and applications in educational technologies. , 2016, Progress in brain research.

[59]  Jochen J. Steil,et al.  Goal Babbling Permits Direct Learning of Inverse Kinematics , 2010, IEEE Transactions on Autonomous Mental Development.

[60]  J. Kagan.  Motives and development. , 1972, Journal of personality and social psychology.

[61]  E. Rolls,et al.  Self-organizing continuous attractor networks and path integration: one-dimensional models of head direction cells , 2002, Network.

[62]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[63]  Frank Kirchner,et al.  Incremental learning of skill collections based on intrinsic motivation , 2013, Front. Neurorobot..

[64]  V. Santucci.  Intrinsic motivation signals for driving the acquisition of multiple tasks : A simulated robotic study , 2013 .

[65]  Pierre-Yves Oudeyer,et al.  Intrinsic Motivation Systems for Autonomous Mental Development , 2007, IEEE Transactions on Evolutionary Computation.

[66]  Jan Peters,et al.  Deep spiking networks for model-based planning in humanoids , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[67]  Aude Billard,et al.  Online Learning of the Body Schema , 2008, Int. J. Humanoid Robotics.

[68]  Giulio Sandini,et al.  Developmental robotics: a survey , 2003, Connect. Sci..

[69]  Wolfgang Maass,et al.  Neural Dynamics as Sampling: A Model for Stochastic Computation in Recurrent Networks of Spiking Neurons , 2011, PLoS Comput. Biol..

[70]  Pierre-Yves Oudeyer,et al.  What is Intrinsic Motivation? A Typology of Computational Approaches , 2007, Frontiers Neurorobotics.

[71]  Jan Peters,et al.  Efficient online adaptation with stochastic recurrent neural networks , 2017, 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids).

[72]  Masaki Ogino,et al.  Cognitive Developmental Robotics: A Survey , 2009, IEEE Transactions on Autonomous Mental Development.

[73]  T. Martin McGinnity,et al.  Novelty Detection as an Intrinsic Motivation for Cumulative Learning Robots , 2013, Intrinsically Motivated Learning in Natural and Artificial Systems.

[74]  Carlos Bordons Alba,et al.  Model Predictive Control , 2012 .

[75]  Gianluca Baldassarre,et al.  What are intrinsic motivations? A biological perspective , 2011, 2011 IEEE International Conference on Development and Learning (ICDL).