How Cognitive Models of Human Body Experience Might Push Robotics

In the last decades, cognitive models of multisensory integration in human beings have been developed and applied to model human body experience. Recent research indicates that Bayesian and connectionist models might push developments in various branches of robotics: assistive robotic devices might adapt to their human users aiming at increased device embodiment, e.g., in prosthetics, and humanoid robots could be endowed with human-like capabilities regarding their surrounding space, e.g., by keeping safe or socially appropriate distances to other agents. In this perspective paper, we review cognitive models that aim to approximate the process of human sensorimotor behavior generation, discuss their challenges and potentials in robotics, and give an overview of existing approaches. While model accuracy is still subject to improvement, human-inspired cognitive models support the understanding of how the modulating factors of human body experience are blended. Implementing the resulting insights in adaptive and learning control algorithms could help to taylor assistive devices to their user's individual body experience. Humanoid robots who develop their own body schema could consider this body knowledge in control and learn to optimize their physical interaction with humans and their environment. Cognitive body experience models should be improved in accuracy and online capabilities to achieve these ambitious goals, which would foster human-centered directions in various fields of robotics.

[1]  R. Weale Vision. A Computational Investigation Into the Human Representation and Processing of Visual Information. David Marr , 1983 .

[2]  Jonathan D. Cohen,et al.  Rubber hands ‘feel’ touch that eyes see , 1998, Nature.

[3]  Mitsuo Kawato,et al.  MOSAIC Model for Sensorimotor Learning and Control , 2001, Neural Computation.

[4]  Miomir Vukobratović,et al.  Intelligent Control of Robotic Systems , 2003 .

[5]  Giulio Sandini,et al.  Developmental robotics: a survey , 2003, Connect. Sci..

[6]  Nicholas P. Holmes,et al.  The body schema and multisensory representation(s) of peripersonal space , 2004, Cognitive Processing.

[7]  Alexandre Pouget,et al.  Bayesian multisensory integration and cross-modal spatial links , 2004, Journal of Physiology-Paris.

[8]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[9]  Konrad Paul Kording,et al.  Review TRENDS in Cognitive Sciences Vol.10 No.7 July 2006 Special Issue: Probabilistic models of cognition Bayesian decision theory in sensorimotor control , 2022 .

[10]  Konrad Paul Kording,et al.  Causal Inference in Multisensory Perception , 2007, PloS one.

[11]  J. Tenenbaum,et al.  Intuitive theories as grammars for causal inference , 2007 .

[12]  M. Bassolino,et al.  Extended Multisensory Space in Blind Cane Users , 2007, Psychological science.

[13]  Ron Sun,et al.  The Cambridge Handbook of Computational Psychology , 2008 .

[14]  James L. McClelland,et al.  Connectionist models of cognition. , 2008 .

[15]  Á. Mayer,et al.  Body schema and body awareness of amputees , 2008, Prosthetics and orthotics international.

[16]  J. Bradshaw,et al.  Mechanisms underlying embodiment, disembodiment and loss of embodiment , 2008, Neuroscience & Biobehavioral Reviews.

[17]  Marjolein P. M. Kammers,et al.  What is embodiment? A psychometric approach , 2008, Cognition.

[18]  T. Shultz,et al.  The Cambridge Handbook of Computational Psychology: Computational Models of Developmental Psychology , 2008 .

[19]  H. Ehrsson,et al.  Upper limb amputees can be induced to experience a rubber hand as their own , 2008, Brain : a journal of neurology.

[20]  Stefan Ulbrich,et al.  Rapid learning of humanoid body schemas with Kinematic Bézier Maps , 2009, 2009 9th IEEE-RAS International Conference on Humanoid Robots.

[21]  Active body schema learning , 2009 .

[22]  Masaki Ogino,et al.  Cognitive Developmental Robotics: A Survey , 2009, IEEE Transactions on Autonomous Mental Development.

[23]  Wolfram Burgard,et al.  Body schema learning for robotic manipulators from visual self-perception , 2009, Journal of Physiology - Paris.

[24]  Angelo Cangelosi,et al.  Epigenetic Robotics Architecture (ERA) , 2010, IEEE Transactions on Autonomous Mental Development.

[25]  Giulio Sandini,et al.  The iCub humanoid robot: An open-systems platform for research in cognitive development , 2010, Neural Networks.

[26]  Alejandro Hernández Arieta,et al.  Body Schema in Robotics: A Review , 2010, IEEE Transactions on Autonomous Mental Development.

[27]  Oliver Alan Kannape,et al.  The limits of agency in walking humans , 2010, Neuropsychologia.

[28]  Max Berniker,et al.  Bayesian approaches to sensory integration for motor control. , 2011, Wiley interdisciplinary reviews. Cognitive science.

[29]  Gergő Orbán,et al.  Representations of uncertainty in sensorimotor control , 2011, Current Opinion in Neurobiology.

[30]  Jan Peters,et al.  Model learning for robot control: a survey , 2011, Cognitive Processing.

[31]  David W. Franklin,et al.  Computational Mechanisms of Sensorimotor Control , 2011, Neuron.

[32]  Giulio Sandini,et al.  Force Control and Reaching Movements on the iCub Humanoid Robot , 2011, ISRR.

[33]  Adam N. Sanborn,et al.  Bridging Levels of Analysis for Probabilistic Models of Cognition , 2012 .

[34]  Thomas R. Shultz,et al.  Computational Models in Developmental Psychology , 2013 .

[35]  A. Clark Whatever next? Predictive brains, situated agents, and the future of cognitive science. , 2013, The Behavioral and brain sciences.

[36]  M. Reiner,et al.  Perspectives and possible applications of the rubber hand and virtual hand illusion in non-invasive rehabilitation: Technological improvements and their consequences , 2014, Neuroscience & Biobehavioral Reviews.

[37]  Albert Jin Chung,et al.  Perception of Body Ownership Is Driven by Bayesian Sensory Inference , 2015, PloS one.

[38]  Lorenzo Rosasco,et al.  Teaching iCub to recognize objects using deep Convolutional Neural Networks , 2015, MLIS@ICML.

[39]  Alessandro Roncone,et al.  Learning peripersonal space representation through artificial skin for avoidance and reaching with whole body surface , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[40]  Ed Vul,et al.  Choosing fast and slow: explaining differences between hedonic and utilitarian choices , 2015, CogSci.

[41]  Junpei Zhong,et al.  Artificial Neural Models for Feedback Pathways for Sensorimotor Integration , 2015 .

[42]  Alessandro Roncone,et al.  Peripersonal Space and Margin of Safety around the Body: Learning Visuo-Tactile Associations in a Humanoid Robot with Artificial Skin , 2016, PloS one.

[43]  M. Molinari,et al.  The embodiment of assistive devices-from wheelchair to exoskeleton. , 2016, Physics of life reviews.

[44]  Bruno Lara,et al.  Body Representations for Robot Ego-Noise Modelling and Prediction. Towards the Development of a Sense of Agency in Artificial Agents , 2016, ALIFE.

[45]  Bruno Lara,et al.  Exploration Behaviors, Body Representations, and Simulation Processes for the Development of Cognition in Artificial Agents , 2016, Front. Robot. AI.

[46]  Matteo Bianchi,et al.  A Human–Robot Interaction Perspective on Assistive and Rehabilitation Robotics , 2017, Front. Neurorobot..

[47]  Gordon Cheng,et al.  Yielding Self-Perception in Robots Through Sensorimotor Contingencies , 2017, IEEE Transactions on Cognitive and Developmental Systems.

[48]  Giorgio Metta,et al.  Robotic Homunculus: Learning of Artificial Skin Representation in a Humanoid Robot Motivated by Primary Somatosensory Cortex , 2018, IEEE Transactions on Cognitive and Developmental Systems.

[49]  Stefan Wermter,et al.  On the Robustness of Speech Emotion Recognition for Human-Robot Interaction with Deep Neural Networks , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[50]  Justine C. Cléry,et al.  Frontier of Self and Impact Prediction , 2018, Front. Psychol..

[51]  Gordon Cheng,et al.  Adaptive Robot Body Learning and Estimation Through Predictive Coding , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[52]  J. O'Regan,et al.  Which limb is it? Responses to vibrotactile stimulation in early infancy , 2017, The British journal of developmental psychology.

[53]  Claudio Castellini,et al.  Robotic interfaces for cognitive psychology and embodiment research: A research roadmap. , 2018, Wiley interdisciplinary reviews. Cognitive science.