Primate-inspired mental rotations: Implications for robot control

This paper describes research into the role of optic-flow derived spatial representations and their relation to cognitive computational models of mental rotation in primates, with the goal of producing effective and unique autonomous robot navigational capabilities. A theoretical framework is outlined spanning sensing, cognition, and motor control. Progress to date on its implementation within an autonomous robot control architecture is presented.

[1]  Björn Mauck,et al.  Mental Rotation of Perspective Stimuli in a California Sea Lion (Zalophus californianus) , 2003, Brain, Behavior and Evolution.

[2]  Frank Dellaert,et al.  Flow separation for fast and robust stereo odometry , 2009, 2009 IEEE International Conference on Robotics and Automation.

[3]  Ronald C. Arkin,et al.  Behavior-Based Robot Navigation for Extended Domains , 1992, Adapt. Behav..

[4]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[5]  R. Wehner,et al.  Visual navigation in insects: coupling of egocentric and geocentric information , 1996, The Journal of experimental biology.

[6]  C. Duffy.  MST neurons respond to optic flow and translational movement. , 1998, Journal of neurophysiology.

[7]  G. Dehnhardt,et al.  Mental rotation in a California sea lion (Zalophus californianus). , 1997, The Journal of experimental biology.

[8]  Christian Büchel,et al.  Spatial updating: how the brain keeps track of changing object locations during observer motion , 2008, Nature Neuroscience.

[9]  John R. Anderson.  Arguments concerning representations for mental imagery. , 1978 .

[10]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[11]  Lynn Andrea Stein,et al.  Imagination and situated cognition , 1991, J. Exp. Theor. Artif. Intell..

[12]  Björn Mauck,et al.  Mental Rotation and Rotational Invariance in the Rhesus Monkey (Macaca mulatta) , 2005, Brain, Behavior and Evolution.

[13]  Ronald C. Arkin,et al.  A Neural Schema Architecture for Autonomous Robots , 1998 .

[14]  Mandyam V. Srinivasan,et al.  Competent vision and navigation systems , 2009, IEEE Robotics & Automation Magazine.

[15]  Joo-Seok Hyun,et al.  Visual working memory as the substrate for mental rotation. , 2010, Psychonomic bulletin & review.

[16]  A. Georgopoulos,et al.  The mental and the neural: Psychological and neural studies of mental rotation and memory scanning , 1995, Neuropsychologia.

[17]  S. Kosslyn,et al.  Motor processes in mental rotation , 1998, Cognition.

[18]  Zhengyou Zhang,et al.  Iterative point matching for registration of free-form curves and surfaces , 1994, International Journal of Computer Vision.

[19]  Joël Fagot,et al.  Rotation of Mental Images in Baboons When the Visual Input Is Directed to the Left Cerebral Hemisphere , 1993 .

[20]  Ronald C. Arkin,et al.  Multi-robot system based on model of wolf hunting behavior to emulate wolf and elk interactions , 2010, 2010 IEEE International Conference on Robotics and Biomimetics.

[21]  Bernhard Schölkopf,et al.  Where did I take that snapshot? Scene-based homing by image matching , 1998, Biological Cybernetics.

[22]  Masahiro Fujita,et al.  An ethological and emotional basis for human-robot interaction , 2003, Robotics Auton. Syst..

[23]  Peter Khooshabeh.  Is mental rotation color blind , 2009 .

[24]  J. Gibson.  The Ecological Approach to Visual Perception , 1979 .

[25]  Frank Dellaert,et al.  Stereo Tracking and Three-Point/One-Point Algorithms - A Robust Approach in Visual Odometry , 2006, 2006 International Conference on Image Processing.

[26]  Ronald C. Arkin,et al.  TAME: Time-Varying Affective Response for Humanoid Robots , 2011, Int. J. Soc. Robotics.

[27]  Ronald C. Arkin,et al.  Ecological Robotics: A Schema-Theoretic Approach , 1996, Intelligent Robots.

[28]  Mary Hegarty,et al.  Modulation of neural activity by angle of rotation during imagined spatial transformations , 2006, NeuroImage.

[29]  Benjamin Kuipers,et al.  An Intellectual History of the Spatial Semantic Hierarchy , 2008, Robotics and Cognitive Approaches to Spatial Mapping.

[30]  Ferdinando A. Mussa-Ivaldi,et al.  Geometric Structure of the Adaptive Controller of the Human Arm , 1993 .

[31]  F A Mussa-Ivaldi,et al.  Computations underlying the execution of movement: a biological perspective. , 1991, Science.

[32]  Ronald C. Arkin,et al.  Usability evaluation of high-level user assistance for robot mission specification , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[33]  N. Franceschini,et al.  From insect vision to robot vision , 1992 .

[34]  Ilya A. Rybak,et al.  A Neurobiological Perspective on Humanoid Robot Design , 2000, IEEE Intell. Syst..

[35]  R. Hetherington.  The Perception of the Visual World , 1952 .

[36]  Naoyuki Sato,et al.  Spatial imagery of novel places based on visual scene transformation , 2012, Cognitive Systems Research.

[37]  Stella F. Lourenco,et al.  Using geometry to specify location: implications for spatial coding in children and nonhuman animals , 2007, Psychological research.

[38]  Charles J Duffy,et al.  Attentional dynamics and visual perception: mechanisms of spatial disorientation in Alzheimer's disease. , 2003, Brain : a journal of neurology.

[39]  Ronald C. Arkin,et al.  Behavioral models of the praying mantis as a basis for robotic behavior , 2000, Robotics Auton. Syst..

[40]  Ronald C. Arkin,et al.  Acting Deceptively: Providing Robots with the Capacity for Deception , 2011, Int. J. Soc. Robotics.

[41]  A. Georgopoulos.  On reaching. , 1986, Annual review of neuroscience.

[42]  R. Shepard,et al.  Upward direction, mental rotation, and discrimination of left and right turns in maps , 1984, Cognition.

[43]  Ronald C. Arkin,et al.  Lek behavior as a model for multi-robot systems , 2009, 2009 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[44]  Mary Hegarty,et al.  Representations of Shape during Mental Rotation , 2010, AAAI Spring Symposium: Cognitive Shape Processing.

[45]  J. A. Anthony,et al.  The Mental Rotation of Map Displays , 1992 .

[46]  Tad T. Brunyé,et al.  Spatial Mental Representation: Implications for Navigation System Design: , 2008 .

[47]  M. Heisenberg,et al.  The sensory-motor link in motion-dependent flight control of flies. , 1993, Reviews of oculomotor research.

[48]  Ronald C. Arkin,et al.  Multiagent Mission Specification and Execution , 1997, Auton. Robots.

[49]  J. Vauclair,et al.  Mirror-image matching and mental rotation problem solving by baboons (Papio papio): unilateral input enhances performance. , 1993, Journal of experimental psychology. General.

[50]  Björn Mauck,et al.  Visual Information Processing in the Lion-Tailed Macaque (Macaca silenus): Mental Rotation or Rotational Invariance? , 2005, Brain, Behavior and Evolution.

[51]  M. Kozhevnikov,et al.  Perspective-Taking vs. Mental Rotation Transformations and How They Predict Spatial Navigation Performance. , 2006 .

[52]  Andrew Vardy,et al.  Local visual homing by matched-filter descent in image distances , 2006, Biological Cybernetics.

[53]  A M Johnson,et al.  Speed of Mental Rotation as a Function of Problem-Solving Strategies , 1990, Perceptual and motor skills.

[54]  Michael F. Land.  Does Steering a Car Involve Perception of the Velocity Flow Field , 2001 .

[55]  Ronald C. Arkin,et al.  Motor Schema — Based Mobile Robot Navigation , 1989, Int. J. Robotics Res..

[56]  F. Bremmer,et al.  Perception of self-motion from visual flow , 1999, Trends in Cognitive Sciences.

[57]  William H. Warren,et al.  Optic flow is used to control human walking , 2001, Nature Neuroscience.

[58]  J. H. Steiger,et al.  Nonholistic processing in mental rotation: Some suggestive evidence , 1982, Perception & psychophysics.

[59]  Zenon W. Pylyshyn,et al.  What the Mind’s Eye Tells the Mind’s Brain: A Critique of Mental Imagery , 1973 .

[60]  R. Wurtz,et al.  Response of monkey MST neurons to optic flow stimuli with shifted centers of motion , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[61]  Ronald C. Arkin,et al.  Implementing Tolman's schematic sowbug: behavior-based robotics in the 1930's , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[62]  J D Delius,et al.  Rotational invariance in visual pattern recognition by pigeons and humans. , 1982, Science.

[63]  Gregor Schöner,et al.  A dynamical systems approach to task-level system integration used to plan and control autonomous vehicle motion , 1992, Robotics Auton. Syst..

[64]  Barbara Landau,et al.  Spatial representation across species: geometry, language, and maps , 2009, Current Opinion in Neurobiology.

[65]  Geoffrey W. Sutton.  Breaking the Spell: Religion as a Natural Phenomenon , 2009 .

[66]  Brice Isableu,et al.  Embodied spatial transformations: "body analogy" for the mental rotation of objects. , 2006, Journal of experimental psychology. General.

[67]  David N. Lee,et al.  Where we look when we steer , 1994, Nature.

[68]  Ronald C. Arkin,et al.  Motor schema based navigation for a mobile robot: An approach to programming by behavior , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[69]  Oussama Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1985, Autonomous Robot Vehicles.

[70]  F. Dellaert,et al.  Learning general optical flow subspaces for egomotion estimation and detection of motion anomalies , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.