Biologically Inspired Framework for Learning and Abstract Representation of Attention Control

The goal of this research is to develop a framework that enables artificial agents to learn active control of their attention as a means toward efficient planning, decision-making, and recognition. The proposed method is inspired by recent findings in psychology and neuroscience that give rise to the assumption that sequential firing of mirror neurons are connected with prediction, recognition, and planning. As these capabilities are connected to active perception, we hypothesize that simulated sequential mirror neurons can provide an abstract representation of learned attention control. The proposed framework consists of three phases. The first phase is designed for learning active control of attention using reinforcement learning. In the second phase, sequential concepts are extracted from the agent's experience and sequential mirror neurons are generated. In the last phase the concepts represented by these sequential mirror neurons are employed for higher level motor-planning and control of attention, as well as recognition.

[1]  S. Sherman,et al.  Receptive-field characteristics of neurons in cat striate cortex: Changes with visual field eccentricity. , 1976, Journal of neurophysiology.

[2]  José Santos-Victor,et al.  Visual learning by imitation with motor representations , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[3]  RICHARD L. DIDDAY,et al.  Eye Movements and Visual Perception: A "Two Visual System" Model , 1975, Int. J. Man Mach. Stud..

[4]  E. Miller,et al.  The prefontral cortex and cognitive control , 2000, Nature Reviews Neuroscience.

[5]  C. Hofsten,et al.  Infants predict other people's action goals , 2006, Nature Neuroscience.

[6]  L. Itti,et al.  Modeling the influence of task on attention , 2005, Vision Research.

[7]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[8]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[9]  L. Fogassi,et al.  Audiovisual mirror neurons and action recognition , 2003, Experimental Brain Research.

[10]  L. Stark,et al.  Scanpaths in Eye Movements during Pattern Perception , 1971, Science.

[11]  D. Noton,et al.  Eye movements and visual perception. , 1971, Scientific American.

[12]  Jean-Luc Velay,et al.  Interhemispheric sensorimotor integration in pointing movements: a study on dyslexic adults , 2002, Neuropsychologia.

[13]  J. Wolfe,et al.  What attributes guide the deployment of visual attention and how do they do it? , 2004, Nature Reviews Neuroscience.

[14]  J. Tanji,et al.  Neuronal activity in the supplementary and presupplementary motor areas for temporal organization of multiple movements. , 2000, Journal of neurophysiology.

[15]  J Tanji,et al.  Role for cells in the presupplementary motor area in updating motor plans. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[16]  J. Velay,et al.  The influence of writing practice on letter recognition in preschool children: a comparison between handwriting and typing. , 2005, Acta psychologica.

[17]  Jean-Luc Velay,et al.  Visual presentation of single letters activates a premotor area involved in writing , 2003, NeuroImage.

[18]  C. Gilbert,et al.  The Neural Basis of Perceptual Learning , 2001, Neuron.

[19]  D. Ballard,et al.  What you see is what you need. , 2003, Journal of vision.

[20]  G. Schneider Two visual systems. , 1969, Science.

[21]  Sigmund Exner,et al.  Untersuchungen über die Localisation der Functionen in der Grosshirnrinde des Menschen , 1881 .

[22]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[23]  E. Miller,et al.  THE PREFRONTAL CORTEX AND COGNITIVE CONTROL , 2000 .

[24]  G. Mangun,et al.  The neural mechanisms of top-down attentional control , 2000, Nature Neuroscience.

[25]  J. Stone,et al.  Properties of cat retinal ganglion cells: a comparison of W-cells with X- and Y-cells. , 1974, Journal of neurophysiology.

[26]  G. Rizzolatti Motor and visual-motor functions of the premotor cortex , 1988 .

[27]  O. Hikosaka,et al.  Activation of human presupplementary motor area in learning of sequential procedures: a functional MRI study. , 1996, Journal of neurophysiology.

[28]  John K. Tsotsos Analyzing vision at the complexity level , 1990, Behavioral and Brain Sciences.

[29]  R. Klein,et al.  Inhibition of return , 2000, Trends in Cognitive Sciences.

[30]  E. L. Berry,et al.  Association of abnormal cerebellar activation with motor learning difficulties in dyslexic adults , 1999, The Lancet.

[31]  F. Ohl,et al.  Fallacies in behavioural interpretation of auditory cortex plasticity , 2004, Nature Reviews Neuroscience.

[32]  Harri Valpola,et al.  Development of Representations, Categories and Concepts—a Hypothesis , 2005, 2005 International Symposium on Computational Intelligence in Robotics and Automation.

[33]  Jun Tanji,et al.  Role for supplementary motor area cells in planning several movements ahead , 1994, Nature.

[34]  Erik D. Reichle,et al.  Using reinforcement learning to understand the emergence of "intelligent" eye-movement behavior during reading. , 2006, Psychological review.

[35]  D. Robinson,et al.  Shared neural control of attentional shifts and eye movements , 1996, Nature.

[36]  M. Naka Repeated writing facilitates children’s memory for pseudocharacters and foreign letters , 1998, Memory & cognition.

[37]  D. Ts'o,et al.  Functional organization of primate visual cortex revealed by high resolution optical imaging. , 1990, Science.

[38]  A. Cowey PROJECTION OF THE RETINA ON TO STRIATE AND PRESTRIATE CORTEX IN THE SQUIRREL MONKEY, SAIMIRI SCIUREUS. , 1964, Journal of neurophysiology.

[39]  M. Hallett,et al.  The functional neuroanatomy of simple and complex sequential finger movements: a PET study. , 1998, Brain : a journal of neurology.

[40]  Andy Clark,et al.  Where brain, body, and world collide , 1998, Cognitive Systems Research.

[41]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[42]  P. Dean,et al.  Impaired performance of children with dyslexia on a range of cerebellar tasks , 1996, Annals of dyslexia.

[43]  W. J. Nowack Neurobiology of Neocortex , 1989, Neurology.

[44]  C. Hulme The Interaction of Visual and Motor Memory for Graphic Forms following Tracing , 1979, The Quarterly journal of experimental psychology.

[45]  I. Rybak,et al.  A model of attention-guided visual perception and recognition , 1998, Vision Research.

[46]  M. Posner,et al.  Selective attention and cognitive control , 1987, Trends in Neurosciences.

[47]  G. Rizzolatti,et al.  Motor facilitation during action observation: a magnetic stimulation study. , 1995, Journal of neurophysiology.

[48]  Hossein Mobahi,et al.  A BIOLOGICALLY INSPIRED METHOD FOR CONCEPTUAL IMITATION USING REINFORCEMENT LEARNING , 2007, Appl. Artif. Intell..