Simple Substrates for Complex Cognition

Complex cognitive tasks present a range of computational and algorithmic challenges for neural accounts of both learning and inference. In particular, it is extremely hard to solve them using the sort of simple policies that have been extensively studied as solutions to elementary Markov decision problems. There has thus been recent interest in architectures for the instantiation and even learning of policies that are formally more complicated than these, involving operations such as gated working memory. However, the focus of these ideas and methods has largely been on what might best be considered as automatized, routine or, in the sense of animal conditioning, habitual, performance. Thus, they have yet to provide a route towards understanding the workings of rule-based control, which is critical for cognitively sophisticated competence. Here, we review a recent suggestion for a uniform architecture for habitual and rule-based execution, discuss some of the habitual mechanisms that underpin the use of rules, and consider a statistical relationship between rules and habits.

[1]  Tomaso Poggio,et al.  Models of object recognition , 2000, Nature Neuroscience.

[2]  John R. Anderson Acquisition of cognitive skill. , 1982 .

[3]  John McCarthy,et al.  SOME PHILOSOPHICAL PROBLEMS FROM THE STANDPOINT OF ARTI CIAL INTELLIGENCE , 1987 .

[4]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[5]  E. Koechlin,et al.  Supporting On-line Material Materials and Methods , 2022 .

[6]  Daniel M. Wolpert,et al.  Forward Models for Physiological Motor Control , 1996, Neural Networks.

[7]  John R. Anderson,et al.  A central circuit of the mind , 2008, Trends in Cognitive Sciences.

[8]  T. Poggio A theory of how the brain might work. , 1990, Cold Spring Harbor symposia on quantitative biology.

[9]  G. Logan Toward an instance theory of automatization. , 1988 .

[10]  李幼升,et al.  Ph , 1989 .

[11]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .

[12]  N. Cowan,et al.  Separating cognitive capacity from knowledge: a new hypothesis , 2007, Trends in Cognitive Sciences.

[13]  C. Summerfield,et al.  An information theoretical approach to prefrontal executive function , 2007, Trends in Cognitive Sciences.

[14]  T. Sejnowski,et al.  Spatial Transformations in the Parietal Cortex Using Basis Functions , 1997, Journal of Cognitive Neuroscience.

[15]  Joshua B. Tenenbaum,et al.  Separating Style and Content with Bilinear Models , 2000, Neural Computation.

[16]  P. Dayan,et al.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control , 2005, Nature Neuroscience.

[17]  Michael J. Frank,et al.  Interactions between frontal cortex and basal ganglia in working memory: A computational model , 2001, Cognitive, affective & behavioral neuroscience.

[18]  D. V. van Essen,et al.  A neurobiological model of visual attention and invariant pattern recognition based on dynamic routing of information , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[19]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[20]  John Fletcher Simple associations , 2008, BMJ : British Medical Journal.

[21]  Jonathan Evans In two minds: dual-process accounts of reasoning , 2003, Trends in Cognitive Sciences.

[22]  Tony A. Plate,et al.  Holographic Reduced Representation: Distributed Representation for Cognitive Structures , 2003 .

[23]  Geoffrey E. Hinton,et al.  Mundane Reasoning by Parallel Constraint Satisfaction , 1990 .

[24]  Peter Dayan,et al.  Bilinearity, Rules, and Prefrontal Cortex , 2007, Frontiers Comput. Neurosci..

[25]  E. R. Crossman A THEORY OF THE ACQUISITION OF SPEED-SKILL∗ , 1959 .

[26]  John R. Anderson,et al.  The acquisition of robust and flexible cognitive skills. , 2008, Journal of experimental psychology. General.

[27]  P. Dayan,et al.  Flexible shaping: How learning in small steps helps , 2009, Cognition.

[28]  Jürgen Schmidhuber,et al.  Learning to Forget: Continual Prediction with LSTM , 2000, Neural Computation.

[29]  B. Balleine,et al.  Motivational control of heterogeneous instrumental chains. , 1995 .

[30]  R. Shiffrin,et al.  Controlled and automatic human information processing: I , 1977 .

[31]  Stefan Wermter,et al.  Hybrid Neural Systems , 1998, Lecture Notes in Computer Science.

[32]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[33]  H. Spinnler The prefrontal cortex, Anatomy, physiology, and neuropsychology of the frontal lobe, J.M. Fuster. Raven Press, New York (1980), IX-222 pages , 1981 .

[34]  Carla H. Lagorio,et al.  Psychology , 1929, Nature.

[35]  Geoffrey E. Hinton Tensor Product Variable Binding and the Representation of Symbolic Structures in Connectionist Systems , 1991 .

[36]  S. Chaiken,et al.  Dual-process theories in social psychology , 1999 .

[37]  S. Sloman The empirical case for two systems of reasoning. , 1996 .

[38]  D M Wolpert,et al.  Multiple paired forward and inverse models for motor control , 1998, Neural Networks.

[39]  R. Poldrack,et al.  Dissociable Controlled Retrieval and Generalized Selection Mechanisms in Ventrolateral Prefrontal Cortex , 2005, Neuron.

[40]  D. Kahneman,et al.  Representativeness revisited: Attribute substitution in intuitive judgment. , 2002 .

[41]  Walter Schneider,et al.  Controlled and Automatic Human Information Processing: 1. Detection, Search, and Attention. , 1977 .

[42]  Kunihiko Fukushima,et al.  Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position , 1980, Biological Cybernetics.

[43]  Michael J. Frank,et al.  Making Working Memory Work: A Computational Model of Learning in the Prefrontal Cortex and Basal Ganglia , 2006, Neural Computation.

[44]  Mitsuo Kawato,et al.  A forward-inverse optics model of reciprocal connections between visual cortical areas , 1993 .

[45]  Refractor Vision , 2000, The Lancet.

[46]  R. Shiffrin,et al.  Automatic and controlled processing revisited. , 1984, Psychological review.

[47]  S. Epstein Integration of the cognitive and the psychodynamic unconscious. , 1994, The American psychologist.

[48]  Geoffrey E. Hinton,et al.  Autoencoders, Minimum Description Length and Helmholtz Free Energy , 1993, NIPS.

[49]  E. Miller,et al.  A Neural Circuit Model of Flexible Sensorimotor Mapping: Learning and Forgetting on Multiple Timescales , 2007, Neuron.

[50]  Rajesh P. N. Rao,et al.  Probabilistic Models of the Brain: Perception and Neural Function , 2002 .

[51]  Thomas E. Hazy,et al.  Towards an executive without a homunculus: computational models of the prefrontal cortex/basal ganglia system , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[52]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[53]  J. B. Levitt,et al.  Patterns of intrinsic and associational circuitry in monkey prefrontal cortex , 1996, The Journal of comparative neurology.

[54]  Geoffrey E. Hinton,et al.  The "wake-sleep" algorithm for unsupervised neural networks. , 1995, Science.

[55]  Peter Dayan,et al.  Images, Frames, and Connectionist Hierarchies , 2006, Neural Computation.

[56]  N. Cohen From Conditioning to Conscious Recollection Memory Systems of the Brain. Oxford Psychology Series, Volume 35. , 2001 .

[57]  Allen and Rosenbloom Paul S. Newell,et al.  Mechanisms of Skill Acquisition and the Law of Practice , 1993 .

[58]  K. Stanovich,et al.  Heuristics and Biases: Individual Differences in Reasoning: Implications for the Rationality Debate? , 2002 .

[59]  E. Koechlin,et al.  The role of the anterior prefrontal cortex in human cognition , 1999, Nature.

[60]  Geoffrey E. Hinton Preface to the Special Issue on Connectionist Symbol Processing , 1990 .

[61]  Geoffrey E. Hinton,et al.  A Distributed Connectionist Production System , 1988, Cogn. Sci..

[62]  Geoffrey E. Hinton,et al.  The Helmholtz Machine , 1995, Neural Computation.

[63]  De Vries Book review: R.C. O'Reilly and Y. Munakata: Computational explorations in cognitive neuroscience: understanding the mind by stimulating the brain. Cambridge, Mass: The MIT Press. , 2002 .

[64]  R. O’Reilly,et al.  Computational Explorations in Cognitive Neuroscience: Understanding the Mind by Simulating the Brain , 2000 .

[65]  Paul M. Fitts,et al.  Perceptual-Motor Skill Learning1 , 1964 .

[66]  A. Dickinson Actions and habits: the development of behavioural autonomy , 1985 .

[67]  G. Kane Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol 1: Foundations, vol 2: Psychological and Biological Models , 1994 .

[68]  Andrea J. van Doorn,et al.  The Generic Bilinear Calibration-Estimation Problem , 2004, International Journal of Computer Vision.

[69]  Thomas E. Hazy,et al.  Banishing the homunculus: Making working memory work , 2006, Neuroscience.

[70]  Richard Reviewer-Granger Unified Theories of Cognition , 1991, Journal of Cognitive Neuroscience.