Emergence in Cognitive Science

The study of human intelligence was once dominated by symbolic approaches, but over the last 30 years an alternative approach has arisen. Symbols and processes that operate on them are often seen today as approximate characterizations of the emergent consequences of sub- or nonsymbolic processes, and a wide range of constructs in cognitive science can be understood as emergents. These include representational constructs (units, structures, rules), architectural constructs (central executive, declarative memory), and developmental processes and outcomes (stages, sensitive periods, neurocognitive modules, developmental disorders). The greatest achievements of human cognition may be largely emergent phenomena. It remains a challenge for the future to learn more about how these greatest achievements arise and to emulate them in artificial systems.

[1]  James L. McClelland,et al.  Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. , 1995, Psychological review.

[2]  R. Siegler.  Three aspects of cognitive development , 1976, Cognitive Psychology.

[3]  J A Kelso,et al.  Dynamic pattern generation in behavioral and neural systems. , 1988, Science.

[4]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[5]  R. Jackendoff.  Linguistics in Cognitive Science: The state of the art , 2007 .

[6]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[7]  James L. McClelland,et al.  Rules or connections in past-tense inflections: what does the evidence rule out? , 2002, Trends in Cognitive Sciences.

[8]  M. Gopnik,et al.  Familial aggregation of a developmental language disorder , 1991, Cognition.

[9]  Noam Chomsky,et al.  वाक्यविन्यास का सैद्धान्तिक पक्ष = Aspects of the theory of syntax , 1965 .

[10]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[11]  Marvin Minsky,et al.  K-Lines: A theory of Memory , 1980, Cogn. Sci..

[12]  Wayne D. Gray,et al.  Topics in Cognitive Science , 2009 .

[13]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[14]  James L. McClelland,et al.  Understanding normal and impaired word reading: computational principles in quasi-regular domains. , 1996, Psychological review.

[15]  Joshua B. Tenenbaum,et al.  Church: a language for generative models , 2008, UAI.

[16]  Clara Pinto Correia.  The Ovary of Eve: Egg and Sperm and Preformation , 1997 .

[17]  D. Hofstadter,et al.  Godel, Escher, Bach: An Eternal Golden Braid , 1979 .

[18]  S. Pinker,et al.  The past and future of the past tense , 2002, Trends in Cognitive Sciences.

[19]  J. Flavell.  The Developmental psychology of Jean Piaget , 1963 .

[20]  Karl J. Friston,et al.  Neural basis of an inherited speech and language disorder. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[21]  James L. McClelland.  Memory as a Constructive Process , 2010 .

[22]  B. MacWhinney,et al.  Implementations are not conceptualizations: Revising the verb learning model , 1991, Cognition.

[23]  V. Braitenberg.  Vehicles, Experiments in Synthetic Psychology , 1984 .

[24]  Linda B. Smith,et al.  Development as a dynamic system , 1992, Trends in Cognitive Sciences.

[25]  James L. McClelland,et al.  On learning the past-tenses of English verbs: implicit rules or parallel distributed processing , 1986 .

[26]  M. Turvey.  Impredicativity, Dynamics, and the Perception-Action Divide , 2004 .

[27]  L. Squire.  Memory and the hippocampus: a synthesis from findings with rats, monkeys, and humans. , 1992, Psychological review.

[28]  R. Glushko.  The Organization and Activation of Orthographic Knowledge in Reading Aloud. , 1979 .

[29]  R. Venezky.  The Structure of English Orthography , 1965 .

[30]  J. Tenenbaum,et al.  Structured statistical models of inductive reasoning. , 2009, Psychological review.

[31]  Robert S Siegler,et al.  Development of rules and strategies: balancing the old and the new. , 2002, Journal of experimental child psychology.

[32]  J. Scharf.  [Language evolution]. , 1973, Gegenbaurs morphologisches Jahrbuch.

[33]  James L. McClelland.  Memory as a Constructive Process: The Parallel Distributed Processing Approach , 2010 .

[34]  David Badre,et al.  Left ventrolateral prefrontal cortex and the cognitive control of memory , 2007, Neuropsychologia.

[35]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: I. An account of basic findings. , 1981 .

[36]  F. Keil.  Constraints on knowledge and cognitive development. , 1981 .

[37]  Joan L. Bybee,et al.  Gradience of Gradience: A reply to Jackendoff , 2007 .

[38]  H. Haken.  Synergetics: an Introduction, Nonequilibrium Phase Transitions and Self-organization in Physics, Chemistry, and Biology , 1977 .

[39]  James L. McClelland,et al.  An Interactive Activation Model of the Effect of Context in Perception. Part II. Report No. 8003. , 1980 .

[40]  Michael S. C. Thomas,et al.  Exploring the Williams syndrome face-processing debate: the importance of building developmental trajectories. , 2004, Journal of child psychology and psychiatry, and allied disciplines.

[41]  H. B. Pepinsky.  Culture and Thought: A Psychological Introduction. , 1974 .

[42]  Glenn W. Suter,et al.  The Reluctant Mr. Darwin , 2006 .

[43]  George Henry Lewes,et al.  Problems of life and mind , 1874 .

[44]  Philipp Slusallek,et al.  Introduction to real-time ray tracing , 2005, SIGGRAPH Courses.

[45]  H. Morowitz.  The Emergence of Everything: How the World Became Complex , 2002 .

[46]  G. Marcus.  The Algebraic Mind: Integrating Connectionism and Cognitive Science , 2001 .

[47]  J. Cacioppo,et al.  Handbook of neuroscience for the behavioral sciences , 2009 .

[48]  James L. McClelland,et al.  State-Dependent Factors Influencing Neural Plasticity: A Partial Account of the Critical Period , 1987 .

[49]  Stephen A. Ritz,et al.  Distinctive features, categorical perception, and probability learning: some applications of a neural model , 1977 .

[50]  S. Pinker,et al.  On language and connectionism: Analysis of a parallel distributed processing model of language acquisition , 1988, Cognition.

[51]  Bob McMurray,et al.  Defusing the Childhood Vocabulary Explosion , 2007, Science.

[52]  T. Bever,et al.  The relation between linguistic structure and associative theories of language learning—A constructive critique of some connectionist learning models , 1988, Cognition.

[53]  J. Elman,et al.  Rethinking Innateness: A Connectionist Perspective on Development , 1996 .

[54]  Geoffrey E. Hinton,et al.  Distributed Representations , 1986, The Philosophy of Artificial Intelligence.

[55]  James L. McClelland,et al.  ‘Words or Rules’ cannot exploit the regularity in exceptions , 2002, Trends in Cognitive Sciences.

[56]  D. Plaut,et al.  Doing without schema hierarchies: a recurrent connectionist approach to normal and impaired routine sequential action. , 2004, Psychological review.

[57]  James L. McClelland,et al.  A connectionist model of a continuous developmental transition in the balance scale task , 2009, Cognition.

[58]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[59]  H. Spinnler.  The prefrontal cortex, Anatomy, physiology, and neuropsychology of the frontal lobe, J.M. Fuster. Raven Press, New York (1980), IX-222 pages , 1981 .

[60]  Xiao-Jing Wang,et al.  Probabilistic Decision Making by Slow Reverberation in Cortical Circuits , 2002, Neuron.

[61]  David C. Plaut.  Face and Word Processing: Two Sides of the Same Brain , 2008 .

[62]  R. F. Thompson,et al.  The search for the engram. , 1976, The American psychologist.

[63]  J. Kelso,et al.  Coordination Dynamics: Issues and Trends , 2004, Understanding Complex Systems.

[64]  Mark S. Seidenberg,et al.  Age-of-acquisition effects in reading aloud: Tests of cumulative frequency and frequency trajectory , 2004, Memory & cognition.

[65]  Paul Smolensky,et al.  Information processing in dynamical systems: foundations of harmony theory , 1986 .

[66]  J. Fuster.  The Prefrontal Cortex , 1997 .

[67]  Peter M. Todd,et al.  Learning and connectionist representations , 1993 .

[68]  James L. McClelland,et al.  Letting structure emerge: connectionist and dynamical systems approaches to cognition , 2010, Trends in Cognitive Sciences.

[69]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[71]  M. Page,et al.  Connectionist modelling in psychology: A localist manifesto , 2000, Behavioral and Brain Sciences.

[72]  James L. McClelland,et al.  Semantic Cognition: A Parallel Distributed Processing Approach , 2004 .

[73]  J. Fodor,et al.  Connectionism and cognitive architecture: A critical analysis , 1988, Cognition.

[74]  M Coltheart,et al.  DRC: a dual route cascaded model of visual word recognition and reading aloud. , 2001, Psychological review.

[75]  James L. McClelland,et al.  Autonomous Mental Development by Robots and Animals , 2001, Science.

[76]  James L. McClelland,et al.  Success and failure of new speech category learning in adulthood: Consequences of learned Hebbian attractors in topographic maps , 2007, Cognitive, affective & behavioral neuroscience.

[77]  D. Chalmers.  Strong and Weak Emergence , 2006 .

[78]  D. Lewkowicz,et al.  A dynamic systems approach to the development of cognition and action. , 2007, Journal of cognitive neuroscience.

[79]  Jeffrey S Bowers,et al.  On the biological plausibility of grandmother cells: implications for neural network theories in psychology and neuroscience. , 2009, Psychological review.

[80]  S. Pinker.  The Language Instinct , 1994 .

[81]  Helmut Gernsheim,et al.  W. H. Fox Talbot and the history of photography , 1977 .

[82]  G. Reeke.  The society of mind , 1991 .

[83]  Paul W. Munro.  State-dependent factors influencing neural plasticity: a partial account of the , 1986 .

[84]  Allen Newell,et al.  Physical Symbol Systems , 1980, Cogn. Sci..

[85]  James L. McClelland.  Parallel Distributed Processing: Implications for Cognition and Development , 1988 .

[86]  Terrence J. Sejnowski,et al.  Parallel Networks that Learn to Pronounce English Text , 1987, Complex Syst..

[87]  B. Mesquita,et al.  Adjustment to Chronic Diseases and Terminal Illness Health Psychology : Psychological Adjustment to Chronic Disease , 2006 .

[88]  J. Barwise,et al.  Visual information and valid reasoning , 1991 .

[89]  Charles Cole,et al.  Fluid concepts and creative analogies: Computer models of the fundamental mechanisms of thought , 1996 .

[90]  J. Flege.  Second Language Speech Learning Theory , Findings , and Problems , 2006 .

[91]  Joan L. Bybee,et al.  Mechanisms of Change in Grammaticization: The Role of Frequency , 2008 .

[92]  Margaret A. Boden,et al.  Douglas Hofstadter and the Fluid Analogies Research Group, Fluid Concepts and Creative Analogies: Computer Models of the Fundamental Mechanisms of Thought , 2004, Minds and Machines.

[93]  Michael S. C. Thomas,et al.  Modeling language acquisition in atypical phenotypes. , 2003, Psychological review.

[94]  K. T. Spoehr,et al.  The role of orthographic and phonotactic rules in perceiving letter patterns. , 1975, Journal of experimental psychology. Human perception and performance.

[95]  M. Sur,et al.  Rewiring cortex: the role of patterned activity in development and plasticity of neocortical circuits. , 1999, Journal of neurobiology.

[96]  R. Galatzer-Levy.  Emergence , 2002 .

[97]  R. Ratcliff,et al.  Multialternative decision field theory: a dynamic connectionist model of decision making. , 2001, Psychological review.

[98]  Douglas L. Medin,et al.  Context theory of classification learning. , 1978 .

[99]  James L. McClelland.  Running Head : Letting Structure Emerge Letting Structure Emerge : Connectionist and Dynamical Systems Approaches to Understanding Cognition , 2009 .