The parallel distributed processing approach to semantic cognition

How do we know what properties something has, and which of its properties should be generalized to other objects? How is the knowledge underlying these abilities acquired, and how is it affected by brain disorders? Our approach to these issues is based on the idea that cognitive processes arise from the interactions of neurons through synaptic connections. The knowledge in such interactive and distributed processing systems is stored in the strengths of the connections and is acquired gradually through experience. Degradation of semantic knowledge occurs through degradation of the patterns of neural activity that probe the knowledge stored in the connections. Simulation models based on these ideas capture semantic cognitive processes and their development and disintegration, encompassing domain-specific patterns of generalization in young children, and the restructuring of conceptual knowledge as a function of experience.

[1]  I. Sigel,et al.  HANDBOOK OF CHILD PSYCHOLOGY , 2006 .

[2]  W. Scoville,et al.  LOSS OF RECENT MEMORY AFTER BILATERAL HIPPOCAMPAL LESIONS , 1957, Journal of neurology, neurosurgery, and psychiatry.

[3]  T. Kuhn,et al.  The Structure of Scientific Revolutions. , 1964 .

[4]  J. Flavell.  The Developmental psychology of Jean Piaget , 1963 .

[5]  Marvin Minsky,et al.  Semantic Information Processing , 1968 .

[6]  H. R. Quillian.  In semantic information processing , 1968 .

[7]  M. Ross Quillian,et al.  Retrieval time from semantic memory , 1969 .

[8]  D Marr,et al.  Simple memory: a theory for archicortex. , 1971, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[9]  R. Brown.  A First Language , 1973 .

[10]  Lance J. Rips,et al.  Semantic distance and the verification of semantic relations , 1973 .

[11]  D. Rumelhart,et al.  A model for analogical reasoning. , 1973 .

[12]  E. Warrington.  Quarterly Journal of Experimental Psychology the Selective Impairment of Semantic Memory the Selective Impairment of Semantic Memory , 2022 .

[13]  E. Rosch.  Cognitive Representations of Semantic Categories. , 1975 .

[14]  Wayne D. Gray,et al.  Basic objects in natural categories , 1976, Cognitive Psychology.

[15]  Douglas L. Medin,et al.  Context theory of classification learning. , 1978 .

[16]  Richard C. Anderson,et al.  Schooling and the Acquisition of Knowledge , 1978 .

[17]  “Schooling and the acquisition of knowledge” , 1979 .

[18]  M. McCloskey,et al.  Decision processes in verifying category membership statements: Implications for models of semantic memory , 1979, Cognitive Psychology.

[19]  J. G. Snodgrass,et al.  A standardized set of 260 pictures: norms for name agreement, image agreement, familiarity, and visual complexity. , 1980, Journal of experimental psychology. Human learning and memory.

[20]  Charles E. Caton,et al.  Semantic and Conceptual Development: An Ontological Perspective , 1982 .

[21]  T. Shallice,et al.  Category specific semantic impairments. , 1998, Brain : a journal of neurology.

[22]  Stephen M. Kosslyn,et al.  Pictures and names: Making the connection , 1984, Cognitive Psychology.

[23]  D. Medin,et al.  The role of theories in conceptual coherence. , 1985, Psychological review.

[24]  S. Carey.  Conceptual Change in Childhood , 1985 .

[25]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[26]  H. Brownell,et al.  Category differentiation in object recognition: typicality constraints on the basic category advantage. , 1985, Journal of experimental psychology. Learning, memory, and cognition.

[27]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[28]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[29]  P. Eling.  Current perspectives in dysphasia, Stanton Newman, Ruth Epstein (Eds.). Churchill Livingstone, Edinburgh, London, Melbourne and New York (1985), 236, ISBN: 0 443 03039 1 , 1986 .

[30]  R. Nosofsky.  Attention, similarity, and the identification-categorization relationship. , 1986 .

[31]  E. Markman,et al.  Categories and induction in young children , 1986, Cognition.

[32]  Geoffrey E. Hinton,et al.  Schemata and Sequential Thought Processes in PDP Models , 1986 .

[33]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[34]  E. Warrington,et al.  Categories of knowledge. Further fractionations and an attempted integration. , 1987, Brain : a journal of neurology.

[35]  Geoffrey E. Hinton,et al.  Learning Representations by Recirculation , 1987, NIPS.

[36]  James L. McClelland.  Parallel Distributed Processing: Implications for Cognition and Development , 1988 .

[37]  U. Neisser.  Concepts and Conceptual Development: Ecological and Intellectual Factors in Categorization , 1989 .

[38]  Geoffrey E. Hinton.  Learning distributed representations of concepts. , 1989 .

[39]  F. Keil.  Concepts, Kinds, and Cognitive Development , 1989 .

[40]  D. Neary,et al.  Semantic dementia: a form of circumscribed cerebral atrophy , 1995 .

[41]  Geoffrey E. Hinton,et al.  Parallel Models of Associative Memory , 1989 .

[42]  James L. McClelland,et al.  Finite State Automata and Simple Recurrent Networks , 1989, Neural Computation.

[43]  Ronald J. Williams,et al.  A Learning Algorithm for Continually Running Fully Recurrent Neural Networks , 1989, Neural Computation.

[44]  Antonio R. Damasio,et al.  The Brain Binds Entities and Events by Multiregional Activation from Convergence Zones , 1989, Neural Computation.

[45]  P. Milner.  A cell assembly theory of hippocampal amnesia , 1989, Neuropsychologia.

[46]  R. Morris.  Parallel Distributed Processing: Implications for Psychology and Neurobiology , 1990 .

[47]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[48]  John R. Anderson.  The Adaptive Character of Thought , 1990 .

[49]  David E. Rumelhart,et al.  Brain style computation: learning and generalization , 1990 .

[50]  G. Wolters.  Parallel Distributed Processing: Implications for Psychology and Neurobiology edited by R. G. M. Morris, Oxford University Press, 1989. £40.00 (x + 339 pages) ISBN 0 19 852178 2 , 1990, Trends in Neurosciences.

[51]  Rochel Gelman,et al.  First Principles Organize Attention to and Learning About Relevant Data: Number and the Animate-Inanimate Distinction as Examples , 1990, Cogn. Sci..

[52]  J. Reggia.  Book review: An Introduction to Neural and Electronic Networks. Edited by Steven E Zornetzer, Joel L. Davis, and Clifford Lau (Academic Press) , 1990, SGAR.

[53]  Michael I. Jordan,et al.  A more biologically plausible learning rule for neural networks. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[54]  B. MacWhinney.  The CHILDES project: tools for analyzing talk , 1992 .

[55]  Philippe G. Schyns,et al.  A Modular Neural Network Model of Concept Acquisition , 1991, Cogn. Sci..

[56]  F. Keil,et al.  Early differentiation of causal mechanisms appropriate to biological and nonbiological kinds. , 1991, Child development.

[57]  S. Carey,et al.  The Epigenesis of mind : essays on biology and cognition , 1991 .

[58]  James L. McClelland,et al.  A computational model of semantic memory impairment: modality specificity and emergent category specificity. , 1991, Journal of experimental psychology. General.

[59]  J. F. Macario,et al.  Young children's use of color in classification: Foods and canonically colored objects , 1991 .

[60]  J. Mandler,et al.  Separating the sheep from the goats: Differentiating global categories , 1991, Cognitive Psychology.

[61]  J. Mandler.  How to build a baby: II. Conceptual primitives. , 1992, Psychological review.

[62]  Mark F. St. John,et al.  The Story Gestalt: A Model of Knowledge-Intensive Processes in Text Comprehension , 1992, Cogn. Sci..

[63]  J. Hodges,et al.  Semantic dementia. Progressive fluent aphasia with temporal lobe atrophy. , 1992, Brain : a journal of neurology.

[64]  L. Squire.  Memory and the hippocampus: a synthesis from findings with rats, monkeys, and humans. , 1992, Psychological review.

[65]  J. Kruschke,et al.  ALCOVE: an exemplar-based connectionist model of category learning. , 1992, Psychological review.

[66]  Michael I. Jordan,et al.  Computational Consequences of a Bias toward Short Connections , 1992, Journal of Cognitive Neuroscience.

[67]  T. Shallice,et al.  Deep Dyslexia: A Case Study of , 1993 .

[68]  J. Mandler,et al.  Concept formation in infancy , 1993 .

[69]  Peter M. Todd,et al.  Learning and connectionist representations , 1993 .

[70]  N. Furlong.  The epigenesis of mind: Essays in biology and cognition , 1993 .

[71]  B. Bertenthal,et al.  The Epigenesis of Mind: Essays on Biology and Cognition , 1993 .

[72]  E. Spelke,et al.  Domain-specific knowledge and conceptual change , 1994 .

[73]  G. Kane.  Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol 1: Foundations, vol 2: Psychological and Biological Models , 1994 .

[74]  A. Gopnik,et al.  The theory theory. , 1994 .

[75]  P Alvarez,et al.  Memory consolidation and the medial temporal lobe: a simple network model. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[76]  S. Gelman,et al.  Mapping the Mind: Domain Specificity In Cognition And Culture , 1994 .

[77]  Leslie G. Ungerleider,et al.  Discrete Cortical Regions Associated with Knowledge of Color and Knowledge of Action , 1995, Science.

[78]  James L. McClelland,et al.  Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. , 1995, Psychological review.

[79]  D. Plaut.  Double dissociation without modularity: evidence from connectionist neuropsychology. , 1995, Journal of clinical and experimental neuropsychology.

[80]  Joel L. Davis,et al.  An Introduction to Neural and Electronic Networks , 1995 .

[81]  J. Hodges,et al.  Charting the progression in semantic dementia: implications for the organisation of semantic memory. , 1995, Memory.

[82]  Randall C. O'Reilly,et al.  Biologically Plausible Error-Driven Learning Using Local Activation Differences: The Generalized Recirculation Algorithm , 1996, Neural Computation.

[83]  Alexander J. Smola,et al.  Neural Information Processing Systems , 1997, NIPS 1997.

[84]  Mark S. Seidenberg,et al.  Double Dissociation of Semantic Categories in Alzheimer's Disease , 1997, Brain and Language.

[85]  James L. McClelland,et al.  Rethinking infant knowledge: toward an adaptive process account of successes and failures in object permanence tasks. , 1997, Psychological review.

[86]  Mark S. Seidenberg,et al.  On the nature and scope of featural representations of word meaning. , 1997, Journal of experimental psychology. General.

[87]  L. Nadel,et al.  Memory consolidation, retrograde amnesia and the hippocampal complex , 1997, Current Opinion in Neurobiology.

[88]  M. Johnson,et al.  The emergence of perceptual category representations in young infants: a connectionist analysis. , 1997, Journal of experimental child psychology.

[89]  Thomas J. Palmeri,et al.  An Exemplar-Based Random Walk Model of Speeded Classification , 1997 .

[90]  Teuvo Kohonen,et al.  The self-organizing map , 1990, Neurocomputing.

[91]  W. Ahn.  Why are different features central for natural kinds and artifacts?: the role of causal status in determining feature centrality , 1998, Cognition.

[92]  Mark S. Seidenberg,et al.  Category-Specific Semantic Deficits in Focal and Widespread Brain Damage: A Computational Account , 1998, Journal of Cognitive Neuroscience.

[93]  N. Chater,et al.  Rational models of cognition , 1998 .

[94]  A. Caramazza,et al.  Domain-Specific Knowledge Systems in the Brain: The Animate-Inanimate Distinction , 1998, Journal of Cognitive Neuroscience.

[95]  D. Mareschal,et al.  A computational and neuropsychological account of object‐oriented behaviours in infancy , 1999 .

[96]  R. French,et al.  A connectionist account of asymmetric category learning in early infancy. , 2000, Developmental psychology.

[97]  David M. Sobel,et al.  Detecting blickets: how young children use information about novel causal powers in categorization and induction. , 2000, Child development.

[98]  J. Hodges,et al.  Semantic dementia: clinical, radiological and pathological perspectives , 2000, Journal of Neurology.

[99]  D. Mareschal.  Object knowledge in infancy: current controversies and approaches , 2000, Trends in Cognitive Sciences.

[100]  E. Rolls.  The orbitofrontal cortex and reward. , 2000, Cerebral cortex.

[101]  Robert A. Wilson,et al.  Explanation and Cognition , 2000 .

[102]  N. Chater,et al.  Rational models of cognition , 1998 .

[103]  Mark H. Johnson,et al.  Global-Before-Basic Object Categorization in Connectionist Networks and 2-Month-Old Infants. , 2000, Infancy : the official journal of the International Society on Infant Studies.

[104]  E. Heit.  Properties of inductive reasoning , 2000, Psychonomic bulletin & review.

[105]  L. K. Tyler,et al.  Conceptual Structure and the Structure of Concepts: A Distributed Account of Category-Specific Deficits , 2000, Brain and Language.

[106]  D. Plaut,et al.  Individual and developmental differences in semantic priming: empirical and computational support for a single-mechanism account of lexical processing. , 2000, Psychological review.

[107]  J. Mandler.  Perceptual and Conceptual Processes in Infancy , 2000 .

[108]  W. Ahn,et al.  Causal status effect in children's categorization , 2000, Cognition.

[109]  T. Shallice,et al.  Long-term retrograde amnesia… the crucial role of the hippocampus , 2001, Neuropsychologia.

[110]  James L. McClelland,et al.  No Right to Speak? The Relationship between Object Naming and Semantic Impairment:Neuropsychological Evidence and a Computational Model , 2001, Journal of Cognitive Neuroscience.

[111]  G. Humphreys,et al.  Category specificity in mind and brain? , 2001, Behavioral and Brain Sciences.

[112]  M. Brett,et al.  Large, colorful, or noisy? Attribute- and modality-specific activations during retrieval of perceptual attribute knowledge , 2001 .

[113]  L. Tyler,et al.  Towards a distributed account of conceptual knowledge , 2001, Trends in Cognitive Sciences.

[114]  Alex Martin,et al.  Semantic memory and the brain: structure and processes , 2001, Current Opinion in Neurobiology.

[115]  D. Plaut.  Graded modality-specific specialisation in semantics: A computational account of optic aphasia , 2002, Cognitive neuropsychology.

[116]  S. Pauen.  The global-to-basic level shift in infants’ categorical thinking: First evidence from a longitudinal study , 2002 .

[117]  J. Hodges,et al.  When objects lose their meaning: What happens to their use? , 2002, Cognitive, affective & behavioral neuroscience.

[118]  D. Plaut,et al.  The impact of synaptic depression following brain damage: A connectionist account of “access/refractory” and “degraded-store” semantic impairments , 2002, Cognitive, affective & behavioral neuroscience.

[119]  G. Murphy,et al.  The Big Book of Concepts , 2002 .

[120]  U. Goswami.  Blackwell handbook of childhood cognitive development , 2002 .

[121]  Christine D. Wilson,et al.  Grounding conceptual knowledge in modality-specific systems , 2003, Trends in Cognitive Sciences.

[122]  M. Brett,et al.  Actions Speak Louder Than Functions: The Importance of Manipulability and Action in Tool Representation , 2003, Journal of Cognitive Neuroscience.

[123]  Karin Ackermann,et al.  Categories and Concepts , 2003, Job 28. Cognition in Context.

[124]  R. O’Reilly,et al.  Modeling hippocampal and neocortical contributions to recognition memory: a complementary-learning-systems approach. , 2003, Psychological review.

[125]  James L. McClelland,et al.  Connectionist models of development , 2003 .

[126]  T. Rogers,et al.  A duck with four legs: Investigating the structure of conceptual knowledge using picture drawing in semantic dementia , 2003, Cognitive neuropsychology.

[127]  Thomas R. Shultz,et al.  Modeling cognitive development on balance scale phenomena , 1994, Machine Learning.

[128]  Frank C. Keil,et al.  The Shadows and Shallows of Explanation , 1998, Minds and Machines.

[129]  James L. McClelland,et al.  Semantic Cognition: A Parallel Distributed Processing Approach , 2004 .

[130]  P. Bloom.  How Children Learn the Meaning of Words and How LSA Does It ( Too ) , 2005 .