Context, cortex, and associations: a connectionist developmental approach to verbal analogies

We present a PDP model of binary choice verbal analogy problems (A:B as C:[D1|D2], where D1 and D2 represent choice alternatives). We train a recurrent neural network in item-relation-item triples and use this network to test performance on analogy questions. Without training on analogy problems per se, the model explains the developmental shift from associative to relational responding as an emergent consequence of learning upon the environment's statistics. Such learning allows gradual, item-specific acquisition of relational knowledge to overcome the influence of unbalanced association frequency, accounting for association effects of analogical reasoning seen in cognitive development. The network also captures the overall degradation in performance after anterior temporal damage by deleting a fraction of learned connections, while capturing the return of associative dominance after frontal damage by treating frontal structures as necessary for maintaining activation of A and B while seeking a relation between C and D. While our theory is still far from being complete it provides a unified explanation of findings that need to be considered together in any integrated account of analogical reasoning.

[1]  Kenneth Slonneger Types of Relations , 1977 .

[2]  Jean-Pierre Thibaut,et al.  Semantic Analogies by Young Children : Testing the Role of Inhibition , 2011 .

[3]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: Part 2. The contextual enhancement effect and some tests and extensions of the model. , 1982, Psychological review.

[4]  Erika Tunteler,et al.  Spontaneous analogical transfer in 4-year-olds: a microgenetic study. , 2002, Journal of experimental child psychology.

[5]  Robert J. Sternberg,et al.  Developmental Patterns in the Solution of Verbal Analogies. Technical Report No. 3. Cognitive Development Series. , 1979 .

[6]  A. L. Brown,et al.  Analogical transfer in very young children: combining two separately learned solutions to reach a goal. , 1986, Child development.

[7]  Robert M. French Relational priming is to analogy-making as one-ball juggling is to seven-ball juggling , 2008, Behavioral and Brain Sciences.

[8]  D. Osherson,et al.  Distinct brain loci in deductive versus probabilistic reasoning , 1998, Neuropsychologia.

[9]  L. J. Chapman,et al.  A THEORY OF VERBAL BEHAVIOR IN SCHIZOPHRENIA. , 1964, Progress in experimental personality research.

[10]  James L. McClelland,et al.  Are there mental lexicons? The role of semantics in lexical decision , 2010, Brain Research.

[11]  Barbara A. Cornblatt,et al.  The continuous performance test, identical pairs version: II. Contrasting attentional profiles in schizophrenic and depressed patients , 1989, Psychiatry Research.

[12]  D. Gentner,et al.  Comparison and Categorization in the Development of Relational Similarity , 1996 .

[13]  D. Stuss,et al.  Neuropsychological studies of the frontal lobes. , 1984, Psychological bulletin.

[14]  K. Holyoak,et al.  Mental Leaps: Analogy in Creative Thought , 1994 .

[15]  D. Gentner,et al.  Structural Alignment during Similarity Comparisons , 1993, Cognitive Psychology.

[16]  K. Holyoak,et al.  Children's development of analogical reasoning: insights from scene analogy problems. , 2006, Journal of experimental child psychology.

[17]  M. Honda,et al.  Toward Neuroanatomical Models of Analogy: A Positron Emission Tomography Study of Analogical Mapping , 2000, Cognitive Psychology.

[18]  K. Holyoak,et al.  A System for Relational Reasoning in Human Prefrontal Cortex , 1999 .

[19]  R. French The computational modeling of analogy-making , 2002, Trends in Cognitive Sciences.

[20]  U. Goswami Analogical Reasoning: What Develops? A Review of Research and Theory. , 1991 .

[21]  D. Gentner Metaphor as Structure Mapping: The Relational Shift. , 1988 .

[22]  Dedre Gentner,et al.  Structure-Mapping: A Theoretical Framework for Analogy , 1983, Cogn. Sci..

[23]  J. Desmond,et al.  Neural Substrates of Fluid Reasoning: An fMRI Study of Neocortical Activation during Performance of the Raven's Progressive Matrices Test , 1997, Cognitive Psychology.

[24]  D. Gentner,et al.  The analogical mind : perspectives from cognitive science , 2001 .

[25]  K. Patterson,et al.  Disrupted temporal lobe connections in semantic dementia , 1998, NeuroImage.

[26]  M. Scheerer,et al.  Problem Solving , 1967, Nature.

[27]  R. Morrison,et al.  A computational account of children's analogical reasoning: balancing inhibitory control in working memory and relational representation. , 2011, Developmental science.

[28]  J. Cohen,et al.  Context, cortex, and dopamine: a connectionist approach to behavior and biology in schizophrenia. , 1992, Psychological review.

[29]  F. Wilkening,et al.  Children's analogical reasoning about natural phenomena. , 1997, Journal of experimental child psychology.

[30]  Daniel C. Krawczyk,et al.  A Neurocomputational Model of Analogical Reasoning and its Breakdown in Frontotemporal Lobar Degeneration , 2004, Journal of Cognitive Neuroscience.

[31]  Robert J. Sternberg,et al.  Reasoning, Problem Solving, and Intelligence. , 1980 .

[32]  James L. McClelland,et al.  James L. McClelland, David Rumelhart and the PDP Research Group, Parallel distributed processing: explorations in the microstructure of cognition . Vol. 1. Foundations . Vol. 2. Psychological and biological models . Cambridge MA: M.I.T. Press, 1987. , 1989, Journal of Child Language.

[33]  K. Holyoak,et al.  Development of analogical problem-solving skill. , 1984, Child development.

[34]  Geoffrey E. Hinton,et al.  Implementing Semantic Networks in Parallel Hardware , 2014 .

[35]  J. Duncan,et al.  Fluid intelligence after frontal lobe lesions , 1995, Neuropsychologia.

[36]  James L. McClelland,et al.  Psychological and biological models , 1986 .

[37]  Lindsey E. Richland,et al.  Early Executive Function Predicts Reasoning Development , 2013, Psychological science.

[38]  J. Gentile,et al.  Process of solving analogy items. , 1969, Journal of educational psychology.

[39]  Leonidas A A Doumas,et al.  A theory of the discovery and predication of relational concepts. , 2008, Psychological review.

[40]  Dedre Gentner,et al.  Systematicity and Surface Similarity in the Development of Analogy , 1986, Cogn. Sci..

[41]  John E. Hummel,et al.  Distributed representations of structure: A theory of analogical access and mapping. , 1997 .

[42]  Ann L. Brown Analogical learning and transfer: what develops? , 1989 .

[43]  K. Holyoak,et al.  The Cambridge handbook of thinking and reasoning , 2005 .

[44]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[45]  K. Holyoak,et al.  Schema induction and analogical transfer , 1983, Cognitive Psychology.

[46]  J. Ronald Gentile,et al.  Associative responding versus analogical reasoning by children , 1977 .

[47]  D. Spence,et al.  Lexical co-occurrence and association strength , 1990 .

[48]  D. Mareschal,et al.  Analogy as relational priming: The challenge of self-reflection , 2008, Behavioral and Brain Sciences.

[49]  James L. McClelland The programmable blackboard model of reading , 1986 .

[50]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[51]  T. Achenbach,et al.  Standardization of a Research Instrument for Identifying Associative Responding in Children. , 1970 .

[52]  Michael L. Littman,et al.  Learning Analogies and Semantic Relations , 2003, ArXiv.

[53]  T. Shallice,et al.  Deficits in strategy application following frontal lobe damage in man. , 1991, Brain : a journal of neurology.

[54]  F H Durgin,et al.  The reverse Stroop effect , 2000, Psychonomic bulletin & review.

[55]  R. Dolan,et al.  Neural systems engaged by planning: a PET study of the Tower of London task , 1996, Neuropsychologia.

[56]  James L. McClelland,et al.  Structure and deterioration of semantic memory: a neuropsychological and computational investigation. , 2004, Psychological review.

[57]  Ann L. Brown,et al.  Higher-order structure and relational reasoning: Contrasting analogical and thematic relations , 1990, Cognition.

[58]  J. Laird,et al.  The Nature of “Intelligence” and the Principles of Cognition , 1923, Nature.

[59]  D. Gentner,et al.  More evidence for a relational shift in the development of analogy: Children's performance on a causal-mapping task , 1998 .

[60]  R R Abramczyk,et al.  “Reverse” Stroop Effect in the Performance of Schizophrenics , 1983, Perceptual and motor skills.

[61]  James L. McClelland Emergence in Cognitive Science , 2010, Top. Cogn. Sci..

[62]  David Badre,et al.  Analogical reasoning and prefrontal cortex: evidence for separable retrieval and integration mechanisms. , 2004, Cerebral cortex.

[63]  Leslie G. Ungerleider,et al.  Neural correlates of category-specific knowledge , 1996, Nature.

[64]  Ann L. Brown,et al.  Melting chocolate and melting snowmen: Analogical reasoning and causal relations , 1990, Cognition.