Running head : HEBBIAN LEARNING How Far Can You Go with Hebbian Learning , and When Does it Lead you Astray ?

This paper considers the use of Hebbian learning rules to model aspects of development and learning, including the emergence of structure in the visual system in early life. There is considerable physiological evidence that a Hebb-like learning rule applies to the strengthening of synaptic efficacy seen in neurophysiological investigations of Long-Term Potentiation, and similar learning rules are often used to show how various properties of visual neurons and their organization into ocular dominance stripes and orientation columns could arise without being otherwise pre-programmed. Some of the plusses and minuses of Hebbian learning are considered. Hebbian learning can strengthen the neural response that is elicited by an input; this can be good if the response made is appropriate to the situation but it can also be counterproductive if a different response would be more appropriate. Cases in which this outcome-independent Hebbian type of strengthening might account at least in part for cases in which humans fail to learn are considered, and computational models embodying the Hebbian approach are described that can account for the findings. At a systems level, Hebbian learning cannot be the whole story. From a computational point of view, Hebbian learning can certainly lead one in the wrong direction, and some form of control over this is necessary. Also, experimental findings clearly show that human learning can be affected by feedback. Several ways in which sensitivity to feedback might be incorporated to guide learning within a fundamentally Hebbian framework for learning are considered.

[1]  J. Haldane The interaction of nature and nurture. , 1946, Annals of eugenics.

[2]  W. Scoville,et al.  LOSS OF RECENT MEMORY AFTER BILATERAL HIPPOCAMPAL LESIONS , 1957, Journal of neurology, neurosurgery, and psychiatry.

[3]  R. H. Walters The Growth of Logical Thinking from Childhood to Adolescence , 1960 .

[4]  B. Milner,et al.  Further analysis of the hippocampal amnesic syndrome: 14-year follow-up study of H.M.☆ , 1968 .

[5]  R. Siegler Three aspects of cognitive development , 1976, Cognitive Psychology.

[6]  B. McNaughton,et al.  Synaptic enhancement in fascia dentata: Cooperativity among coactive afferents , 1978, Brain Research.

[7]  W. Levy,et al.  Synapses as associative memory elements in the hippocampal formation , 1979, Brain Research.

[8]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  David Zipser,et al.  Feature Discovery by Competive Learning , 1986, Cogn. Sci..

[10]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[11]  R Linsker,et al.  From basic network principles to neural architecture: emergence of orientation columns. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[12]  R Linsker,et al.  From basic network principles to neural architecture: emergence of orientation-selective cells. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[13]  R Linsker,et al.  From basic network principles to neural architecture: emergence of spatial-opponent cells. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[14]  James L. McClelland Parallel Distributed Processing: Implications for Cognition and Development , 1988 .

[15]  N. Cohen,et al.  The impaired learning of semantic knowledge following bilateral medial temporal-lobe resection , 1988, Brain and Cognition.

[16]  K. Miller,et al.  Ocular dominance column development: analysis and simulation. , 1989, Science.

[17]  J. S. Johnson,et al.  Critical period effects in second language learning: The influence of maturational state on the acquisition of English as a second language , 1989, Cognitive Psychology.

[18]  James L. McClelland,et al.  Learning and Applying Contextual Constraints in Sentence Comprehension , 1990, Artif. Intell..

[19]  H. Margolis Paradigms and Barriers , 1990, PSA: Proceedings of the Biennial Meeting of the Philosophy of Science Association.

[20]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[21]  Philippe G. Schyns,et al.  A Modular Neural Network Model of Concept Acquisition , 1991, Cogn. Sci..

[22]  James L. McClelland,et al.  Nature, nurture, and connections: Implications of connectionist models for cognitive development. , 1991 .

[23]  G. Recanzone,et al.  Topographic reorganization of the hand representation in cortical area 3b owl monkeys trained in a frequency-discrimination task. , 1992, Journal of neurophysiology.

[24]  G. Recanzone,et al.  Changes in the distributed temporal response properties of SI cortical neurons reflect improvements in performance on a temporally based tactile discrimination task. , 1992, Journal of neurophysiology.

[25]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[26]  Donald A. Sofge,et al.  Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches , 1992 .

[27]  Endel Tulving,et al.  The Role of Repetition and Associative Interference in New Semantic Learning in Amnesia: A Case Experiment , 1993, Journal of Cognitive Neuroscience.

[28]  SM Dudek,et al.  Bidirectional long-term modification of synaptic effectiveness in the adult and immature hippocampus , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[29]  Barbara A. Wilson,et al.  When implicit learning fails: Amnesia and the problem of error elimination , 1994, Neuropsychologia.

[30]  James L. McClelland,et al.  Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. , 1995, Psychological review.

[31]  L R Squire,et al.  On the acquisition of new declarative knowledge in amnesia. , 1995, Behavioral neuroscience.

[32]  B. Milner Further analysis of the hippocampal amnesic syndrome: 14-year follow-up of HM , 1996 .

[33]  H. Markram,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997, Science.

[34]  James L. McClelland,et al.  Rethinking infant knowledge: toward an adaptive process account of successes and failures in object permanence tasks. , 1997, Psychological review.

[35]  James L. McClelland,et al.  Understanding failures of learning: Hebbian learning, competition for representational space, and some preliminary experimental data. , 1999, Progress in brain research.

[36]  L. Abbott,et al.  Synaptic plasticity: taming the beast , 2000, Nature Neuroscience.

[37]  L. C. Katz,et al.  Early development of ocular dominance columns. , 2000, Science.

[38]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[39]  T. Shallice,et al.  Long-term retrograde amnesia… the crucial role of the hippocampus , 2001, Neuropsychologia.

[40]  James L. McClelland,et al.  Mechanisms of cognitive development : behavioral and neural perspectives , 2001 .

[41]  Cara H. Cashon,et al.  A constructivist model of infant cognition , 2002 .

[42]  James L. McClelland,et al.  Success and failure in teaching the [r]-[l] contrast to Japanese adults: Tests of a Hebbian model of plasticity and stabilization in spoken language perception , 2002, Cognitive, affective & behavioral neuroscience.

[43]  L. Cooper,et al.  A unified model of NMDA receptor-dependent bidirectional synaptic plasticity , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[44]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[45]  Geoffrey J. Goodhill,et al.  Topography and ocular dominance: a model exploring positive correlations , 1993, Biological Cybernetics.

[46]  M. Delgado,et al.  Modulation of Caudate Activity by Action Contingency , 2004, Neuron.

[47]  James L. McClelland,et al.  Semantic Cognition: A Parallel Distributed Processing Approach , 2004 .

[48]  S. Grossberg On the development of feature detectors in the visual cortex with applications to learning and reaction-diffusion systems , 1976, Biological Cybernetics.

[49]  Rebecca L. Gómez,et al.  Dynamically guided learning , 2005 .

[50]  K. Jellinger Processes of Change in Brain and Cognitive Development Attention and Performance XXI , 2007 .

[51]  Randall C. O’Reilly,et al.  Modeling Integration and Dissociation in Brain and Cognitive Development , 2022 .