Cerebellar Substrates for Error Correction in Motor Conditioning

The authors evaluate a mapping of Rescorla and Wagner's (1972) behavioral model of classical conditioning onto the cerebellar substrates for motor reflex learning and illustrate how the limitations of the Rescorla-Wagner model are just as useful as its successes for guiding the development of new psychobiological theories of learning. They postulate that the inhibitory pathway that returns conditioned response information from the cerebellar interpositus nucleus back to the inferior olive is the neural basis for the error correction learning proposed by Rescorla and Wagner (Gluck, Myers, & Thompson, 1994; Thompson, 1986). The authors' cerebellar model expects that behavioral processes described by the Rescorla-Wagner model will be localized within the cerebellum and related brain stem structures, whereas behavioral processes beyond the scope of the Rescorla-Wagner model will depend on extracerebellar structures such as the hippocampus and related cortical regions. Simulations presented here support both implications. Several novel implications of the authors' cerebellar error-correcting model are described including a recent empirical study by Kim, Krupa, and Thompson (1998), who verified that suppressing the putative error correction pathway should interfere with the Kamin (1969) blocking effect, a behavioral manifestation of error correction learning. The authors also discuss the model's implications for understanding the limits of cerebellar contributions to associative learning and how this informs our understanding of hippocampal function in conditioning. This leads to a more integrative view of the neural substrates of conditioning in which the authors' real-time circuit-level model of the cerebellum can be viewed as a generalization of the long-term memory module of Gluck and Myers' (1993) trial-level theory of cerebellar-hippocampal interaction in motor conditioning.

[1]  R. Bolles,et al.  Naloxone and shock-elicited freezing in the rat. , 1979 .

[2]  G. Bower,et al.  From conditioning to category learning: an adaptive network model. , 1988 .

[3]  John Madden,et al.  Neurobiology of learning, emotion, and affect , 1991 .

[4]  R. Sutherland,et al.  Configural association theory and the hippocampal formation: An appraisal and reconfiguration , 1995, Hippocampus.

[5]  J. Disterhoft,et al.  Hippocampectomy disrupts trace eye-blink conditioning in rabbits. , 1990, Behavioral neuroscience.

[6]  L. Kamin Predictability, surprise, attention, and conditioning , 1967 .

[7]  J. Walkenbach,et al.  The Rescorla-Wagner Theory of Conditioning: A Review of the Literature , 1980 .

[8]  B. Knowlton,et al.  Classical conditioning of the rabbit eyelid response with a mossy-fiber stimulation CS: II. Lateral reticular nucleus stimulation. , 1987, Behavioral neuroscience.

[9]  D. Mcfarland,et al.  Dorsal hippocampal lesions: effects of preconditioning CS exposure on flavor aversion. , 1978, Behavioral biology.

[10]  Rodney Cotterill,et al.  Models of brain function , 1989 .

[11]  W. B. Orr,et al.  Hippocampectomy selectively disrupts discrimination reversal conditioning of the rabbit nictitating membrane response , 1983, Behavioural Brain Research.

[12]  D J Krupa,et al.  Reversible inactivation of the cerebellar interpositus nucleus completely prevents acquisition of the classically conditioned eye-blink response. , 1997, Learning & memory.

[13]  R. Clark,et al.  Reversible lesions of the cerebellar interpositus nucleus during acquisition and retention of a classically conditioned behavior. , 1992, Behavioral neuroscience.

[14]  Bernard Widrow,et al.  Adaptive switching circuits , 1988 .

[15]  The olivocerebellar system in motor control, P. Strata (Ed.). Springer-Verlag, Berlin, Heidelberg, New York (1989), 466, DM 138 , 1989 .

[16]  R. Sutherland,et al.  Configural association theory: The role of the hippocampal formation in learning, memory, and amnesia , 1989, Psychobiology.

[17]  Interpositus lesion abolition of the eyeblink conditioned response is not due to effects on performance. , 1993, Behavioral neuroscience.

[18]  R. Clark,et al.  Reversible lesions of the red nucleus during acquisition and retention of a classically conditioned behavior in rabbits. , 1993, Behavioral neuroscience.

[19]  Ralph R. Miller,et al.  Assessment of the Rescorla-Wagner model. , 1995 .

[20]  L. Squire,et al.  The medial temporal lobe memory system , 1991, Science.

[21]  A. Barto,et al.  Distributed motor commands in the limb premotor network , 1993, Trends in Neurosciences.

[22]  M. Fanselow Shock-induced analgesia on the formalin test: effects of shock severity, naloxone, hypophysectomy, and associative variables. , 1984, Behavioral neuroscience.

[23]  R. F. Thompson,et al.  Hippocampus and trace conditioning of the rabbit's classically conditioned nictitating membrane response. , 1986, Behavioral neuroscience.

[24]  A. R. Wagner Stimulus Selection and A “Modified Continuity Theoryrdquo;1 , 1970 .

[25]  R. F. Thompson,et al.  Inhibitory cerebello-olivary projections and blocking effect in classical conditioning. , 1998, Science.

[26]  Richard E Thompson,et al.  Cerebellar circuits and synaptic mechanisms involved in classical eyeblink conditioning , 1997, Trends in Neurosciences.

[27]  M. Fanselow,et al.  Pavlovian Conditioning, Negative Feedback, and Blocking: Mechanisms that Regulate Association Formation , 1998, Neuron.

[28]  Richard F. Thompson,et al.  Locus coeruleus lesions and resistance to extinction of a classically conditioned response: Involvement of the neocortex and hippocampus , 1982, Brain Research.

[29]  S. Kaneko,et al.  Involvement of Postsynaptic G-proteins in Hippocampal Long-Term Potentiation , 1992, Brain research.

[30]  Masao Ito The Cerebellum And Neural Control , 1984 .

[31]  D J Rosen,et al.  Classical conditioning of the rabbit eyelid response with a mossy-fiber stimulation CS: I. Pontine nuclei and middle cerebellar peduncle stimulation. , 1986, Behavioral neuroscience.

[32]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[33]  D J Krupa,et al.  Inactivation of the superior cerebellar peduncle blocks expression but not acquisition of the rabbit's classically conditioned eye-blink response. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[34]  J. Knott The organization of behavior: A neuropsychological theory , 1951 .

[35]  Richard F. Thompson,et al.  Localization of a memory trace in the mammalian brain. , 1993, Science.

[36]  W. F. Prokasy,et al.  Classical conditioning II: Current research and theory. , 1972 .

[37]  D. Woodruff-Pak New Directions For a Classical Paradigm: Human Eyeblink Conditioning , 1999 .

[38]  G. Lynch,et al.  The neurobiology of learning and memory , 1989, Cognition.

[39]  R. F. Thompson,et al.  Classical conditioning in rabbits using pontine nucleus stimulation as a conditioned stimulus and inferior olive stimulation as an unconditioned stimulus , 1989, Synapse.

[40]  B. Campbell,et al.  Punishment and aversive behavior , 1969 .

[41]  The Conditioned Eyeblink Response: A Role for the GABA-B Receptor? , 1997, Pharmacology Biochemistry and Behavior.

[42]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[43]  P. W. Frey,et al.  Inhibition and learning , 1973 .

[44]  R. Rescorla,et al.  Extinction of Pavlovian conditioned inhibition. , 1974, Journal of comparative and physiological psychology.

[45]  B. Kosko,et al.  Visual Structures and Integrated Functions , 1991, Research Notes in Neural Computing.

[46]  R. Clark,et al.  Classical conditioning and brain systems: the role of awareness. , 1998, Science.

[47]  K. Spence Behavior Theory and Conditioning , 1978 .

[48]  J. Steinmetz,et al.  Acquisition of classically conditioned-related activity in the hippocampus is affected by lesions of the cerebellar interpositus nucleus. , 1990, Behavioral neuroscience.

[49]  J. W. Moore,et al.  Below-zero conditioned inhibition of the rabbit's nictitating membrane response. , 1974, Journal of experimental psychology.

[50]  JOHN W. Moore,et al.  Conditioned inhibition of the rabbit nictitating membrane response as a function of CS-UCS interval , 1975 .

[51]  L. Squire Declarative and Nondeclarative Memory: Multiple Brain Systems Supporting Learning and Memory , 1992, Journal of Cognitive Neuroscience.

[52]  J J Kim,et al.  Hippocampectomy impairs the memory of recently, but not remotely, acquired trace eyeblink conditioned responses. , 1995, Behavioral neuroscience.

[53]  P. Strata The Olivocerebellar system in motor control , 1989 .

[54]  M. M. Patterson,et al.  Fimbrial lesions and sensory preconditioning. , 1984, Behavioral neuroscience.

[55]  Richard F. Thompson,et al.  Sensorimotor learning and the cerebellum , 1991 .

[56]  E. Kehoe,et al.  Summation and configuration in patterning schedules with the rat and rabbit , 1985 .

[57]  M. Gluck,et al.  Hippocampal mediation of stimulus representation: A computational theory , 1993, Hippocampus.

[58]  E. Kehoe,et al.  Compound-component differentiation as a function of CS-US interval and CS duration in the rabbit’s conditioned nictitating membrane response , 1986 .

[59]  Richard F. Thompson,et al.  Neuronal responses of the rabbit brainstem during performance of the classically conditioned nictitating membrane (NM)/eyelid response , 1983, Brain Research.

[60]  C. L. Hull Principles of Behavior , 1945 .

[61]  M. Mauk,et al.  Cerebellar cortex lesions disrupt learning-dependent timing of conditioned eyelid responses , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[62]  Richard F. Thompson,et al.  Integrating Behavioral and Biological Models of Classical Conditioning , 1989 .

[63]  P. Solomon,et al.  Latent inhibition and stimulus generalization of the classically conditioned nictitating membrane response in rabbits (Oryctolagus cuniculus) following dorsal hippocampal ablation. , 1975, Journal of comparative and physiological psychology.

[64]  Joel L. Davis,et al.  An Introduction to Neural and Electronic Networks , 1995 .

[65]  Bryan J. Travis,et al.  A Computational Model of the Cerebellum , 1992 .

[66]  J. W. Moore,et al.  Blocking of the rabbit's conditioned nictitating membrane response in Kamin's two-stage paradigm. , 1973, Journal of experimental psychology.

[67]  Joseph E. Steinmetz,et al.  Cerebellar cortical lesions and reacquisition in classical conditioning of the nictitating membrane response in rabbits , 1993, Brain Research.

[68]  S. Blomfield,et al.  How the Cerebellum may be Used , 1970, Nature.

[69]  R. F. Thompson,et al.  Classical conditioning using stimulation of the inferior olive as the unconditioned stimulus. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[70]  R. Rescorla A theory of pavlovian conditioning: The effectiveness of reinforcement and non-reinforcement , 1972 .

[71]  Richard F. Thompson,et al.  Effects of lidocaine injection in the interpositus nucleus and red nucleus on conditioned behavioral and neuronal responses , 1990, Brain Research.

[72]  N. Donegan,et al.  Conditioned diminution and facilitation of the UR: A sometimes opponent-process interpretation. , 1987 .

[73]  P. Solomon Role of the hippocampus in blocking and conditioned inhibition of the rabbit's nictitating membrane response. , 1977, Journal of comparative and physiological psychology.

[74]  B. Skinner,et al.  Principles of Behavior , 1944 .

[75]  J. Theios,et al.  Acquisition and extinction of a classically conditioned response in hippocampectomized rabbits (Oryctolagus cuniculus). , 1972, Journal of comparative and physiological psychology.

[76]  J. Andersson,et al.  Brain substrates of aversive classical conditioning. , 1995 .

[77]  J E Steinmetz,et al.  Possible conditioned stimulus pathway for classical eyelid conditioning in rabbits. I. Anatomical evidence for direct projections from the pontine nuclei to the cerebellar interpositus nucleus. , 1992, Behavioral and neural biology.

[78]  J. Houk Cooperative Control of Limb Movements by the Motor Cortex, Brainstem and , 1989 .

[79]  B J Anderson,et al.  Cerebellar and Brainstem Circuits Involved in Classical Eyeblink Conditioning , 1994, Reviews in the neurosciences.

[80]  R. Rescorla Probability of shock in the presence and absence of CS in fear conditioning. , 1968, Journal of comparative and physiological psychology.

[81]  Satinder Singh,et al.  Distributed Representation of Limb Motor Programs in Arrays of Adjustable Pattern Generators , 1993, Journal of Cognitive Neuroscience.

[82]  A G Barto,et al.  Toward a modern theory of adaptive networks: expectation and prediction. , 1981, Psychological review.