Models of basal ganglia and cerebellum for sensorimotor integration and predictive control

This paper presents a sensorimotor architecture integrating computational models of a cerebellum and a basal ganglia and operating on a microrobot. The computational models enable a microrobot to learn to track a moving object and anticipate future positions using a CCD camera. The architecture features pre-processing modules for coordinate transformation and instantaneous orientation extraction. Learning of motor control is implemented using predictive Hebbian reinforcement-learning algorithm in the basal ganglia model. Learning of sensory predictions makes use of a combination of long-term depression (LTD) and long-term potentiation (LTP) adaptation rules within the cerebellum model. The basal ganglia model uses the visual inputs to develop sensorimotor mapping for motor control, while the cerebellum module uses robot orientation and world- coordinate transformed inputs to predict the location of the moving object in a robot centered coordinate system. We propose several hypotheses about the functional role of cell populations in the cerebellum and argue that mossy fiber projections to the deep cerebellar nucleus (DCN) could play a coordinate transformation role and act as gain fields. We propose that such transformation could be learnt early in the brain development stages and could be guided by the activity of the climbing fibers. Proprioceptor mossy fibers projecting to the DCN and providing robot orientation with respect to a reference system could be involved in this case. Other mossy fibers carrying visual sensory input provide visual patterns to the granule cells. The combined activities of the granule and the Purkinje cells store spatial representations of the target patterns. The combinations of mossy and Purkinje projections to the DCN provide a prediction of the location of the moving target taking into consideration the robot orientation. Results of lesion simulations based on our model show degradations similar to those reported in cerebellar lesion studies on monkeys.

[1]  陸暁峰 Role of Monkey Cerebellar Nuclei in Skill for Sequential Movement(順序運動の記憶における小脳核の役割) , 1998 .

[2]  P. Strick,et al.  Activation of a cerebellar output nucleus during cognitive processing. , 1994, Science.

[3]  P. Strick,et al.  Cerebellar output channels. , 1997, International review of neurobiology.

[4]  Masao Ito The Cerebellum And Neural Control , 1984 .

[5]  Joel L. Davis,et al.  A Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement , 1994 .

[6]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[7]  T. Sejnowski,et al.  Learning to make predictions in the cerebellum may explain the anticipatory modulation of the vestibulo-ocular reflex (VOR) gain with vergence , 1996 .

[8]  A. Barto Adaptive Critics and the Basal Ganglia , 1995 .

[9]  J. Townsend,et al.  Attention coordination and anticipatory control. , 1997, International review of neurobiology.

[10]  A G Barto,et al.  Toward a modern theory of adaptive networks: expectation and prediction. , 1981, Psychological review.

[11]  Kenji Doya,et al.  What are the computations of the cerebellum, the basal ganglia and the cerebral cortex? , 1999, Neural Networks.

[12]  D. Marr A theory of cerebellar cortex , 1969, The Journal of physiology.

[13]  P. van Donkelaar,et al.  Interactions between the eye and hand motor systems: disruptions due to cerebellar dysfunction. , 1994, Journal of neurophysiology.

[14]  D. Wolpert,et al.  Is the cerebellum a smith predictor? , 1993, Journal of motor behavior.

[15]  D. Zee,et al.  Effects of lesions of the oculomotor vermis on eye movements in primate: saccades. , 1998, Journal of neurophysiology.

[16]  P. Dayan,et al.  A framework for mesencephalic dopamine systems based on predictive Hebbian learning , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[17]  J. Albus A Theory of Cerebellar Function , 1971 .

[18]  A. Terry Bahill,et al.  Smooth pursuit eye movements in response to predictable target motions , 1983, Vision Research.

[19]  M. Mauk,et al.  Cerebellar cortex lesions disrupt learning-dependent timing of conditioned eyelid responses , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[20]  E. Courchesne,et al.  A new role for the cerebellum in cognitive operations. , 1992, Behavioral neuroscience.

[21]  Peter Dayan,et al.  Bee foraging in uncertain environments using predictive hebbian learning , 1995, Nature.