Adaptive representation of dynamics during learning of a motor task

We investigated how the CNS learns to control movements in different dynamical conditions, and how this learned behavior is represented. In particular, we considered the task of making reaching movements in the presence of externally imposed forces from a mechanical environment. This environment was a force field produced by a robot manipulandum, and the subjects made reaching movements while holding the end-effector of this manipulandum. Since the force field significantly changed the dynamics of the task, subjects' initial movements in the force field were grossly distorted compared to their movements in free space. However, with practice, hand trajectories in the force field converged to a path very similar to that observed in free space. This indicated that for reaching movements, there was a kinematic plan independent of dynamical conditions. The recovery of performance within the changed mechanical environment is motor adaptation. In order to investigate the mechanism underlying this adaptation, we considered the response to the sudden removal of the field after a training phase. The resulting trajectories, named aftereffects, were approximately mirror images of those that were observed when the subjects were initially exposed to the field. This suggested that the motor controller was gradually composing a model of the force field, a model that the nervous system used to predict and compensate for the forces imposed by the environment. In order to explore the structure of the model, we investigated whether adaptation to a force field, as presented in a small region, led to aftereffects in other regions of the workspace. We found that indeed there were aftereffects in workspace regions where no exposure to the field had taken place; that is, there was transfer beyond the boundary of the training data. This observation rules out the hypothesis that the subject's model of the force field was constructed as a narrow association between visited states and experienced forces; that is, adaptation was not via composition of a look-up table. In contrast, subjects modeled the force field by a combination of computational elements whose output was broadly tuned across the motor state space. These elements formed a model that extrapolated to outside the training region in a coordinate system similar to that of the joints and muscles rather than end-point forces. This geometric property suggests that the elements of the adaptive process represent dynamics of a motor task in terms of the intrinsic coordinate system of the sensors and actuators.

[1]  R. Held,et al.  Adaptation to disarranged eye-hand coordination in the distance-dimension. , 1959, The American journal of psychology.

[2]  Hermann von Helmholtz,et al.  Treatise on Physiological Optics , 1962 .

[3]  R. Held,et al.  PLASTICITY IN HUMAN SENSORIMOTOR CONTROL. , 1963, Science.

[4]  N. A. Bernshteĭn The co-ordination and regulation of movements , 1967 .

[5]  James S. Albus,et al.  I A New Approach to Manipulator Control: The I Cerebellar Model Articulation Controller , 1975 .

[6]  James S. Albus,et al.  New Approach to Manipulator Control: The Cerebellar Model Articulation Controller (CMAC)1 , 1975 .

[7]  S. Grillner Control of Locomotion in Bipeds, Tetrapods, and Fish , 1981 .

[8]  J. F. Soechting,et al.  Invariant characteristics of a pointing movement in man , 1981, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  E. Bizzi,et al.  Human arm trajectory formation. , 1982, Brain : a journal of neurology.

[10]  F. Lacquaniti,et al.  Some factors pertinent to the organization and control of arm movements , 1982, Brain Research.

[11]  L. Brooks,et al.  Nonanalytic Cognition: Memory, Perception, and Concept Learning , 1984 .

[12]  E. Bizzi,et al.  Posture control and trajectory formation during arm movement , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[13]  Marc H. Raibert,et al.  Tabular control of balance in a dynamic legged system , 1984, IEEE Transactions on Systems, Man, and Cybernetics.

[14]  R. M. Siegel,et al.  Encoding of spatial location by posterior parietal neurons. , 1985, Science.

[15]  M A Arbib,et al.  Schemas for the temporal organization of behaviour. , 1985, Human neurobiology.

[16]  Jean-Jacques E. Slotine,et al.  The Robust Control of Robot Manipulators , 1985 .

[17]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[18]  E. Bizzi,et al.  Neural, mechanical, and geometric factors subserving arm posture in humans , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[19]  Ian C Fayé,et al.  An impedance controlled manipulandum for human movement studies , 1986 .

[20]  V. Brooks The Neural Basis of Motor Control , 1986 .

[21]  Elliot Saltzman,et al.  Skilled actions: a task-dynamic approach. , 1987, Psychological review.

[22]  J. Kelso,et al.  Skilled actions: a task-dynamic approach. , 1987, Psychological review.

[23]  C. Capaday,et al.  The trajectory of human wrist movements. , 1988, Journal of neurophysiology.

[24]  Mitsuo Kawato,et al.  Adaptation and learning in control of voluntary movement by the central nervous system , 1988, Adv. Robotics.

[25]  M. Jeannerod The neural and behavioural organization of goal-directed movements , 1990, Psychological Medicine.

[26]  J. Kelso,et al.  Self-organization of coordinative movement patterns ☆ , 1988 .

[27]  H. Cunningham Aiming error under transformed spatial mappings suggests a structure for visual-motor maps. , 1989, Journal of experimental psychology. Human perception and performance.

[28]  R. Sutton,et al.  Connectionist Learning for Control: An Overview , 1989 .

[29]  Mark W. Spong,et al.  Robot dynamics and control , 1989 .

[30]  David J. Reinkensmeyer,et al.  Using associative content-addressable memories to control robots , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[31]  C. Atkeson,et al.  Learning arm kinematics and dynamics. , 1989, Annual review of neuroscience.

[32]  F. Girosi,et al.  Networks for approximation and learning , 1990, Proc. IEEE.

[33]  E. Bizzi,et al.  Motor-space coding in the central nervous system. , 1990, Cold Spring Harbor symposia on quantitative biology.

[34]  Reza Shadmehr Learning Virtual Equilibrium Trajectories for Control of a Robot Arm , 1990, Neural Computation.

[35]  T. Poggio A theory of how the brain might work. , 1990, Cold Spring Harbor symposia on quantitative biology.

[36]  Weiping Li,et al.  Applied Nonlinear Control , 1991 .

[37]  F A Mussa-Ivaldi,et al.  Computations underlying the execution of movement: a biological perspective. , 1991, Science.

[38]  Tamar Flash,et al.  Arm Stiffness And Movement Adaptation To External Loads , 1991, Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society Volume 13: 1991.

[39]  G. Kerr Visuomotor control in goal-directed movements , 1992 .

[40]  J. Kelso,et al.  Learning as change of coordination dynamics: theory and experiment. , 1992, Journal of motor behavior.

[41]  W T Thach,et al.  The cerebellum and the adaptive coordination of movement. , 1992, Annual review of neuroscience.

[42]  R. V. Emmerik,et al.  Kinematic adaptations to perturbations as a function of practice in rhythmic drawing movements. , 1992 .

[43]  Michael I. Jordan,et al.  Forward Models: Supervised Learning with a Distal Teacher , 1992, Cogn. Sci..

[44]  R. Magill,et al.  A note on schema and exemplar approaches to motor skill representation in memory. , 1992, Journal of motor behavior.

[45]  J. Summers Approaches to the study of motor control and learning , 1992 .

[46]  T Poggio,et al.  Fast perceptual learning in visual hyperacuity. , 1991, Science.

[47]  R. E. van Emmerick Kinematic adaptations to perturbations as a function of practice in rhythmic drawing movements. , 1992, Journal of motor behavior.

[48]  Ferdinando A. Mussa-Ivaldi,et al.  Vector summation of end-point impedance in kinematically redundant manipulators , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[49]  Ferdinando A. Mussa-Ivaldi,et al.  Networks that approximate vector-valued mappings , 1993, IEEE International Conference on Neural Networks.

[50]  F. A. Mussa-lvaldi,et al.  Convergent force fields organized in the frog's spinal cord , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[51]  E. Bizzi,et al.  Postural force fields of the human arm and their role in generating multijoint movements , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[52]  Satinder Singh,et al.  Distributed Representation of Limb Motor Programs in Arrays of Adjustable Pattern Generators , 1993, Journal of Cognitive Neuroscience.

[53]  Toshio Tsuji,et al.  Estimation of Human Hand Impedance During Maintenance of Posture , 1994 .

[54]  Michael I. Jordan Motor Learning and the Degrees of Freedom Problem , 2018, Attention and Performance XIII.