A Model of the Learning of Arm Trajectories from Spatial Deviations

Unconstrained point-to-point reaching movements performed in the horizontal plane tend to follow roughly straight hand paths with smooth, bell-shaped velocity profiles. The objective of the research reported here was to explore the hypothesis that these data reflect an underlying learning process that prefers simple paths in space. Under this hypothesis, movements are learned based only on spatial errors between the actual hand path and a desired hand path; temporally varying targets are not allowed. We designed a neural network architecture that learned to produce neural commands to a set of muscle-like actuators based only on information about spatial errors. Following repetitive executions of the reaching task, the network was able to generate point-to-point horizontal arm movements and the resulting muscle activation patterns and hand trajectories were found to be similar to those observed experimentally for human subjects. The implications of our results with respect to current theories of multijoint limb movement generation are discussed.

[1]  A. Hill The maximum work and mechanical efficiency of human muscles, and their most economical speed , 1922, The Journal of physiology.

[2]  Donald E. Kirk,et al.  Optimal Control Theory , 1970 .

[3]  G. Brindley,et al.  THE UNDERSTANDING OF THE BRAIN , 1973 .

[4]  James Lubker,et al.  Formant frequencies of some fixed-mandible vowels and a model of speech motor programming by predictive simulation , 1979 .

[5]  J. F. Soechting,et al.  Invariant characteristics of a pointing movement in man , 1981, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[6]  J. Abbs,et al.  Sensorimotor actions in the control of multi-movement speech gestures , 1983, Trends in Neurosciences.

[7]  John F. Kalaska,et al.  Spatial coding of movement: A hypothesis concerning the coding of movement direction by motor cortical populations , 1983 .

[8]  N. Hogan An organizing principle for a class of voluntary movements , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[10]  C. Atkeson,et al.  Kinematic features of unrestrained vertical arm movements , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[11]  L. Stark,et al.  Roles of the elements of the triphasic control signal , 1985, Experimental Neurology.

[12]  A. G. Feldman Once More on the Equilibrium-Point Hypothesis (λ Model) for Motor Control , 1986 .

[13]  T. Flash,et al.  Moving gracefully: quantitative theories of motor coordination , 1987, Trends in Neurosciences.

[14]  Elliot Saltzman,et al.  Skilled actions: a task-dynamic approach. , 1987, Psychological review.

[15]  W. Thomas Miller,et al.  Sensor-based control of robotic manipulators using a general learning algorithm , 1987, IEEE J. Robotics Autom..

[16]  Richard Durbin,et al.  An analogue approach to the travelling salesman problem using an elastic net method , 1987, Nature.

[17]  Daniel Bullock,et al.  Neural dynamics of planned arm movements: emergent invariants and speed-accuracy properties during trajectory formation , 1988 .

[18]  F. Mussa-Ivaldi,et al.  Do neurons in the motor cortex encode movement direction? An alternative hypothesis , 1988, Neuroscience Letters.

[19]  David J. Reinkensmeyer,et al.  Using associative content-addressable memories to control robots , 1988, Proceedings of the 27th IEEE Conference on Decision and Control.

[20]  M Kuperstein,et al.  Neural model of adaptive hand-eye coordination for single postures. , 1988, Science.

[21]  G. Gottlieb,et al.  Strategies for the control of voluntary movements with one mechanical degree of freedom , 1989, Behavioral and Brain Sciences.

[22]  Michael I. Jordan,et al.  Learning to Control an Unstable System with Forward Modeling , 1989, NIPS.

[23]  H. Kwan,et al.  Neural network control of simple limb movements. , 1990, Canadian journal of physiology and pharmacology.

[24]  Mitsuo Kawato,et al.  Computational schemes and neural network models for formulation and control of multijoint arm trajectory , 1990 .

[25]  Tamar Flash,et al.  The Organization of Human Arm Trajectory Control , 1990 .

[26]  John M. Hollerbach,et al.  Fundamentals of motor behavior , 1990 .

[27]  Z. Hasan,et al.  Timing and magnitude of electromyographic activity for two-joint arm movements in different directions. , 1991, Journal of neurophysiology.

[28]  Z. Hasan,et al.  Initiation rules for planar, two-joint arm movements: agonist selection for movements throughout the work space. , 1991, Journal of neurophysiology.

[29]  Donald F. Specht,et al.  A general regression neural network , 1991, IEEE Trans. Neural Networks.

[30]  F A Mussa-Ivaldi,et al.  Computations underlying the execution of movement: a biological perspective. , 1991, Science.

[31]  M. Flanders Temporal patterns of muscle activation for arm movements in three- dimensional space , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[32]  A. Georgopoulos Higher order motor control. , 1991, Annual review of neuroscience.

[33]  John F. Kalaska,et al.  Reaching movements to visual targets: neuronal representations of sensori-motor transformations , 1991 .

[34]  Michael I. Jordan Constrained supervised learning , 1992 .

[35]  Michael I. Jordan,et al.  Forward Models: Supervised Learning with a Distal Teacher , 1992, Cogn. Sci..

[36]  Martin Fodslette Møller,et al.  A scaled conjugate gradient algorithm for fast supervised learning , 1993, Neural Networks.

[37]  D. Wolpert,et al.  Is the cerebellum a smith predictor? , 1993, Journal of motor behavior.

[38]  M. Kawato Optimization and learning in neural networks for formation and control of coordinated movement , 1993 .

[39]  Michael I. Jordan,et al.  Hierarchical Mixtures of Experts and the EM Algorithm , 1994, Neural Computation.

[40]  Michael I. Jordan Motor Learning and the Degrees of Freedom Problem , 2018, Attention and Performance XIII.