Optimal feedback control as a theory of motor coordination

A central problem in motor control is understanding how the many biomechanical degrees of freedom are coordinated to achieve a common goal. An especially puzzling aspect of coordination is that behavioral goals are achieved reliably and repeatedly with movements rarely reproducible in their detail. Existing theoretical frameworks emphasize either goal achievement or the richness of motor variability, but fail to reconcile the two. Here we propose an alternative theory based on stochastic optimal feedback control. We show that the optimal strategy in the face of uncertainty is to allow variability in redundant (task-irrelevant) dimensions. This strategy does not enforce a desired trajectory, but uses feedback more intelligently, correcting only those deviations that interfere with task goals. From this framework, task-constrained variability, goal-directed corrections, motor synergies, controlled parameters, simplifying rules and discrete coordination modes emerge naturally. We present experimental results from a range of motor tasks to support this theory.

[1]  F. Huddle Coordination , 1966, Open Knowledge Institutions.

[2]  N. A. Bernshteĭn The co-ordination and regulation of movements , 1967 .

[3]  I. Gartside Models of the Structural—Functional Organization of Certain Biological Systems , 1973 .

[4]  Donald O. Walter,et al.  Models of the structural-functional organization of certain biological systems , 1973 .

[5]  H. Zelaznik,et al.  Motor-output variability: a theory for the accuracy of rapid motor acts. , 1979, Psychological review.

[6]  E. Bizzi,et al.  Posture control and trajectory formation during arm movement , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[7]  Geoffrey E. Hinton,et al.  Parallel computations for controlling an arm. , 1984, Journal of motor behavior.

[8]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  J. Abbs,et al.  Dynamic control of the perioral system during speech: kinematic analyses of autogenic and nonautogenic sensorimotor processes. , 1985, Journal of neurophysiology.

[10]  R. Hartley Stochastic Modelling and Control , 1985 .

[11]  K. J. Cole,et al.  Coordination of three-joint digit movements for rapid finger-thumb grasp. , 1986, Journal of neurophysiology.

[12]  K. J. Cole,et al.  Kinematic and electromyographic responses to perturbation of a rapid grasp. , 1987, Journal of neurophysiology.

[13]  R A Abrams,et al.  Optimality in human motor performance: ideal control of rapid aimed movements. , 1988, Psychological review.

[14]  宇野 洋二,et al.  Formation and control of optimal trajectory in human multijoint arm movement : minimum torque-change model , 1988 .

[15]  D. Winter Coordination of Motor Tasks in Human Gait , 1989 .

[16]  S. A. Wallace Perspectives on the coordination of movement , 1989 .

[17]  G E Loeb,et al.  Understanding sensorimotor feedback through optimal control. , 1990, Cold Spring Harbor symposia on quantitative biology.

[18]  Marc Jeannerod Motor representation and control , 1990 .

[19]  Michael A. Arbib,et al.  A computational description of the organization of human reaching and prehension , 1992 .

[20]  B. Vereijken,et al.  Free(z)ing Degrees of Freedom in Skill Acquisition , 1992 .

[21]  E. Komilis,et al.  Error processing in pointing at randomly feedback-induced double-step stimuli. , 1993, Journal of motor behavior.

[22]  G. Edelman,et al.  Solving Bernstein's problem: a proposal for the development of coordinated movement by selection. , 1993, Child development.

[23]  A.D. Kuo,et al.  An optimal control model for analyzing human postural balance , 1995, IEEE Transactions on Biomedical Engineering.

[24]  A. Opstal Dynamic Patterns: The Self-Organization of Brain and Behavior , 1995 .

[25]  G L Gottlieb,et al.  On the voluntary movement of compliant (inertial-viscoelastic) loads by parcellated control mechanisms. , 1996, Journal of neurophysiology.

[26]  E Bizzi,et al.  Augmented Feedback Presented in a Virtual Environment Accelerates Learning of a Difficult Motor Task. , 1997, Journal of motor behavior.

[27]  Gavan Lintern,et al.  Dynamic patterns: The self-organization of brain and behavior , 1997, Complex.

[28]  R. C. Miall,et al.  Multi-joint limbs permit a flexible response to unpredictable events , 1997, Experimental Brain Research.

[29]  Michael I. Jordan,et al.  The Role of Inertial Sensitivity in Motor Planning , 1998, The Journal of Neuroscience.

[30]  Daniel M. Wolpert,et al.  Signal-dependent noise determines motor planning , 1998, Nature.

[31]  E. Bizzi,et al.  Low dimensionality of supraspinally induced force fields. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[32]  Emanuel V. Todrov Studies of goal directed movements , 1998 .

[33]  M. Latash,et al.  Force sharing among fingers as a model of the redundancy problem , 1998, Experimental Brain Research.

[34]  Michael I. Jordan,et al.  Smoothness maximization along a predefined path accurately predicts the speed profiles of complex arm movements. , 1998, Journal of neurophysiology.

[35]  Gregor Schöner,et al.  The uncontrolled manifold concept: identifying control variables for a functional task , 1999, Experimental Brain Research.

[36]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[37]  J. F. Soechting,et al.  Force synergies for multifingered grasping , 2000, Experimental Brain Research.

[38]  M T Turvey,et al.  Specificity of postural sway to the demands of a precision task. , 2000, Gait & posture.

[39]  Gregor Schöner,et al.  Identifying the control structure of multijoint coordination during pistol shooting , 2000, Experimental Brain Research.

[40]  Reza Shadmehr,et al.  Learning of action through adaptive combination of motor primitives , 2000, Nature.

[41]  Michael I. Jordan,et al.  PEGASUS: A policy search method for large MDPs and POMDPs , 2000, UAI.

[42]  K. Newell,et al.  Dimensional change in motor learning. , 2001, Human movement science.

[43]  J. Flanagan,et al.  The Inertial Anisotropy of the Arm Is Accurately Predicted during Movement Planning , 2001, The Journal of Neuroscience.

[44]  D. Domkin,et al.  Structure of joint variability in bimanual pointing tasks , 2002, Experimental Brain Research.

[45]  Emanuel Todorov,et al.  Cosine Tuning Minimizes Motor Errors , 2002, Neural Computation.

[46]  Gregor Schöner,et al.  Goal-equivalent joint coordination in pointing: affect of vision and arm dominance. , 2002, Motor control.

[47]  M. Kawato,et al.  Formation and control of optimal trajectory in human multijoint arm movement , 1989, Biological Cybernetics.

[48]  James Gordon,et al.  Accuracy of planar reaching movements , 1994, Experimental Brain Research.

[49]  Patrick Haggard,et al.  Patterns of coordinated multi-joint movement , 2004, Experimental Brain Research.

[50]  J. Abbs,et al.  Variant and invariant characteristics of speech movements , 2004, Experimental Brain Research.

[51]  W. L. Nelson Physical principles for economies of skilled movements , 1983, Biological Cybernetics.

[52]  Michael I. Jordan,et al.  Are arm trajectories planned in kinematic or dynamic coordinates? An adaptation study , 1995, Experimental Brain Research.