Catching heuristics are optimal control policies

Two seemingly contradictory theories attempt to explain how humans move to intercept an airborne ball. One theory posits that humans predict the ball trajectory to optimally plan future actions; the other claims that, instead of performing such complicated computations, humans employ heuristics to reactively choose appropriate actions based on immediate visual feedback. In this paper, we show that interception strategies appearing to be heuristics can be understood as computational solutions to the optimal control problem faced by a ball-catching agent acting under uncertainty. Modeling catching as a continuous partially observable Markov decision process and employing stochastic optimal control theory, we discover that the four main heuristics described in the literature are optimal solutions if the catcher has sufficient time to continuously visually track the ball. Specifically, by varying model parameters such as noise, time to ground contact, and perceptual latency, we show that different strategies arise under different circumstances. The catcher's policy switches between generating reactive and predictive behavior based on the ratio of system to observation noise and the ratio between reaction time and task duration. Thus, we provide a rational account of human ball-catching behavior and a unifying explanation for seemingly contradictory theories of target interception on the basis of stochastic optimal control.

[1]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[2]  Seville Chapman Catching a Baseball , 1968 .

[3]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[4]  P. J. Brancazio Looking into Chapman’s homer: The physics of judging a fly ball , 1985 .

[5]  宇野 洋二,et al.  Formation and control of optimal trajectory in human multijoint arm movement : minimum torque-change model , 1988 .

[6]  M K Kaiser,et al.  How baseball outfielders determine where to run to catch fly balls. , 1995, Science.

[7]  Daniel M. Wolpert,et al.  Forward Models for Physiological Motor Control , 1996, Neural Networks.

[8]  Daniel M. Wolpert,et al.  Signal-dependent noise determines motor planning , 1998, Nature.

[9]  J. Betts Survey of Numerical Methods for Trajectory Optimization , 1998 .

[10]  F. Lacquaniti,et al.  Does the brain model Newton's laws? , 2001, Nature Neuroscience.

[11]  M. Pandy,et al.  Dynamic optimization of human walking. , 2001, Journal of biomechanical engineering.

[12]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[13]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[14]  M. Kawato,et al.  Formation and control of optimal trajectory in human multijoint arm movement , 1989, Biological Cybernetics.

[15]  Mary Hayhoe,et al.  The role of prediction in catching balls. , 2004 .

[16]  Pierre-Brice Wieber,et al.  Fast Direct Multiple Shooting Algorithms for Optimal Robot Control , 2005 .

[17]  Lorenz T. Biegler,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006, Math. Program..

[18]  P. McLeod,et al.  The generalized optic acceleration cancellation theory of catching. , 2006, Journal of experimental psychology. Human perception and performance.

[19]  G. Gigerenzer Gut Feelings: The Intelligence of the Unconscious , 2007 .

[20]  F. Lacquaniti,et al.  Visuo-motor coordination and internal models for object interception , 2009, Experimental Brain Research.

[21]  Gerd Gigerenzer,et al.  Homo Heuristicus: Why Biased Minds Make Better Inferences , 2009, Top. Cogn. Sci..

[22]  William H Warren,et al.  Catching fly balls in virtual reality: a critical test of the outfielder problem. , 2009, Journal of vision.

[23]  Leslie Pack Kaelbling,et al.  Belief space planning assuming maximum likelihood observations , 2010, Robotics: Science and Systems.

[24]  C. Tomlin,et al.  Closed-loop belief space planning for linear, Gaussian systems , 2011, 2011 IEEE International Conference on Robotics and Automation.

[25]  Nicholas Roy,et al.  Rapidly-exploring Random Belief Trees for motion planning under uncertainty , 2011, 2011 IEEE International Conference on Robotics and Automation.

[26]  Ron Alterovitz,et al.  Motion planning under uncertainty using iterative local optimization in belief space , 2012, Int. J. Robotics Res..

[27]  Moritz Diehl,et al.  CasADi -- A symbolic package for automatic differentiation and optimal control , 2012 .

[28]  Pieter Abbeel,et al.  Scaling up Gaussian Belief Space Planning Through Covariance-Free Trajectory Optimization and Automatic Differentiation , 2014, WAFR.