Early stages in a sensorimotor transformation

Abstract We present a model for several early stages of the sensorimotor transformations involved in targeted arm movement. In psychophysical experiments, human subjects pointed to the remembered locations of randomly placed targets in three-dimensional space. They made consistent errors in distance, and from these errors stages in the sensorimotor transformation were deduced. When subjects attempted to move the right index finger to a virtual target they consistently undershot the distance of the more distal targets. Other experiments indicated that the error was in the sensorimotor transformation rather than in the perception of distance. The error was most consistent when evaluated using a spherical coordinate system based at the right shoulder, indicating that the neural representation of target parameters is transformed from a retinocentric representation to a shoulder-centered representation. According to the model, the error in distance results from the neural implementation of a linear approximation in the algorithm to transform shoulder-centered target parameters into a set of arm orientations appropriate for placing the finger on the target. The transformation to final arm orientations places visually derived information into a frame of reference where it can readily be combined with kinesthetically derived information about initial arm orientations. The combination of these representations of initial and final arm orientations could give rise to the representation of movement direction recorded in the motor cortex by Georgopoulos and his colleagues. Later stages, such as the transformation from kinematic (position) to dynamic (force) parameters, or to levels of muscle activation, are beyond the scope of the present model.

[1]  H. P. Bowditch,et al.  A Comparison of Sight and Touch , 1882, The Journal of physiology.

[2]  P. C. Knapp,et al.  Lectures on the Diagnosis of Diseases of the Brain , 1885 .

[3]  G. Fullerton Psychology and physiology. , 1896 .

[4]  Robert Sessions Woodworth,et al.  THE ACCURACY OF VOLUNTARY MOVEMENT , 1899 .

[5]  G. Holmes DISTURBANCES OF VISUAL ORIENTATION , 1918, The British journal of ophthalmology.

[6]  E. B. Knauft,et al.  The accuracy of positioning reactions as a function of their direction and extent. , 1948, The American journal of psychology.

[7]  P. Fitts,et al.  S-R compatibility: spatial characteristics of stimulus and response codes. , 1953, Journal of experimental psychology.

[8]  C. Slack Some characteristics of the 'Range effect'. , 1953, Journal of experimental psychology.

[9]  R. Penrose A Generalized inverse for matrices , 1955 .

[10]  F. Plum Handbook of Physiology. , 1960 .

[11]  C. S. Harris Perceptual adaptation to inverted, reversed, and displaced vision. , 1965, Psychological review.

[12]  N. Draper,et al.  Applied Regression Analysis , 1966 .

[13]  D. Holding Accuracy of delayed aiming responses , 1968 .

[14]  A. Fuchs,et al.  Further properties of the human saccadic system: eye movements and correction saccades with and without visual fixation points. , 1969, Vision research.

[15]  D. E. Whitney,et al.  The mathematics of coordinated control of prosthetic arms and manipulators. , 1972 .

[16]  D. McCloskey,et al.  The contribution of muscle afferents to kinaesthesia shown by vibration induced illusions of movement and by the effects of paralysing joint afferents. , 1972, Brain : a journal of neurology.

[17]  D. Pedoe A course of geometry for colleges and universities , 1972 .

[18]  John M. Foley,et al.  Visually directed pointing as a function of target distance, direction, and available cues , 1972 .

[19]  Adi Ben-Israel,et al.  Generalized inverses: theory and applications , 1974 .

[20]  G. C. Joyce,et al.  The forces generated at the human elbow joint in response to imposed sinusoidal movements of the forearm , 1974, The Journal of physiology.

[21]  E. Poulton Range Effects in Experiments on People , 1975 .

[22]  L. Buck Boundary distance effects on overshooting. , 1976, Journal of motor behavior.

[23]  R. Carpenter,et al.  Movements of the Eyes , 1978 .

[24]  E. Bizzi,et al.  Characteristics of motor programs underlying arm movements in monkeys. , 1979, Journal of neurophysiology.

[25]  A. Pellionisz,et al.  Brain modeling by tensor network theory and computer simulation. The cerebellum: Distributed processor for predictive coordination , 1979, Neuroscience.

[26]  B. Bridgeman,et al.  Relation between cognitive and motor-oriented systems of visual position perception. , 1979 .

[27]  L E Mays,et al.  Saccades are spatially, not retinocentrically, coded. , 1980, Science.

[28]  A. Pellionisz,et al.  Tensorial approach to the geometry of brain function: Cerebellar coordination via a metric tensor , 1980, Neuroscience.

[29]  W. Rymer,et al.  Joint position sense: the effects of muscle contraction. , 1980, Brain : a journal of neurology.

[30]  J. Kelso,et al.  Exploring a vibratory systems analysis of human movement production. , 1980, Journal of neurophysiology.

[31]  H. Sakata,et al.  Spatial properties of visual fixation neurons in posterior parietal association cortex of the monkey. , 1980, Journal of neurophysiology.

[32]  J. T. Massey,et al.  Spatial trajectories and reaction times of aimed movements: effects of practice, uncertainty, and change in target location. , 1981, Journal of neurophysiology.

[33]  Woolsey,et al.  Cortical Sensory Organization , 1981, Cortical Sensory Organization.

[34]  J. F. Soechting,et al.  Invariant characteristics of a pointing movement in man , 1981, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[35]  J. Paillard,et al.  Visual motion cues in prismatic adaptation: evidence of two separate and additive processes. , 1981, Acta psychologica.

[36]  Bruce M. Carlson,et al.  Morphogenesis and Pattern Formation , 1981 .

[37]  Richard A. Johnson,et al.  Applied Multivariate Statistical Analysis , 1983 .

[38]  A. Pellionisz,et al.  Space-time representation in the brain. The cerebellum as a predictive space-time metric tensor , 1982, Neuroscience.

[39]  A P Georgopoulos,et al.  On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[40]  L. Kempe Handbook of Physiology. Section I. The Nervous System , 1982 .

[41]  J. F. Soechting,et al.  Does position sense at the elbow reflect a sense of elbow joint angle or one of limb orientation? , 1982, Brain Research.

[42]  J. Ewert Advances in vertebrate neuroethology , 1982, Trends in Neurosciences.

[43]  S. Gandevia,et al.  Theoretical requirements for the interpretation of signals of intramuscular tension. , 1982, Journal of theoretical biology.

[44]  E. Bizzi,et al.  Human arm trajectory formation. , 1982, Brain : a journal of neurology.

[45]  E. Bizzi,et al.  Mechanical properties of muscles: Implications for motor control , 1982, Trends in Neurosciences.

[46]  J. Sanes,et al.  Effects of perturbations on accuracy of arm movements , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[47]  R. A. Davidoff Handbook of the spinal cord , 1983 .

[48]  John F. Kalaska,et al.  Spatial coding of movement: A hypothesis concerning the coding of movement direction by motor cortical populations , 1983 .

[49]  E. Thelen,et al.  The organization of spontaneous leg movements in newborn infants. , 1983, Journal of motor behavior.

[50]  R. Andersen,et al.  The influence of the angle of gaze upon the excitability of the light- sensitive neurons of the posterior parietal cortex , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[51]  R. Wurtz,et al.  Visual and oculomotor functions of monkey substantia nigra pars reticulata. III. Memory-contingent visual and saccade responses. , 1983, Journal of neurophysiology.

[52]  W. Graf,et al.  A quantitative analysis of the spatial organization of the vestibulo-ocular reflexes in lateral- and frontal-eyed animals—I. Orientation of semicircular canals and extraocular muscles , 1984, Neuroscience.

[53]  J. F. Soechting,et al.  Psychophysical determination of coordinate representation of human arm orientation , 1984, Neuroscience.

[54]  A. Pellionisz Coordination: a vector-matrix description of transformations of overcomplete CNS coordinates and a tensorial solution using the Moore-Penrose generalized inverse. , 1984, Journal of theoretical biology.

[55]  R. M. Siegel,et al.  Encoding of spatial location by posterior parietal neurons. , 1985, Science.

[56]  S. Wise The primate premotor cortex: past, present, and preparatory. , 1985, Annual review of neuroscience.

[57]  M A Arbib,et al.  Schemas for the temporal organization of behaviour. , 1985, Human neurobiology.

[58]  S. Gandevia Illusory movements produced by electrical stimulation of low-threshold muscle afferents from the hand. , 1985, Brain : a journal of neurology.

[59]  S. Amari,et al.  Sensori-motor transformations in the brain (with a critique of the tensor theory of cerebellum). , 1985, Journal of theoretical biology.

[60]  S. Wray Adaptive mechanisms in gaze control. , 1986, Reviews of oculomotor research.

[61]  J. Perkell,et al.  Variability in production of the vowels /i/ and /a/. , 1985, The Journal of the Acoustical Society of America.

[62]  R. Wurtz,et al.  Modification of saccadic eye movements by GABA-related substances. II. Effects of muscimol in monkey substantia nigra pars reticulata. , 1985, Journal of neurophysiology.

[63]  A. G. Feldman Once More on the Equilibrium-Point Hypothesis (λ Model) for Motor Control , 1986 .

[64]  D L Sparks,et al.  Translation of sensory signals into commands for control of saccadic eye movements: role of primate superior colliculus. , 1986, Physiological reviews.

[65]  W. Rymer,et al.  Characteristics of synergic relations during isometric contractions of human elbow muscles. , 1986, Journal of neurophysiology.

[66]  M. Hoy,et al.  The role of intersegmental dynamics during rapid limb oscillations. , 1986, Journal of biomechanics.

[67]  J. F. Soechting,et al.  Path constraints on point-to-point arm movements in three-dimensional space , 1986, Neuroscience.

[68]  J. F. Soechting,et al.  An algorithm for the generation of curvilinear wrist motion in an arbitrary plane in three-dimensional space , 1986, Neuroscience.

[69]  L. Kaufman,et al.  Handbook of perception and human performance , 1986 .

[70]  M. Konishi Centrally synthesized maps of sensory space , 1986, Trends in Neurosciences.

[71]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[72]  M. Arbib,et al.  Opposition Space as a Structuring Concept for the Analysis of Skilled Hand Movements , 1986 .

[73]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[74]  P. Grobstein,et al.  Neuronal organization underlying visually elicited prey orienting in the frog—III. Evidence for the existence of an uncrossed descending tectofugal pathway , 1987, Neuroscience.

[75]  J. V. Gisbergen,et al.  Collicular ensemble coding of saccades based on vector summation , 1987, Neuroscience.

[76]  P. Grobstein,et al.  Neuronal organization underlying visually elicited prey orienting in the frog—II. Anatomical studies on the laterality of central projections , 1987, Neuroscience.

[77]  J. V. Gisbergen,et al.  A parametric analysis of human saccades in different experimental paradigms , 1987, Vision Research.

[78]  T. Sejnowski Computational models and the development of topographic projections , 1987, Trends in Neurosciences.

[79]  T. Flash,et al.  Moving gracefully: quantitative theories of motor coordination , 1987, Trends in Neurosciences.

[80]  C. Thinus-Blanc,et al.  Cognitive Processes and Spatial Orientation in Animal and Man , 1987 .

[81]  Y. Lamarre,et al.  Rapid elbow flexion in the absence of proprioceptive and cutaneous feedback. , 1987, Human neurobiology.

[82]  C. Koch,et al.  The analysis of visual motion: from computational theory to neuronal mechanisms. , 1986, Annual review of neuroscience.

[83]  P. Grobstein The nervous system/behavior interface: Levels of organization and levels of approach , 1987, Behavioral and Brain Sciences.

[84]  E. Bizzi,et al.  Controlling multijoint motor behavior. , 1987, Exercise and sport sciences reviews.

[85]  P. Grobstein,et al.  Neuronal organization underlying visually elicited prey orienting in the frog—I. Effects of various unilateral lesions , 1987, Neuroscience.

[86]  E I Knudsen,et al.  Computational maps in the brain. , 1987, Annual review of neuroscience.

[87]  C. Hofsten,et al.  The integration of sensory information in the development of precise manual pointing , 1988, Neuropsychologia.

[88]  T. Shallice From Neuropsychology to Mental Structure , 1988 .

[89]  J. Macpherson Strategies that simplify the control of quadrupedal stance. I. Forces at the ground. , 1988, Journal of neurophysiology.

[90]  Daniel Bullock,et al.  Neural dynamics of planned arm movements: emergent invariants and speed-accuracy properties during trajectory formation , 1988 .

[91]  A. Pellionisz Tensorial aspects of the multidimensional massively parallel sensorimotor function of neuronal networks. , 1988, Progress in brain research.

[92]  V. Gurfinkel,et al.  Anticipatory neck muscle activity associated with rapid arm movements , 1988, Neuroscience Letters.

[93]  G. Poggio,et al.  Stereoscopic mechanisms in monkey visual cortex: binocular correlation and disparity selectivity , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[94]  R. Andersen,et al.  The role of the posterior parietal cortex in coordinate transformations for visual-motor integration. , 1988, Canadian journal of physiology and pharmacology.

[95]  D. Elliott,et al.  Manual localization of lateralized visual targets. , 1988, Journal of motor behavior.

[96]  M. Kuperstein,et al.  An adaptive neural model for mapping invariant target position. , 1988, Behavioral neuroscience.

[97]  J. Simpson,et al.  The accessory optic system of rabbit. II. Spatial organization of direction selectivity. , 1988, Journal of neurophysiology.

[98]  A. P. Georgopoulos,et al.  Primate motor cortex and free arm movements to visual targets in three- dimensional space. I. Relations between single cell discharge and direction of movement , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[99]  M. Jeannerod The neural and behavioural organization of goal-directed movements , 1990, Psychological Medicine.

[100]  N Hogan,et al.  Planning and execution of multijoint movements. , 1988, Canadian journal of physiology and pharmacology.

[101]  A. P. Georgopoulos,et al.  Primate motor cortex and free arm movements to visual targets in three- dimensional space. II. Coding of the direction of movement by a neuronal population , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[102]  D. Hubel,et al.  Segregation of form, color, movement, and depth: anatomy, physiology, and perception. , 1988, Science.

[103]  D. Sparks,et al.  Population coding of saccadic eye movements by neurons in the superior colliculus , 1988, Nature.

[104]  P. Grobstein Between the retinotectal projection and directed movement: topography of a sensorimotor interface. , 1988, Brain, behavior and evolution.

[105]  M Kuperstein,et al.  Neural model of adaptive hand-eye coordination for single postures. , 1988, Science.

[106]  F. Zajac,et al.  Determining Muscle's Force and Action in Multi‐Articular Movement , 1989, Exercise and sport sciences reviews.

[107]  J. Kalaska,et al.  A comparison of movement direction-related versus load direction- related activity in primate motor cortex, using a two-dimensional reaching task , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[108]  Richard D. Jones,et al.  Impairment and recovery of ipsilateral sensory-motor function following unilateral cerebral infarction. , 1989, Brain : a journal of neurology.

[109]  R. Andersen Visual and eye movement functions of the posterior parietal cortex. , 1989, Annual review of neuroscience.

[110]  P. Goldman-Rakic,et al.  Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. , 1989, Journal of neurophysiology.

[111]  G. Gottlieb,et al.  Strategies for the control of voluntary movements with one mechanical degree of freedom , 1989, Behavioral and Brain Sciences.

[112]  J. Ewert,et al.  Visuomotor Coordination: Amphibians, Comparisons, Models, and Robots , 1989 .

[113]  F. Lacquaniti Central representations of human limb movement as revealed by studies of drawing and handwriting , 1989, Trends in Neurosciences.

[114]  W. Rymer,et al.  Strategies for muscle activation during isometric torque generation at the human elbow. , 1989, Journal of neurophysiology.

[115]  C Ghez,et al.  Gradual specification of response amplitude in human tracking performance. , 1989, Brain, behavior and evolution.

[116]  Martha Flanders,et al.  Sensory control of target acquisition , 1989, Trends in Neurosciences.

[117]  S. Gandevia,et al.  The distribution of muscular weakness in upper motor neuron lesions affecting the arm. , 1989, Brain : a journal of neurology.

[118]  C J Worringham,et al.  Operator orientation and compatibility in visual-motor task performance. , 1989, Ergonomics.

[119]  E. Bizzi,et al.  Kinematic strategies and sensorimotor transformations in the wiping movements of frogs. , 1989, Journal of neurophysiology.

[120]  J. F. Soechting,et al.  Errors in pointing are due to approximations in sensorimotor transformations. , 1989, Journal of neurophysiology.

[121]  W. Ferrell,et al.  The effect of loading on position sense at the proximal interphalangeal joint of the human index finger. , 1989, The Journal of physiology.

[122]  J. F. Soechting,et al.  Sensorimotor representations for pointing to targets in three-dimensional space. , 1989, Journal of neurophysiology.

[123]  James Trevelyan,et al.  Sensing and control for sheep shearing robots , 1989, IEEE Trans. Robotics Autom..

[124]  R. Llinás,et al.  The Functional Organization of the Olivo‐Cerebellar System as Examined by Multiple Purkinje Cell Recordings , 1989, The European journal of neuroscience.

[125]  N. Logothetis,et al.  Perceptual deficits and the activity of the color-opponent and broad-band pathways at isoluminance. , 1990, Science.

[126]  J. F. Soechting,et al.  Transformation from Head- to Shoulder-Centered Representation of Target Direction in Arm Movements , 1990, Journal of Cognitive Neuroscience.

[127]  R Linsker,et al.  Perceptual neural organization: some approaches based on network models and information theory. , 1990, Annual review of neuroscience.

[128]  J F Soechting,et al.  Parcellation of sensorimotor transformations for arm movements , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[129]  T. Sejnowski,et al.  Neural network model of visual cortex for determining surface curvature from images of shaded surfaces , 1990, Proceedings of the Royal Society of London. B. Biological Sciences.

[130]  W. T. Bourbon,et al.  On the Accuracy and Reliability of Predictions by Control-System Theory , 1990, Perceptual and motor skills.

[131]  Eileen Kowler Eye movements and their role in visual and cognitive processes. , 1990, Reviews of oculomotor research.

[132]  R. Eckmiller Advanced neural computers , 1990 .

[133]  G. E. Alexander,et al.  Preparation for movement: neural representations of intended direction in three motor areas of the monkey. , 1990, Journal of neurophysiology.

[134]  F Lacquaniti,et al.  The control of limb geometry in cat posture. , 1990, The Journal of physiology.

[135]  Bruno Siciliano,et al.  A closed-loop inverse kinematic scheme for on-line joint-based robot control , 1990, Robotica.

[136]  G E Alexander,et al.  Neural representations of the target (goal) of visually guided arm movements in three motor areas of the monkey. , 1990, Journal of neurophysiology.

[137]  J. Mcilwain Topography of eye-position sensitivity of saccades evoked electrically from the cat's superior colliculus , 1990, Visual Neuroscience.

[138]  Paul B. Johnson,et al.  Making arm movements within different parts of space: dynamic aspects in the primate motor cortex , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[139]  S. Gandevia,et al.  The distribution of muscle weakness in upper motoneuron lesions affecting the lower limb. , 1990, Brain : a journal of neurology.

[140]  E. Knudsen,et al.  Horizontal and vertical components of head movement are controlled by distinct neural circuits in the barn owl , 1990, Nature.

[141]  Richard S. Sutton,et al.  Neural networks for control , 1990 .

[142]  L. Fogassi,et al.  Eye position effects on visual, memory, and saccade-related activity in areas LIP and 7a of macaque , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[143]  G E Alexander,et al.  Movement-related neuronal activity selectively coding either direction or muscle pattern in three motor areas of the monkey. , 1990, Journal of neurophysiology.

[144]  L. Yardley Contribution of somatosensory information to perception of the visual vertical with body tilt and rotating visual field , 1990, Perception & psychophysics.

[145]  L E Mays,et al.  Signal transformations required for the generation of saccadic eye movements. , 1990, Annual review of neuroscience.

[146]  W. Chapple,et al.  Kinematic analysis of the defense response in crayfish. , 1990, Journal of neurophysiology.

[147]  C Ghez,et al.  Roles of proprioceptive input in the programming of arm trajectories. , 1990, Cold Spring Harbor symposia on quantitative biology.

[148]  Z. Hasan,et al.  Timing and magnitude of electromyographic activity for two-joint arm movements in different directions. , 1991, Journal of neurophysiology.

[149]  R. Andersen,et al.  Saccade-related activity in the lateral intraparietal area. II. Spatial properties. , 1991, Journal of neurophysiology.

[150]  J F Soechting,et al.  A coordinate system for the synthesis of visual and kinesthetic information , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[151]  Z. Hasan,et al.  Initiation rules for planar, two-joint arm movements: agonist selection for movements throughout the work space. , 1991, Journal of neurophysiology.

[152]  R Caminiti,et al.  Making arm movements within different parts of space: the premotor and motor cortical representation of a coordinate system for reaching to visual targets , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[153]  RP Dum,et al.  The origin of corticospinal projections from the premotor areas in the frontal lobe , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[154]  R. Andersen,et al.  Saccade-related activity in the lateral intraparietal area. I. Temporal properties; comparison with area 7a. , 1991, Journal of neurophysiology.

[155]  L. Jakobson,et al.  A neurological dissociation between perceiving objects and grasping them , 1991, Nature.

[156]  D. Humphrey,et al.  Motor control : concepts and issues , 1991 .

[157]  Richard A. Andersen,et al.  Sensorimotor transformation during eye movements to remembered visual targets , 1991, Vision Research.

[158]  J. Paillard Brain and space , 1991 .

[159]  Lynn Nadel,et al.  1990 Lectures in Complex Systems , 1991 .

[160]  M. Goodale,et al.  Separate visual pathways for perception and action , 1992, Trends in Neurosciences.

[161]  Michelle Fleury,et al.  Different Patterns in Aiming Accuracy for Head-Movers and Non-Head Movers , 1992 .

[162]  Stuart C. Shapiro,et al.  Encyclopedia of artificial intelligence, vols. 1 and 2 (2nd ed.) , 1992 .

[163]  D. Margolin Cognitive neuropsychology in clinical practice , 1992 .

[164]  J. Summers Approaches to the study of motor control and learning , 1992 .

[165]  Michael I. Posner,et al.  Foundations of cognitive neuroscience , 1993 .

[166]  Eric L. Schwartz,et al.  Computational Neuroscience , 1993, Neuromethods.