Visual hyperacuity: spatiotemporal interpolation in human vision

Stroboscopic presentation of a moving object can be interpolated by our visual system into the perception of continuous motion. The precision of this interpolation process has been explored by measuring the vernier discrimination threshold for targets displayed stroboscopically at a sequence of stations. The vernier targets, moving at constant velocity, were presented either with a spatial offset or with a temporal offset or with both. The main results are: (1) vernier acuity for spatial offset is rather invariant over a wide range of velocities and separations between the stations (see Westheimer & McKee 1975); (2) vernier acuity for temporal offset depends on spatial separation and velocity. At each separation there is an optimal velocity such that the strobe interval is roughly constant at about 30 ms; optimal acuity decreases with increasing separation; (3) blur of the vernier pattern decreases acuity for spatial offsets, but improves acuity for temporal offsets (at high velocities and large separations); (4) a temporal offset exactly compensates the equivalent (at the given velocity) spatial offset only for a small separation and optimal velocity; otherwise the spatial offset dominates. A theoretical analysis of the interpolation problem suggests a computational scheme based on the assumption of constant velocity motion. This assumption reflects a constraint satisfied in normal vision over the short times and small distances normally relevant for the interpolation process. A reasonable implementation of this scheme only requires a set of independent, direction selective spatiotemporal channels, that is receptive fields with the different sizes and temporal properties revealed by psychophysical experiments. It is concluded that sophisticated mechanisms are not required to account for the main properties of vernier acuity with moving targets. It is furthermore suggested that the spatiotemporal channels of human vision may be the interpolation filters themselves. Possible neurophysiological implications are briefly discussed.

[1]  G. Westheimer Eye movement responses to a horizontally moving visual stimulus. , 1954, A.M.A. archives of ophthalmology.

[2]  D. Sholl The organization of the cerebral cortex , 1957 .

[3]  J. Robson,et al.  Application of fourier analysis to the visibility of gratings , 1968, The Journal of physiology.

[4]  G Stigmar,et al.  BLURRED VISUAL STIMULI , 1971 .

[5]  Gerald Westheimer,et al.  Temporal and spatial interference with vernier acuity , 1975, Vision Research.

[6]  S. McKee,et al.  Visual acuity in the presence of retinal-image motion. , 1975, Journal of the Optical Society of America.

[7]  G. Westheimer Diffraction Theory and Visual Hyperacuity* , 1976, American journal of optometry and physiological optics.

[8]  M. Morgan Pulfrich Effect and the Filling in of Apparent Motion , 1976, Perception.

[9]  H. Wilson,et al.  Threshold visibility of frequency gradient patterns , 1977, Vision Research.

[10]  A. Watson,et al.  Patterns of temporal interaction in the detection of gratings , 1977, Vision Research.

[11]  Suzanne P. McKee,et al.  Integration regions for visual hyperacuity , 1977, Vision Research.

[12]  S. McKee,et al.  Spatial configurations for visual hyperacuity , 1977, Vision Research.

[13]  H. B. Barlow,et al.  Reconstructing the visual image in space and time , 1979, Nature.

[14]  D. Burr Acuity for apparent vernier offset , 1979, Vision Research.

[15]  S. McKee,et al.  What prior uniocular processing is necessary for stereopsis? , 1979, Investigative ophthalmology & visual science.

[16]  M. Morgan,et al.  Perception of continuity in stroboscopic motion: A temporal frequency analysis , 1979, Vision Research.

[17]  David C. Burr,et al.  How does binocular delay give information about depth? , 1979, Vision Research.

[18]  J. Bergen,et al.  A four mechanism model for threshold spatial vision , 1979, Vision Research.

[19]  D Marr,et al.  Bandpass channels, zero-crossings, and early visual information processing. , 1979, Journal of the Optical Society of America.

[20]  S. Ullman The Interpretation of Visual Motion , 1979 .

[21]  D. H. Kelly Motion and vision. II. Stabilized spatio-temporal threshold surface. , 1979, Journal of the Optical Society of America.

[22]  A. Watson Probability summation over time , 1979, Vision Research.

[23]  M J Morgan,et al.  Spatiotemporal Filtering and the Interpolation Effect in Apparent Motion , 1980, Perception.

[24]  M J Morgan,et al.  Analogue models of motion perception. , 1980, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[25]  D. Burr Motion smear , 1980, Nature.

[26]  O J Braddick,et al.  Low-level and high-level processes in apparent motion. , 1980, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[27]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[28]  D. Marr,et al.  An Information Processing Approach to Understanding the Visual Cortex , 1980 .

[29]  D. Marr,et al.  Smallest channel in early human vision. , 1980, Journal of the Optical Society of America.