Feature detection in human vision: a phase-dependent energy model

This paper presents a simple and biologically plausible model of how mammalian visual systems could detect and identify features in an image. We suggest that the points in a waveform that have unique perceptual significance as ‘lines’ and ‘edges’ are the points where the Fourier components of the waveform come into phase with each other. At these points ‘local energy’ is maximal. Local energy is defined as the square root of the sum of the squared response of sets of matched filters, of identical amplitude spectrum but differing in phase spectrum by 90°: one filter type has an even-symmetric line-spread function, the other an odd-symmetric line-spread function. For a line the main contribution to the local energy peak is in the output of the even-symmetric filters, whereas for edges it is in the output of the odd-symmetric filters. If both filter types respond at the peak of local energy, both edges and lines are seen, either simultaneously or alternating in time. The model was tested with a series of images, and shown to predict well the position of perceived features and the organization of the images.

[1]  Dennis Gabor,et al.  Theory of communication , 1946 .

[2]  Vivian O'Brien,et al.  Contour Perception, Illusion and Reality* , 1958 .

[3]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[4]  C Blakemore,et al.  On the existence of neurones in the human visual system selectively sensitive to the orientation and size of retinal images , 1969, The Journal of physiology.

[5]  J. R. Lee,et al.  How Does the Striate Cortex Begin the Reconstruction of the Visual World? , 1971, Science.

[6]  D. Tolhurst On the possible existence of edge detector neurones in the human visual system , 1972 .

[7]  D J Tolhurst,et al.  On the possible existance of edge detector neurones in the human visual system. , 1972, Vision research.

[8]  J. Kulikowski,et al.  Spatial arrangement of line, edge and grating detectors revealed by subthreshold summation. , 1973, Vision research.

[9]  R. M. Shapley,et al.  Edge detectors in human vision , 1973, The Journal of physiology.

[10]  L. Maffei,et al.  The visual cortex as a spatial frequency analyser. , 1973, Vision research.

[11]  F. Campbell,et al.  The effect of phase on the perception of compound gratings. , 1974, Vision research.

[12]  M. Georgeson,et al.  Contrast constancy: deblurring in human vision by spatial frequency channels. , 1975, The Journal of physiology.

[13]  P. Schiller,et al.  Quantitative studies of single-cell properties in monkey striate cortex. III. Spatial frequency. , 1976, Journal of neurophysiology.

[14]  D Marr,et al.  Early processing of visual information. , 1976, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[15]  F. Campbell,et al.  Why do we not perceive photons? , 1978, Nature.

[16]  J. Movshon,et al.  Receptive field organization of complex cells in the cat's striate cortex. , 1978, The Journal of physiology.

[17]  E. Hewitt,et al.  The Gibbs-Wilbraham phenomenon: An episode in fourier analysis , 1979 .

[18]  G. Sandini,et al.  Responses of visual cortical cells to periodic and non‐periodic stimuli. , 1979, The Journal of physiology.

[19]  D. Burr Sensitivity to spatial phase , 1980, Vision Research.

[20]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[21]  P. Lennie Parallel visual pathways: A review , 1980, Vision Research.

[22]  D. Pollen,et al.  Phase relationships between adjacent simple cells in the visual cortex. , 1981, Science.

[23]  A.V. Oppenheim,et al.  The importance of phase in signals , 1980, Proceedings of the IEEE.

[24]  L N Piotrowski,et al.  A Demonstration of the Visual Importance and Flexibility of Spatial-Frequency Amplitude and Phase , 1982, Perception.

[25]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[26]  J. Canny Finding Edges and Lines in Images , 1983 .

[27]  H. Wilson,et al.  Spatial frequency tuning of orientation selective units estimated by oblique masking , 1983, Vision Research.

[28]  D. Field,et al.  Phase reversal discrimination , 1984, Vision Research.

[29]  Michael S. Landy,et al.  HIPS: Image processing under UNIX. Software and applications , 1984 .

[30]  Michael S. Landy,et al.  HIPS: A unix-based image processing system , 1984, Comput. Vis. Graph. Image Process..

[31]  D. Badcock Spatial phase or luminance profile discrimination? , 1984, Vision Research.

[32]  D. Badcock How do we discriminate relative spatial phase? , 1984, Vision Research.

[33]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[34]  S. Klein,et al.  Hyperacuity thresholds of 1 sec: theoretical predictions and empirical validation. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[35]  T. Poggio,et al.  Fingerprints theorems for zero crossings , 1985 .

[36]  D. Burr,et al.  Spatial and temporal selectivity of the human motion detection system , 1985, Vision Research.

[37]  R. Watt,et al.  A theory of the primitive spatial code in human vision , 1985, Vision Research.

[38]  H. Spitzer,et al.  A complex-cell receptive-field model. , 1985, Journal of neurophysiology.

[39]  M. Morrone,et al.  MACH BANDS DEPEND ON VISUAL PHASE , 1986 .

[40]  D. Burr,et al.  Mach bands are phase dependent , 1986, Nature.

[41]  David C. Burr,et al.  Local and global visual processing , 1986, Vision Research.

[42]  D. Field,et al.  The structure and symmetry of simple-cell receptive-field profiles in the cat’s visual cortex , 1986, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[43]  Robyn A. Owens,et al.  Feature detection from local energy , 1987, Pattern Recognit. Lett..

[44]  D. Burr Implications of the Craik-O'Brien illusion for brightness perception , 1987, Vision Research.

[45]  D. Burr,et al.  The conditions under which Mach bands are visible , 1989, Vision Research.

[46]  D. Burr,et al.  Evidence for edge and bar detectors in human vision , 1989, Vision Research.