Orientational minimal redundancy wavelets: from edge detection to perception

Natural images are complex but very structured objects and, in spite of its complexity, the sensory areas in the neocortex in mammals are able to devise learned strategies to encode them efficiently. How is this goal achieved? In this paper, we will discuss the multiscaling approach, which has been recently used to derive a redundancy reducing wavelet basis. This kind of representation can be statistically learned from the data and is optimally adapted for image coding; besides, it presents some remarkable features found in the visual pathway. We will show that the introduction of oriented wavelets is necessary to provide a complete description, which stresses the role of the wavelets as edge detectors.

[1]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[2]  David J. Field,et al.  What Is the Goal of Sensory Coding? , 1994, Neural Computation.

[3]  Horace Barlow,et al.  What is the computational goal of the neocortex , 1994 .

[4]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1967 .

[5]  J. Movshon,et al.  Linearity and Normalization in Simple Cells of the Macaque Primary Visual Cortex , 1997, The Journal of Neuroscience.

[6]  G. Wornell.  Wavelet-based representations for the 1/f family of fractal processes , 1993, Proc. IEEE.

[7]  J. Nadal,et al.  Nonlinear neurons in the low-noise limit: a factorial code maximizes information transfer Network 5 , 1994 .

[8]  Joseph J. Atick,et al.  Towards a Theory of Early Visual Processing , 1990, Neural Computation.

[9]  Eero P. Simoncelli,et al.  Image compression via joint statistical characterization in the wavelet domain , 1999, IEEE Trans. Image Process..

[10]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[11]  Antonio Turiel,et al.  Self-similarity Properties of Natural Images , 1997, NIPS.

[12]  J. H. Hateren,et al.  Theoretical predictions of spatiotemporal receptive fields of fly LMCs, and experimental validation , 1992, Journal of Comparative Physiology A.

[13]  D. Heeger.  Normalization of cell responses in cat striate cortex , 1992, Visual Neuroscience.

[14]  David Mumford,et al.  Statistics of natural images and models , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[15]  Antonio Turiel,et al.  The Multifractal Structure of Contrast Changes in Natural Images: From Sharp Edges to Textures , 2000, Neural Computation.

[16]  Joel L. Davis,et al.  Large-Scale Neuronal Theories of the Brain , 1994 .

[17]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[18]  N. Parga,et al.  Scene dependence of the non-Gaussian scaling properties of natural images , 2000, Network.

[19]  Joseph J. Atick,et al.  What Does the Retina Know about Natural Scenes? , 1992, Neural Computation.

[20]  Antonio Turiel,et al.  Reconstructing images from their most singular fractal manifold , 2002, IEEE Trans. Image Process..

[21]  Eero P. Simoncelli.  Shiftable multi-scale transforms [or "What's wrong with orthonormal wavelets"] , 1992 .

[22]  Novikov,et al.  Infinitely divisible distributions in turbulence. , 1994, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[23]  Vision Research , 1961, Nature.

[24]  Zhaoping Li,et al.  Towards a theory of striate cortex , 1994 .

[25]  Zhaoping Li,et al.  Toward a Theory of the Striate Cortex , 1994, Neural Computation.

[26]  J. Nadal,et al.  Self-Similarity Properties of Natural Images Resemble Those of Turbulent Flows , 1998, cond-mat/0107314.

[27]  L. Maffei,et al.  The visual cortex as a spatial frequency analyser. , 1973, Vision research.

[28]  Ralph Linsker,et al.  Self-organization in a perceptual network , 1988, Computer.

[29]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[30]  Edward H. Adelson,et al.  Shiftable multiscale transforms , 1992, IEEE Trans. Inf. Theory.

[31]  Eero P. Simoncelli,et al.  Random Cascades on Wavelet Trees and Their Use in Analyzing and Modeling Natural Images , 2001 .

[32]  Martin J. Wainwright,et al.  Scale Mixtures of Gaussians and the Statistics of Natural Images , 1999, NIPS.

[33]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[34]  J. H. Hateren,et al.  Independent component filters of natural images compared with simple cells in primary visual cortex , 1998 .

[35]  Antonio Turiel.  WAVELET BASED DECOMPOSITION OF NATURAL IMAGES IN INDEPENDENT RESOLUTION LEVELS , 2003 .

[36]  Ruderman,et al.  Multiscaling and information content of natural color images , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[37]  D. Ruderman.  The statistics of natural images , 1994 .

[38]  I. Daubechies.  Ten Lectures on Wavelets , 1992 .

[39]  R C Reid,et al.  Efficient Coding of Natural Scenes in the Lateral Geniculate Nucleus: Experimental Test of a Computational Theory , 1996, The Journal of Neuroscience.

[40]  Stéphane Mallat,et al.  Characterization of Signals from Multiscale Edges , 2011, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  A Turiel,et al.  Multifractal wavelet filter of natural images. , 2000, Physical review letters.