Chromatic structure of natural scenes.

We applied independent component analysis (ICA) to hyperspectral images in order to learn an efficient representation of color in natural scenes. In the spectra of single pixels, the algorithm found basis functions that had broadband spectra and basis functions that were similar to natural reflectance spectra. When applied to small image patches, the algorithm found some basis functions that were achromatic and others with overall chromatic variation along lines in color space, indicating color opponency. The directions of opponency were not strictly orthogonal. Comparison with principal-component analysis on the basis of statistical measures such as average mutual information, kurtosis, and entropy, shows that the ICA transformation results in much sparser coefficients and gives higher coding efficiency. Our findings suggest that nonorthogonal opponent encoding of photoreceptor signals leads to higher coding efficiency and that ICA may be used to reveal the underlying statistical properties of color information in natural scenes.

[1]  Gunther Wyszecki,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulae, 2nd Edition , 2000 .

[2]  J. Cohen,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulas , 1968 .

[3]  R. M. Boynton,et al.  Chromaticity diagram showing cone excitation by stimuli of equal luminance. , 1979, Journal of the Optical Society of America.

[4]  F. Billmeyer Color Science: Concepts and Methods, Quantitative Data and Formulae, 2nd ed., by Gunter Wyszecki and W. S. Stiles, John Wiley and Sons, New York, 1982, 950 pp. Price: $75.00 , 1983 .

[5]  G. Buchsbaum,et al.  Trichromacy, opponent colours coding and optimum colour information transmission in the retina , 1983, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[6]  P. Lennie,et al.  Chromatic mechanisms in lateral geniculate nucleus of macaque. , 1984, The Journal of physiology.

[7]  L. Maloney Evaluation of linear models of surface spectral reflectance with small numbers of parameters. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[8]  J. Mollon "Tho' she kneel'd in that place where they grew..." The uses and origins of primate colour vision. , 1989, The Journal of experimental biology.

[9]  J. Lythgoe,et al.  Visual pigments and the acquisition of visual information. , 1989, The Journal of experimental biology.

[10]  P. Lennie,et al.  Chromatic mechanisms in striate cortex of macaque , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[11]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[12]  David H. Brainard,et al.  The Cost of Trichromacy for Spatial Vision , 1991 .

[13]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[14]  D. Macleod,et al.  Spectral sensitivities of the human cones. , 1993, Journal of the Optical Society of America. A, Optics, image science, and vision.

[15]  Ron Gershon,et al.  Measurement and Analysis of Object Reflectance Spectra , 1994 .

[16]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[17]  David J. Field,et al.  What Is the Goal of Sensory Coding? , 1994, Neural Computation.

[18]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[19]  C. J.,et al.  Maximum Likelihood and Covariant Algorithms for Independent Component Analysis , 1996 .

[20]  Barak A. Pearlmutter,et al.  A Context-Sensitive Generalization of ICA , 1996 .

[21]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[22]  M. Vorobyev,et al.  Colour vision as an adaptation to frugivory in primates , 1996, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[23]  Aapo Hyvärinen,et al.  A Fast Fixed-Point Algorithm for Independent Component Analysis , 1997, Neural Computation.

[24]  M. Webster,et al.  Adaptation and the color statistics of natural images , 1997, Vision Research.

[25]  D. Chakrabarti,et al.  A fast fixed - point algorithm for independent component analysis , 1997 .

[26]  Javier Hernández-Andrés,et al.  Linear bases for representation of natural and artificial illuminants , 1997 .

[27]  J. Cardoso Infomax and maximum likelihood for blind source separation , 1997, IEEE Signal Processing Letters.

[28]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[29]  Te-Won Lee,et al.  Independent Component Analysis , 1998, Springer US.

[30]  Shun-ichi Amari,et al.  Natural Gradient Works Efficiently in Learning , 1998, Neural Computation.

[31]  T Troscianko,et al.  Color and luminance information in natural scenes. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.

[32]  D. Ruderman,et al.  Statistics of cone responses to natural images: implications for visual coding , 1998 .

[33]  K. Kreutz-Delgado,et al.  Convex/Schur-Convex (CSC) Log-Priors and Sparse Coding , 1999 .

[34]  Terrence J. Sejnowski,et al.  Independent Component Analysis Using an Extended Infomax Algorithm for Mixed Sub-Gaussian and Super-Gaussian Sources , 1999, Neural Comput..

[35]  Terrence J. Sejnowski,et al.  Independent Component Analysis Using an Extended Infomax Algorithm for Mixed Subgaussian and Supergaussian Sources , 1999, Neural Computation.

[36]  Bruno A. Olshausen,et al.  PROBABILISTIC FRAMEWORK FOR THE ADAPTATION AND COMPARISON OF IMAGE CODES , 1999 .

[37]  Jean-Franois Cardoso High-Order Contrasts for Independent Component Analysis , 1999, Neural Computation.

[38]  Terrence J. Sejnowski,et al.  The Spectral Independent Components of Natural Scenes , 2000, Biologically Motivated Computer Vision.

[39]  Terrence J. Sejnowski,et al.  Learning Overcomplete Representations , 2000, Neural Computation.

[40]  T W Cronin,et al.  Color signals in natural scenes: characteristics of reflectance spectra and effects of natural illuminants. , 2000, Journal of the Optical Society of America. A, Optics, image science, and vision.