Seeing White: Qualia in the Context of Decoding Population Codes

When the nervous system is presented with multiple simultaneous inputs of some variable, such as wavelength or disparity, they can be combined to give rise to qualitatively new percepts that cannot be produced by any single input value. For example, there is no single wavelength that appears white. Many models of decoding neural population codes have problems handling multiple inputs, either attempting to extract a single value of the input parameter or, in some cases, registering the presence of multiple inputs without synthesizing them into something new. These examples raise a more general issue regarding the interpretation of population codes. We propose that population decoding involves not the extraction of specific values of the physical inputs, but rather a transformation from the input space to some abstract representational space that is not simply related to physical parameters. As a specific example, a four-layer network is presented that implements a transformation from wavelength to a high-level hue-saturation color space.

[1]  H Sompolinsky,et al.  Simple models for reading neuronal population codes. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[2]  L F Abbott,et al.  Transfer of coded information from sensory to motor networks , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[3]  S Yamane,et al.  Color selectivity of neurons in the inferior temporal cortex of the awake macaque monkey , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[4]  H. Komatsu Mechanisms of central color vision , 1998, Current Opinion in Neurobiology.

[5]  Herman P. Snippe,et al.  Parameter Extraction from Population Codes: A Critical Assessment , 1996, Neural Computation.

[6]  T. Lamb,et al.  Photoreceptor spectral sensitivities: Common shape in the long-wavelength region , 1995, Vision Research.

[7]  T. Sejnowski,et al.  A critique of pure vision , 1993 .

[8]  R. Desimone,et al.  Spectral properties of V4 neurons in the macaque , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  B L McNaughton,et al.  Interpreting neuronal population activity by reconstruction: unified framework with application to hippocampal place cells. , 1998, Journal of neurophysiology.

[10]  W. D. Wright Physiological Optics , 1958, Nature.

[11]  Joel L. Davis,et al.  Large-Scale Neuronal Theories of the Brain , 1994 .

[12]  Gunther Wyszecki,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulae, 2nd Edition , 2000 .

[13]  E. Adelson,et al.  Phenomenal coherence of moving visual patterns , 1982, Nature.

[14]  Thomas D. Albright,et al.  Neural correlates of perceptual motion coherence , 1992, Nature.

[15]  R. M. Boynton Human color vision , 1979 .

[16]  D. Macleod,et al.  Color appearance depends on the variance of surround colors , 1997, Current Biology.

[17]  R A Andersen,et al.  Transparent motion perception as detection of unbalanced motion signals. I. Psychophysics , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[18]  T. Poggio,et al.  Synthesizing a color algorithm from examples. , 1988, Science.

[19]  J. Movshon,et al.  A computational analysis of the relationship between neuronal and behavioral responses to visual motion , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[20]  Leif H. Finkel,et al.  Network simulations of retinal and cortical contributions to color constancy , 1995, Vision Research.

[21]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[22]  S. Zeki Colour coding in the cerebral cortex: The responses of wavelength-selective and colour-coded cells in monkey visual cortex to changes in wavelength composition , 1983, Neuroscience.

[23]  Charles H. Anderson,et al.  BASIC ELEMENTS OF BIOLOGICAL COMPUTATIONAL SYSTEMS , 1994 .

[24]  R. L. Valois,et al.  A multi-stage color model , 1993, Vision Research.

[25]  Peter E. Latham,et al.  Statistically Efficient Estimation Using Population Coding , 1998, Neural Computation.

[26]  Alexandre Pouget,et al.  Probabilistic Interpretation of Population Codes , 1996, Neural Computation.

[27]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[28]  Alexandre Pouget,et al.  Connectionist Models of Orientation Identification , 1991 .

[29]  G Buchsbaum,et al.  Optimum probabilistic processing in colour perception. II. Colour vision as template matching , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[30]  S P Wise,et al.  Conditional oculomotor learning: population vectors in the supplementary eye field. , 1997, Journal of neurophysiology.

[31]  J. Cohen,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulas , 1968 .

[32]  T. Sejnowski,et al.  A selection model for motion processing in area MT of primates , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[33]  E. Land Recent advances in retinex theory , 1986, Vision Research.

[34]  Thomas Young,et al.  II. The Bakerian Lecture. On the theory of light and colours , 1802, Philosophical Transactions of the Royal Society of London.

[35]  Qasim Zaidi,et al.  Lateral interactions within color mechanism in simultaneous induced contrast , 1992, Vision Research.

[36]  R A Andersen,et al.  Transparent motion perception as detection of unbalanced motion signals. III. Modeling , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[37]  B L McNaughton,et al.  Dynamics of the hippocampal ensemble code for space. , 1993, Science.

[38]  D. Perrett,et al.  The `Ideal Homunculus': decoding neural population signals , 1998, Trends in Neurosciences.

[39]  T. Sanger,et al.  Probability density estimation for the interpretation of neural population codes. , 1996, Journal of neurophysiology.

[40]  H. Wilson,et al.  Modified line-element theory for spatial-frequency and width discrimination. , 1984, Journal of the Optical Society of America. A, Optics and image science.

[41]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[42]  M. Lucassen,et al.  Color Constancy under Natural and Artificial Illumination , 1996, Vision Research.

[43]  T. Sejnowski,et al.  Neural network model of visual cortex for determining surface curvature from images of shaded surfaces , 1990, Proceedings of the Royal Society of London. B. Biological Sciences.

[44]  M. Young,et al.  Sparse population coding of faces in the inferotemporal cortex. , 1992, Science.

[45]  D. Sparks,et al.  Population coding of saccadic eye movements by neurons in the superior colliculus , 1988, Nature.

[46]  G. Edelman,et al.  A model of color vision based on cortical reentry. , 1996, Cerebral cortex.

[47]  S. Lehky,et al.  Neural model of stereoacuity and depth interpolation based on a distributed representation of stereo disparity [published erratum appears in J Neurosci 1991 Mar;11(3):following Table of Contents] , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[48]  Terrence J. Sejnowski,et al.  Network model of shape-from-shading: neural function arises from both receptive and projective fields , 1988, Nature.