Adaptation and Unsupervised Learning

Adaptation is a ubiquitous neural and psychological phenomenon, with a wealth of instantiations and implications. Although a basic form of plasticity, it has, bar some notable exceptions, attracted computational theory of only one main variety. In this paper, we study adaptation from the perspective of factor analysis, a paradigmatic technique of unsupervised learning. We use factor analysis to re-interpret a standard view of adaptation, and apply our new model to some recent data on adaptation in the domain of face discrimination.

[1]  J. Gibson,et al.  Adaptation, after-effect and contrast in the perception of tilted lines. I. Quantitative studies , 1937 .

[2]  F. Attneave.  Some informational aspects of visual perception. , 1954, Psychological review.

[3]  K. Jöreskog.  Some contributions to maximum likelihood factor analysis , 1967 .

[4]  K. Jöreskog.  A general approach to confirmatory maximum likelihood factor analysis , 1969 .

[5]  H B Barlow,et al.  PATTERN RECOGNITION AND THE RESPONSES OF SENSORY NEURONS * , 1969, Annals of the New York Academy of Sciences.

[6]  F. Campbell,et al.  The tilt after-effect: a fresh look. , 1971, Vision research.

[7]  W. Precht.  The synaptic organization of the brain G.M. Shepherd, Oxford University Press (1975). 364 pp., £3.80 (paperback) , 1976, Neuroscience.

[8]  G. Shepherd.  The Synaptic Organization of the Brain , 1979 .

[9]  Dorothy T. Thayer,et al.  EM algorithms for ML factor analysis , 1982 .

[10]  Brian Everitt,et al.  An Introduction to Latent Variable Models , 1984 .

[11]  R. Weiler,et al.  Light-dependent change of cone-horizontal cell interactions in carp retina , 1984, Brain Research.

[12]  C. Enroth-Cugell,et al.  Chapter 9 Visual adaptation and retinal gain controls , 1984 .

[13]  D. Regan,et al.  Postadaptation orientation discrimination. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[14]  Ian T. Jolliffe,et al.  Principal Component Analysis , 1986, Springer Series in Statistics.

[15]  Ralph Linsker,et al.  Self-organization in a perceptual network , 1988, Computer.

[16]  H. B. Barlow,et al.  Unsupervised Learning , 1989, Neural Computation.

[17]  Joseph J. Atick,et al.  Towards a Theory of Early Visual Processing , 1990, Neural Computation.

[18]  D. Heeger.  Normalization of cell responses in cat striate cortex , 1992, Visual Neuroscience.

[19]  William Bialek,et al.  Statistics of Natural Images: Scaling in the Woods , 1993, NIPS.

[20]  F. Ebner,et al.  Laminar comparison of somatosensory cortical plasticity. , 1994, Science.

[21]  Zhaoping Li,et al.  Efficient stereo coding in the multiscale representation , 1994 .

[22]  D. Hamasaki,et al.  The retinal dopamine network alters the adaptational properties of retinal ganglion cells in the cat. , 1994, Journal of neurophysiology.

[23]  Geoffrey E. Hinton,et al.  The "wake-sleep" algorithm for unsupervised neural networks. , 1995, Science.

[24]  J. Atick,et al.  Temporal decorrelation: a theory of lagged and nonlagged responses in the lateral geniculate nucleus , 1995 .

[25]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[26]  Peter Dayan,et al.  Factor Analysis Using Delta-Rule Wake-Sleep Learning , 1997, Neural Computation.

[27]  L. Abbott,et al.  Synaptic Depression and Cortical Gain Control , 1997, Science.

[28]  Rajesh P. N. Rao,et al.  Dynamic Model of Visual Recognition Predicts Neural Response Properties in the Visual Cortex , 1997, Neural Computation.

[29]  Christopher M. Bishop,et al.  Mixtures of Probabilistic Principal Component Analyzers , 1999, Neural Computation.

[30]  Zoubin Ghahramani,et al.  A Unifying Review of Linear Gaussian Models , 1999, Neural Computation.

[31]  Martin J. Wainwright,et al.  Visual adaptation as optimal information transmission , 1999, Vision Research.

[32]  Terrence J. Sejnowski,et al.  Unsupervised Learning , 2018, Encyclopedia of GIS.

[33]  C. Clifford,et al.  A functional angle on some after-effects in cortical vision , 2000, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[34]  A. O'Toole,et al.  Prototype-referenced shape encoding revealed by high-level aftereffects , 2001, Nature Neuroscience.

[35]  Eero P. Simoncelli,et al.  Natural signal statistics and sensory gain control , 2001, Nature Neuroscience.

[36]  H Barlow,et al.  Redundancy reduction revisited , 2001, Network.

[37]  I. Jolliffe.  Principal Component Analysis , 2002 .

[38]  Bruno A. Olshausen,et al.  Book Review , 2003, Journal of Cognitive Neuroscience.

[39]  D. McCormick.  Membrane Properties and Neurotransmitter Actions , 2004 .

[40]  J. H. van Hateren,et al.  A theory of maximizing sensory information , 2004, Biological Cybernetics.

[41]  E. Oja,et al.  Fast adaptive formation of orthogonalizing filters and associative memory in recurrent networks of neuron-like elements , 1976, Biological Cybernetics.