Visual Development and the Acquisition of Motion Velocity Sensitivities

We consider the hypothesis that systems learning aspects of visual perception may benefit from the use of suitably designed developmental progressions during training. Four models were trained to estimate motion velocities in sequences of visual images. Three of the models were developmental models in the sense that the nature of their visual input changed during the course of training. These models received a relatively impoverished visual input early in training, and the quality of this input improved as training progressed. One model used a coarse-to-multiscale developmental progression (it received coarse-scale motion features early in training and finer-scale features were added to its input as training progressed), another model used a fine-to-multiscale progression, and the third model used a random progression. The final model was nondevelopmental in the sense that the nature of its input remained the same throughout the training period. The simulation results show that the coarse-to-multiscale model performed best. Hypotheses are offered to account for this model's superior performance, and simulation results evaluating these hypotheses are reported. We conclude that suitably designed developmental sequences can be useful to systems learning to estimate motion velocities. The idea that visual development can aid visual learning is a viable hypothesis in need of further study.

[1]  P. Milner A model for visual shape recognition. , 1974, Psychological review.

[2]  Geoffrey E. Hinton Shape Representation in Parallel Systems , 1981, IJCAI.

[3]  G Turkewitz,et al.  Limitations on input as a basis for neural organization and perceptual development: a preliminary theoretical statement. , 1982, Developmental psychobiology.

[4]  A. Norcia,et al.  Spatial frequency sweep VEP: Visual acuity during the first year of life , 1985, Vision Research.

[5]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[6]  William H. Press,et al.  Numerical Recipes in C The Art of Scientific Computing , 1995 .

[7]  Dana H. Ballard,et al.  Cortical connections and parallel processing: Structure and function , 1986, Behavioral and Brain Sciences.

[8]  William H. Press,et al.  Book-Review - Numerical Recipes in Pascal - the Art of Scientific Computing , 1989 .

[9]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[10]  Elissa L. Newport,et al.  Maturational Constraints on Language Learning , 1990, Cogn. Sci..

[11]  Richard K. Belew,et al.  Evolving networks: using the genetic algorithm with connectionist learning , 1990 .

[12]  I. Ohzawa,et al.  Stereoscopic depth discrimination in the visual cortex: neurons ideally suited as disparity detectors. , 1990, Science.

[13]  Elie Bienenstock,et al.  Neural Networks and the Bias/Variance Dilemma , 1992, Neural Computation.

[14]  D. Heeger Normalization of cell responses in cat striate cortex , 1992, Visual Neuroscience.

[15]  Terrence J. Sejnowski,et al.  Filter selection model for motion segmentation and velocity integration , 1994 .

[16]  Michael I. Jordan A statistical approach to decision tree modeling , 1994, COLT '94.

[17]  Michael I. Jordan,et al.  Hierarchical Mixtures of Experts and the EM Algorithm , 1994, Neural Computation.

[18]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[19]  Fengchun Peng,et al.  Bayesian Inference in Mixtures-of-Experts and Hierarchical Mixtures-of-Experts Models With an Applic , 1996 .

[20]  E. Adelson,et al.  Slow and Smooth: A Bayesian theory for the combination of local motion signals in human vision , 1998 .

[21]  Alexander Thiele,et al.  Speed skills: measuring the visual speed analyzing properties of primate MT neurons , 2001, Nature Neuroscience.

[22]  Eero P. Simoncelli,et al.  Representing retinal image speed in visual cortex , 2001, Nature Neuroscience.

[23]  Robert A. Jacobs,et al.  Developmental Constraints Aid the Acquisition of Binocular Disparity Sensitivities , 2003, Neural Computation.

[24]  Robert A. Jacobs,et al.  Does Visual Development Aid Visual Learning , 2004 .