Dynamic properties of neural networks with adapting synapses

Two kinds of dynamic processes take place in neural networks. One involves the change with time of the activity of each neuron. The other involves the change in strength of the connections (synapses) between neurons. When a neural network is learning or developing, both processes simultaneously take place, and their dynamics interact. This interaction is particularly important in feedback networks. A Lyapunov function is developed to help understand the combined activity and synapse dynamics for a class of such adaptive networks. The methods and viewpoint are illustrated by using them to describe the development of columnar structure of orientation-selective cells in primary visual cortex. Within this model, the columnar structure originates from symmetry breaking in feedback pathways within an area of cortex, rather than feedforward pathways between areas.

[1]  F. Attneave,et al.  The Organization of Behavior: A Neuropsychological Theory , 1949 .

[2]  D. Hubel,et al.  Integrative action in the cat's lateral geniculate body , 1961, The Journal of physiology.

[3]  D. Hubel,et al.  Shape and arrangement of columns in cat's striate cortex , 1963, The Journal of physiology.

[4]  W. Levick,et al.  Sustained and transient neurones in the cat's retina and lateral geniculate nucleus , 1971, The Journal of physiology.

[5]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[6]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[7]  Stephen Grossberg,et al.  Absolute stability of global pattern formation and parallel memory storage by competitive neural networks , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[8]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[9]  P. Lennie,et al.  Spatial frequency analysis in the visual system. , 1985, Annual review of neuroscience.

[10]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[11]  R Linsker,et al.  From basic network principles to neural architecture: emergence of spatial-opponent cells. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[12]  S. Shinomoto Memory maintenance in neural networks , 1987 .

[13]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[14]  Stephen Wiggins Global Bifurcations and Chaos: Analytical Methods , 1988 .

[15]  Stephen Wiggins,et al.  Global Bifurcations and Chaos , 1988 .

[16]  K. Miller,et al.  Ocular dominance column development: analysis and simulation. , 1989, Science.

[17]  G. Blasdel,et al.  Visualization of neuronal activity in monkey striate cortex. , 1989, Annual review of physiology.

[18]  T. Wiesel,et al.  Columnar specificity of intrinsic horizontal and corticocortical connections in cat visual cortex , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[19]  D. Ts'o,et al.  Functional organization of primate visual cortex revealed by high resolution optical imaging. , 1990, Science.

[20]  Dawei W. Dong Dynamic properties of neural networks , 1991 .

[21]  Dawei W. Dong Dynamic properties of neural network with adapting synapses , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.