How brains make chaos in order to make sense of the world

Abstract Recent “connectionist” models provide a new explanatory alternative to the digital computer as a model for brain function. Evidence from our EEG research on the olfactory bulb suggests that the brain may indeed use computational mechanisms like those found in connectionist models. In the present paper we discuss our data and develop a model to describe the neural dynamics responsible for odor recognition and discrimination. The results indicate the existence of sensory- and motor-specific information in the spatial dimension of EEG activity and call for new physiological metaphors and techniques of analysis. Special emphasis is placed in our model on chaotic neural activity. We hypothesize that chaotic behavior serves as the essential ground state for the neural perceptual apparatus, and we propose a mechanism for acquiring new forms of patterned activity corresponding to new learned odors. Finally, some of the implications of our neural model for behavioral theories are briefly discussed. Our research, in concert with the connectionist work, encourages a reevaluation of explanatory models that are based only on the digital computer metaphor.

[1]  Henri Bénard,et al.  Les tourbillons cellulaires dans une nappe liquide. - Méthodes optiques d'observation et d'enregistrement , 1901 .

[2]  W. Smith.  The Integrative Action of the Nervous System , 1907, Nature.

[3]  Lord Rayleigh,et al.  LIX. On convection currents in a horizontal layer of fluid, when the higher temperature is on the under side , 1916 .

[4]  C. Sherrington.  Man On His Nature , 1940 .

[5]  W. H. F. Barnes.  The Nature of Explanation , 1944, Nature.

[6]  J. Brobeck.  The Integrative Action of the Nervous System , 1948, The Yale Journal of Biology and Medicine.

[7]  F. Bremer.  [The physiological basis of the EEG]. , 1949, La Presse medicale.

[8]  R. F. Tredgold,et al.  The Living Brain , 1954, Mental Health.

[9]  B. Katz,et al.  Quantal components of the end‐plate potential , 1954, The Journal of physiology.

[10]  J. Lilly,et al.  Surface movements of click responses from acoustic cerebral cortex of cat: leading and trailing edges of a response figure. , 1954, Journal of neurophysiology.

[11]  J. Lilly,et al.  Surface movements of figures in spontaneous activity of anesthetized cerebral cortex: leading and trailing edges. , 1955, Journal of neurophysiology.

[12]  C. Waddington.  The strategy of the genes , 1957 .

[13]  D. Purpura.  The Mammalian Cerebral Cortex , 1958 .

[14]  S. Counce.  The Strategy of the Genes , 1958, The Yale Journal of Biology and Medicine.

[15]  R. Bickford,et al.  Depth electrographic study of a fast rhythm evoked from the human calcarine region by steady illumination. , 1960, Electroencephalography and clinical neurophysiology.

[16]  Kenneth L. Artis.  Design for a Brain , 1961 .

[17]  Frank Rosenblatt,et al.  PRINCIPLES OF NEURODYNAMICS. PERCEPTRONS AND THE THEORY OF BRAIN MECHANISMS , 1963 .

[18]  E. Lorenz.  Deterministic nonperiodic flow , 1963 .

[19]  B. Mandelbrot,et al.  RANDOM WALK MODELS FOR THE SPIKE ACTIVITY OF A SINGLE NEURON. , 1964, Biophysical journal.

[20]  G. Horridge,et al.  Structure and function in the nervous systems of invertebrates , 1965 .

[21]  G. P. Moore,et al.  Statistical analysis and functional interpretation of neuronal spike data. , 1966, Annual review of physiology.

[22]  G. P. Moore,et al.  Neuronal spike trains and stochastic point processes. I. The single spike train. , 1967, Biophysical journal.

[23]  G. P. Moore,et al.  Neuronal spike trains and stochastic point processes. II. Simultaneous spike trains. , 1967, Biophysical journal.

[24]  P. Frank,et al.  Boston Studies in the Philosophy of Science , 1968 .

[25]  W. Freeman,et al.  Pattern analysis of cortical evoked potential parameters during attention changes , 1969 .

[26]  D. W. Demott,et al.  Toposcopic studies of learning , 1970 .

[27]  Nelson Goodman,et al.  Languages of Art, an Approach to a Theory of Symbols , 1970 .

[28]  N. Goodman,et al.  Languages of Art: An Approach to a Theory of Symbols , 1971 .

[29]  F. Takens,et al.  On the nature of turbulence , 1971 .

[30]  G. Shepherd.  Synaptic organization of the mammalian olfactory bulb. , 1972, Physiological reviews.

[31]  W. Freeman.  Waves, Pulses, and the Theory of Neural Masses , 1972 .

[32]  R. Zucker.  Changes in the statistics of transmitter release during facilitation , 1973, The Journal of physiology.

[33]  T. J. Willey,et al.  The ultrastructure of the cat olfactory bulb , 1973, The Journal of comparative neurology.

[34]  Stochastic models for single neuron firing trains: a survey. , 1974 .

[35]  R. Zucker.  Crayfish neuromuscular facilitation activated by constant presynaptic action potentials and depolarizing pulses , 1974, The Journal of physiology.

[36]  S E Fienberg,et al.  Stochastic models for single neuron firing trains: a survey. , 1974, Biometrics.

[37]  S. Grossberg.  A neural model of attention, reinforcement and discrimination learning. , 1975, International review of neurobiology.

[38]  Donald O. Walter,et al.  Mass action in the nervous system , 1975 .

[39]  R. M. Knights,et al.  The Neuropsychology of learning disorders : theoretical approaches , 1976 .

[40]  D Marr,et al.  Cooperative computation of stereo disparity. , 1976, Science.

[41]  D. G. Moulton,et al.  Spatial patterning of response to odors in the peripheral olfactory system. , 1976, Physiological reviews.

[42]  T. H. Brown,et al.  Evoked neurotransmitter release: statistical effects of nonuniformity and nonstationarity. , 1976, Proceedings of the National Academy of Sciences of the United States of America.

[43]  Robert M. May,et al.  Simple mathematical models with very complicated dynamics , 1976, Nature.

[44]  Stephen A. Ritz,et al.  Distinctive features, categorical perception, and probability learning: some applications of a neural model , 1977 .

[45]  M. N. Livanov.  Spatial organization of cerebral processes , 1977 .

[46]  John Shotter,et al.  Human Action and Its Psychological Investigation , 1977 .

[47]  A. G. Hawkes,et al.  Stochastic Models for Spike Trains of Single Neurons , 1977 .

[48]  W. Freeman.  Spatial properties of an EEG event in the olfactory bulb and cortex. , 1978, Electroencephalography and clinical neurophysiology.

[49]  D. Thomas King,et al.  Mind over Machine. , 1978 .

[50]  G. Pfurtscheller.  Handbook of electroencephalography and clinical neurophysiology , 1978 .

[51]  J. Guckenheimer,et al.  Random evolutionarily stable strategies. , 1978, Theoretical population biology.

[52]  The Neuropsychology of Learning Disorders: Theoretical Approaches , 1978 .

[53]  Stochastic Models for Spike Trains of Single Neurons , 1978 .

[54]  J. Gibson.  The Ecological Approach to Visual Perception , 1979 .

[55]  L. Glass,et al.  PATHOLOGICAL CONDITIONS RESULTING FROM INSTABILITIES IN PHYSIOLOGICAL CONTROL SYSTEMS * , 1979, Annals of the New York Academy of Sciences.

[56]  A. Pellionisz,et al.  Brain modeling by tensor network theory and computer simulation. The cerebellum: Distributed processor for predictive coordination , 1979, Neuroscience.

[57]  A Babloyantz,et al.  Self-organization in biological systems with multiple cellular contacts , 1979, Bulletin of mathematical biology.

[58]  W. Freeman.  Use of Spatial Deconvolution to Compensate for Distortion of EEG by Volume Conduction , 1980, IEEE Transactions on Biomedical Engineering.

[59]  Patricia Smith Churchland,et al.  A Perspective on Mind-Brain Research , 1980 .

[60]  W. Freeman,et al.  Effects of carnosine on olfactory bulb EEG, evoked potentials and DC potentials , 1980, Brain Research.

[61]  A. Winfree.  The geometry of biological time , 1991 .

[62]  John R. Searle,et al.  Minds, brains, and programs , 1980, Behavioral and Brain Sciences.

[63]  S. Grossberg,et al.  How does a brain build a cognitive code? , 1980, Psychological review.

[64]  H. Maturana,et al.  Autopoiesis and Cognition , 1980 .

[65]  S. Grossberg.  How does a brain build a cognitive code , 1980 .

[66]  W. Freeman.  A Physiological Hypothesis of Perception , 2015, Perspectives in biology and medicine.

[67]  H. Swinney,et al.  Alternating periodic and chaotic regimes in a chemical reaction — Experiment and theory , 1981 .

[68]  J. D. Farmer,et al.  ON DETERMINING THE DIMENSION OF CHAOTIC FLOWS , 1981 .

[69]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: I. An account of basic findings. , 1981 .

[70]  Jerome A. Feldman,et al.  Connectionist Models and Their Properties , 1982, Cogn. Sci..

[71]  W. Freeman,et al.  Changes in spatial patterns of rabbit olfactory EEG with conditioning to odors. , 1982, Psychophysiology.

[72]  S. Grossberg.  Mathematical Psychology and Psychophysiology , 1982 .

[73]  J. D. Farmer,et al.  A PHASE SPACE ANALYSIS OF BAROCLINIC FLOW , 1982 .

[74]  S. Grossberg.  Processing of Expected and Unexpected Events During Conditioning and Attention: A Psychophysiological Theory , 1982 .

[75]  J S Kauer,et al.  Mapping of odor-related neuronal activity in the olfactory bulb by high-resolution 2-deoxyglucose autoradiography. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[76]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[77]  S. Grossberg.  Studies of mind and brain : neural principles of learning, perception, development, cognition, and motor control , 1982 .

[78]  Stephen Grossberg,et al.  Absolute stability of global pattern formation and parallel memory storage by competitive neural networks , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[79]  A. Garfinkel.  A mathematics for physiology. , 1983, The American journal of physiology.

[80]  O. Rössler.  The Chaotic Hierarchy , 1983 .

[81]  P. J. Holmes,et al.  Nonlinear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields , 1983, Applied Mathematical Sciences.

[82]  Arnold J. Mandell,et al.  Synergetics of the Brain , 1983 .

[83]  R. Abraham,et al.  Dynamics--the geometry of behavior , 1983 .

[84]  P. Grassberger,et al.  Measuring the Strangeness of Strange Attractors , 1983 .

[85]  J. Fodor.  Modularity of mind , 1983 .

[86]  W. Freeman.  The physiological basis of mental images. , 1983, Biological psychiatry.

[87]  S. Grossberg.  Neural Substrates of Binocular Form Perception: Filtering, Matching, Diffusion, and Resonance , 1983 .

[88]  B. Julesz.  A brief outline of the texton theory of human vision , 1984, Trends in Neurosciences.

[89]  W. Freeman,et al.  Periglomerular cell action on mitral cells in olfactory bulb shown by current source density analysis , 1984, Brain Research.

[90]  Gonzalo Viana Di Prisco,et al.  Hebb synaptic plasticity , 1984, Progress in Neurobiology.

[91]  Zenon W. Pylyshyn,et al.  Computation and Cognition: Toward a Foundation for Cognitive Science , 1984 .

[92]  H. Schuster.  Deterministic chaos: An introduction , 1984 .

[93]  J. Fodor,et al.  The Modularity of Mind: An Essay on Faculty Psychology , 1984 .

[94]  Stephen Wolfram,et al.  Cellular automata as models of complexity , 1984, Nature.

[95]  G Viana Di Prisco.  Hebb synaptic plasticity. , 1984, Progress in neurobiology.

[96]  Robert Shaw,et al.  The Dripping Faucet As A Model Chaotic System , 1984 .

[97]  R. Nicoll,et al.  Comparison of the action of baclofen with gamma‐aminobutyric acid on rat hippocampal pyramidal cells in vitro. , 1985, The Journal of physiology.

[98]  D. Wilson,et al.  Odor familiarity alters mitral cell response in the olfactory bulb of neonatal rats. , 1985, Brain research.

[99]  Matthew Witten,et al.  Modelling of Biomedical Systems , 1985 .

[100]  J. Nicolis.  CHAOTIC DYNAMICS OF INFORMATION PROCESSING WITH RELEVANCE TO COGNITIVE BRAIN FUNCTIONS , 1985 .

[101]  P. Rapp,et al.  Dynamics of spontaneous neural activity in the simian motor cortex: The dimension of chaotic neurons , 1985 .

[102]  A. Babloyantz,et al.  Evidence of Chaotic Dynamics of Brain Activity During the Sleep Cycle , 1985 .

[103]  W. Freeman,et al.  Odor-related bulbar EEG spatial pattern analysis during appetitive conditioning in rabbits. , 1985 .

[104]  Oono,et al.  Discrete model of chemical turbulence. , 1985, Physical review letters.

[105]  J. Rinzel,et al.  Bursting, beating, and chaos in an excitable membrane model. , 1985, Biophysical journal.

[106]  W. Freeman,et al.  Odor-related bulbar EEG spatial pattern analysis during appetitive conditioning in rabbits. , 1985, Behavioral neuroscience.

[107]  G L Shaw,et al.  Model of cortical organization embodying a basis for a theory of information processing and memory recall. , 1985, Proceedings of the National Academy of Sciences of the United States of America.

[108]  I. Tsuda,et al.  Chaotic dynamics of information processing: the "magic number seven plus-minus two" revisited. , 1985, Bulletin of mathematical biology.

[109]  Ichiro Tsuda,et al.  Chaotic dynamics of information processing: The “magic number seven plus-minus two” revisited , 1985 .

[110]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[111]  W. Freeman,et al.  Spatial EEG patterns, non-linear dynamics and perception: the neo-sherringtonian view , 1985, Brain Research Reviews.

[112]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[113]  W. Freeman,et al.  Relation of olfactory EEG to behavior: time series analysis. , 1986, Behavioral neuroscience.

[114]  Gottfried Mayer-Kress,et al.  Dimensions and Entropies in Chaotic Systems , 1986 .

[115]  C. Cohan,et al.  Convergence in a distributed nervous system: parallel processing and self-organization. , 1986, Journal of neurobiology.

[116]  Walter J. Freeman,et al.  Classification of EEG Spatial Patterns with a Tree-Structured Methodology: CART , 1986, IEEE Transactions on Biomedical Engineering.

[117]  James L. McClelland,et al.  James L. McClelland, David Rumelhart and the PDP Research Group, Parallel distributed processing: explorations in the microstructure of cognition . Vol. 1. Foundations . Vol. 2. Psychological and biological models . Cambridge MA: M.I.T. Press, 1987. , 1989, Journal of Child Language.

[118]  J. E. Skinner,et al.  Chemical dependencies of learning in the rabbit olfactory bulb: acquisition of the transient spatial pattern change depends on norepinephrine. , 1986, Behavioral neuroscience.

[119]  S Grossberg,et al.  Neural dynamics of speech and language coding: developmental programs, perceptual grouping, and competition for short-term memory. , 1986, Human neurobiology.

[120]  P. Grassberger.  Do climatic attractors exist? , 1986, Nature.

[121]  J. Hopfield,et al.  Computing with neural circuits: a model. , 1986, Science.

[122]  W. Freeman,et al.  EEG Spatial Pattern Differences with Discriminated Odors Manifest Chaotic and Limit Cycle Attractors in Olfactory Bulb of Rabbits , 1986 .

[123]  S Grossberg,et al.  Neural dynamics of word recognition and recall: attentional priming, learning, and resonance. , 1986, Psychological review.

[124]  B. Baird.  Nonlinear dynamics of pattern formation and pattern recognition in the rabbit olfactory bulb , 1986 .

[125]  H. Dodt,et al.  The role of chloride transport in postsynaptic inhibition of hippocampal neurons. , 1986, Science.

[126]  A. Babloyantz,et al.  Low-dimensional chaos in an instance of epilepsy. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[127]  Christine A. Skarda.  Explaining behavior: Bringing the brain back in , 1986 .

[128]  Walter J. Freeman,et al.  Petit mal seizure spikes in olfactory bulb and cortex caused by runaway inhibition after exhaustion of excitation , 1986, Brain Research Reviews.

[129]  S. Grossberg,et al.  Neural dynamics of word recognition and recall: attentional priming, learning, and resonance. , 1986 .

[130]  G. Oster,et al.  A MODEL FOR SHELL PATTERNS BASED ON NEURAL ACTIVITY , 1986 .

[131]  J. Fodor.  The Modularity of mind. An essay on faculty psychology , 1986 .

[132]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[133]  W J Freeman,et al.  Relation of olfactory EEG to behavior: factor analysis. , 1987, Behavioral neuroscience.

[134]  Steven L. Bressler,et al.  Relation of olfactory bulb and cortex. II. Model for driving of cortex by bulb , 1987, Brain Research.

[135]  W. Freeman,et al.  Spatial patterns of visual cortical fast EEG during conditioned reflex in a rhesus monkey , 1987, Brain Research.

[136]  S. Grossberg,et al.  Neural dynamics of attentionally modulated Pavlovian conditioning: blocking, interstimulus interval, and secondary reinforcement. , 1987, Applied optics.

[137]  Steven L. Bressler.  Relation of olfactory bulb and cortex. I. Spatial variation of bulbocortical interdependence , 1987, Brain Research.

[138]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[139]  Stephen Grossberg,et al.  Neural dynamics of speech and language coding: developmental programs, perceptual grouping, and competition for short-term memory. , 1986, Human neurobiology.

[140]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[141]  Geoffrey Hunter.  What Computers Can't Do , 1988, Philosophy.

[142]  Jerome A. Feldman,et al.  Connectionist Models and Their Properties , 1982, Cogn. Sci..

[143]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: part 1.: an account of basic findings , 1988 .

[144]  W. Freeman.  Dynamics of Image Formation by Nerve Cell Assemblies , 1988, Advances in Cognitive Science.

[145]  E. Reed.  The Ecological Approach to Visual Perception , 1989 .

[146]  Jean,et al.  The Computer and the Brain , 1989, Annals of the History of Computing.

[147]  Geoffrey E. Hinton,et al.  Parallel Models of Associative Memory , 1989 .