Ecological expected utility and the mythical neural code

Neural spikes are an evolutionarily ancient innovation that remains nature’s unique mechanism for rapid, long distance information transfer. It is now known that neural spikes sub serve a wide variety of functions and essentially all of the basic questions about the communication role of spikes have been answered. Current efforts focus on the neural communication of probabilities and utility values involved in decision making. Significant progress is being made, but many framing issues remain. One basic problem is that the metaphor of a neural code suggests a communication network rather than a recurrent computational system like the real brain. We propose studying the various manifestations of neural spike signaling as adaptations that optimize a utility function called ecological expected utility.

[1]  R. Quiroga,et al.  Human single-neuron responses at the threshold of conscious recognition , 2008, Proceedings of the National Academy of Sciences.

[2]  D. Bradley,et al.  Neural population code for fine perceptual decisions in area MT , 2005, Nature Neuroscience.

[3]  Angela J. Yu,et al.  Uncertainty, Neuromodulation, and Attention , 2005, Neuron.

[4]  Timothy E. J. Behrens,et al.  Learning the value of information in an uncertain world , 2007, Nature Neuroscience.

[5]  K. Doya,et al.  Understanding Neural Coding through the Model-Based Analysis of Decision Making , 2007, The Journal of Neuroscience.

[6]  K.,et al.  Evidence for Multiple Stages in the Processing of Ambiguous Words in Syntactic Contexts , 2004 .

[7]  S. Laughlin,et al.  An Energy Budget for Signaling in the Grey Matter of the Brain , 2001, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[8]  R. Poldrack,et al.  Prospect theory on the brain? Toward a cognitive neuroscience of decision under risk. , 2005, Brain research. Cognitive brain research.

[9]  Dorian Aur,et al.  Reading the Neural Code: What do Spikes Mean for Behavior? , 2007 .

[10]  C. Gross Genealogy of the “Grandmother Cell” , 2002, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[11]  Alexandre Pouget,et al.  Probabilistic Interpretation of Population Codes , 1996, Neural Computation.

[12]  H. C. LONGUET-HIGGINS,et al.  Non-Holographic Associative Memory , 1969, Nature.

[13]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[14]  Chun-I Yeh,et al.  Temporal precision in the neural code and the timescales of natural vision , 2007, Nature.

[15]  A V Herz,et al.  Neural codes: firing rates and beyond. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[16]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[17]  Jeffrey S Bowers,et al.  On the biological plausibility of grandmother cells: implications for neural network theories in psychology and neuroscience. , 2009, Psychological review.

[18]  J. Gold,et al.  Neural computations that underlie decisions about sensory stimuli , 2001, Trends in Cognitive Sciences.

[19]  R. Poldrack,et al.  Prospect Theory and the Brain , 2009 .

[20]  Karl J. Friston,et al.  Encoding of Marginal Utility across Time in the Human Brain , 2009, The Journal of Neuroscience.

[21]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[22]  Daeyeol Lee,et al.  Mechanisms for Stochastic Decision Making in the Primate Frontal Cortex , 2009 .

[23]  R. Reid,et al.  Efficacy of Retinal Spikes in Driving Cortical Responses , 2003, The Journal of Neuroscience.

[24]  John P. Miller,et al.  Temporal encoding in nervous systems: A rigorous definition , 1995, Journal of Computational Neuroscience.

[25]  Antonio Torralba,et al.  Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. , 2006, Psychological review.

[26]  Naftali Tishby,et al.  The minimum information principle and its application to neural code analysis , 2009, Proceedings of the National Academy of Sciences.

[27]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[28]  P. Dayan,et al.  Space and time in visual context , 2007, Nature Reviews Neuroscience.

[29]  P. Katz,et al.  Evolution and development of neural circuits in invertebrates , 2007, Current Opinion in Neurobiology.

[30]  P. Glimcher Choice: Towards a Standard Back-pocket Model , 2009 .

[31]  Jerome A. Feldman,et al.  Decision Theory and Artificial Intelligence II: The Hungry Monkey , 1977, Cogn. Sci..

[32]  Michael N. Shadlen,et al.  Synchrony Unbound A Critical Evaluation of the Temporal Binding Hypothesis , 1999, Neuron.

[33]  Colin Camerer,et al.  Neuroeconomics: decision making and the brain , 2008 .

[34]  J L Gallant,et al.  Sparse coding and decorrelation in primary visual cortex during natural vision. , 2000, Science.

[35]  Donal G Sinex,et al.  Immediate changes in tuning of inferior colliculus neurons following acute lesions of cat spiral ganglion. , 2002, Journal of neurophysiology.

[36]  James W Bisley,et al.  Neural correlates of attention and distractibility in the lateral intraparietal area. , 2006, Journal of neurophysiology.

[37]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[38]  A. L. I︠A︡rbus Eye Movements and Vision , 1967 .

[39]  A. Pouget,et al.  Reading population codes: a neural implementation of ideal observers , 1999, Nature Neuroscience.

[40]  Lokendra Shastri,et al.  A computational model of episodic memory formation in the hippocampal system , 2001, Neurocomputing.

[41]  T. Sejnowski,et al.  Regulation of spike timing in visual cortical circuits , 2008, Nature Reviews Neuroscience.

[42]  I. Erev,et al.  Perceptual accuracy and conflicting effects of certainty on risk-taking behaviour , 2008, Nature.

[43]  D. Kramer Foraging Behavior , 2022 .

[44]  Anthony J. Movshon,et al.  Optimal representation of sensory information by neural populations , 2006, Nature Neuroscience.

[45]  Jerome A. Feldman,et al.  A (Somewhat) New Solution to the Variable Binding Problem , 2008, Neural Computation.

[46]  P. Ruby,et al.  What is self-specific? Theoretical investigation and critical review of neuroimaging results. , 2009, Psychological review.

[47]  E. Izhikevich Solving the distal reward problem through linkage of STDP and dopamine signaling , 2007, BMC Neuroscience.

[48]  Guillaume A. Rousselet,et al.  Limits of Event-related Potential Differences in Tracking Object Processing Speed , 2007, Journal of Cognitive Neuroscience.

[49]  Tim Gollisch,et al.  Throwing a glance at the neural code: Rapid information transmission in the visual system , 2009, HFSP journal.

[50]  Timothy D. Hanks,et al.  Probabilistic Population Codes for Bayesian Decision Making , 2008, Neuron.

[51]  Eero P. Simoncelli,et al.  Spatio-temporal correlations and visual signalling in a complete neuronal population , 2008, Nature.

[52]  Wulfram Gerstner,et al.  Spiking Neuron Models: Single Neurons, Populations, Plasticity , 2002 .

[53]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[54]  W. Newsome,et al.  The Trouble with Choice: Studying Decision Variables in the Brain , 2009 .

[55]  Jerome A. Feldman,et al.  Computational constraints on higher neural representations , 1993 .

[56]  Valentin Dragoi,et al.  Adaptive coding of visual information in neural populations , 2008, Nature.

[57]  Krista A. Ehinger,et al.  Modelling search for people in 900 scenes: A combined source model of eye guidance , 2009 .

[58]  J. Eggermont Between sound and perception: reviewing the search for a neural code , 2001, Hearing Research.

[59]  Karl J. Friston,et al.  Integrated Bayesian models of learning and decision making for saccadic eye movements☆ , 2008, Neural Networks.

[60]  H Barlow,et al.  Redundancy reduction revisited , 2001, Network.

[61]  P. Lennie The Cost of Cortical Computation , 2003, Current Biology.

[62]  Simon J. Thorpe,et al.  Ultra-rapid object detection with saccadic eye movements: Visual processing speed revisited , 2006, Vision Research.

[63]  K. Miller,et al.  One-Dimensional Dynamics of Attention and Decision Making in LIP , 2008, Neuron.

[64]  C. Koch,et al.  Sparse but not ‘Grandmother-cell’ coding in the medial temporal lobe , 2008, Trends in Cognitive Sciences.

[65]  Alex M. Andrew Spiking Neuron Models: Single Neurons, Populations, Plasticity , 2003 .

[66]  John W. Clark,et al.  Neural Representation of Probabilistic Information , 2001, Neural Computation.

[67]  Vanessa A. Bender,et al.  Two Coincidence Detectors for Spike Timing-Dependent Plasticity in Somatosensory Cortex , 2006, The Journal of Neuroscience.

[68]  A. Zador,et al.  Neural representation and the cortical code. , 2000, Annual review of neuroscience.

[69]  L F Abbott,et al.  Decoding neuronal firing and modelling neural networks , 1994, Quarterly Reviews of Biophysics.

[70]  James H. Fowler,et al.  On the Evolutionary Origin of Prospect Theory Preferences , 2008, The Journal of Politics.

[71]  Wei Ji Ma,et al.  Bayesian inference with probabilistic population codes , 2006, Nature Neuroscience.

[72]  Thomas Serre,et al.  A feedforward architecture accounts for rapid categorization , 2007, Proceedings of the National Academy of Sciences.

[73]  M Concetta Morrone,et al.  Neural mechanisms for timing visual events are spatially selective in real-world coordinates , 2007, Nature Neuroscience.

[74]  R. Zemel,et al.  Inference and computation with population codes. , 2003, Annual review of neuroscience.

[75]  D. Kahneman Maps of Bounded Rationality: Psychology for Behavioral Economics , 2003 .

[76]  Gabriel Kreiman,et al.  Neural coding: computational and biophysical perspectives , 2004, Physics of Life Reviews.

[77]  Sebastian Thrun,et al.  Anytime search in dynamic graphs , 2008, Artif. Intell..

[78]  Jerome A. Feldman,et al.  From Molecule to Metaphor - A Neural Theory of Language , 2006 .

[79]  C E Carr,et al.  Processing of temporal information in the brain. , 1993, Annual review of neuroscience.

[80]  P. Glimcher,et al.  Neuroeconomics: The Consilience of Brain and Decision , 2004, Science.

[81]  Robert W Meech,et al.  Evolution of excitability in lower metazoans , 2007 .

[82]  A. Rustichini Neuroeconomics: Formal models of decision making and cognitive neuroscience , 2008 .

[83]  Karl J. Friston,et al.  A Hierarchy of Time-Scales and the Brain , 2008, PLoS Comput. Biol..

[84]  C. Padoa-Schioppa,et al.  Neuronal Representations of Value , 2009 .

[85]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[86]  F. Dodge,et al.  Deciphering a neural code for vision. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[87]  Sophie Denève,et al.  Bayesian Spiking Neurons I: Inference , 2008, Neural Computation.

[88]  Angela J. Yu,et al.  Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[89]  Richard G. Baraniuk,et al.  Sparse Coding via Thresholding and Local Competition in Neural Circuits , 2008, Neural Computation.

[90]  Philip L. Smith,et al.  A comparison of sequential sampling models for two-choice reaction time. , 2004, Psychological review.

[91]  L. Pinneo On noise in the nervous system. , 1966, Psychological review.