Neural Information Processing in Cognition: We Start to Understand the Orchestra, but Where is the Conductor?

Research in neural information processing has been successful in the past, providing useful approaches both to practical problems in computer science and to computational models in neuroscience. Recent developments in the area of cognitive neuroscience present new challenges for a computational or theoretical understanding asking for neural information processing models that fulfill criteria or constraints from cognitive psychology, neuroscience and computational efficiency. The most important of these criteria for the evaluation of present and future contributions to this new emerging field are listed at the end of this article.

[1]  D. Kahneman Thinking, Fast and Slow , 2011 .

[2]  G. Palm Novelty, Information and Surprise , 2012, Information Science and Statistics.

[3]  Christof Koch,et al.  A test for consciousness. , 2011, Scientific American.

[4]  John E. Laird,et al.  The Soar Cognitive Architecture , 2012 .

[5]  Terrence J. Sejnowski,et al.  The Computational Brain , 1996, Artif. Intell..

[6]  M. Tsodyks,et al.  Working models of working memory , 2014, Current Opinion in Neurobiology.

[7]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[8]  Benjamin Naumann The Architecture Of Cognition , 2016 .

[9]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Richard Reviewer-Granger Unified Theories of Cognition , 1991, Journal of Cognitive Neuroscience.

[11]  John R. Anderson How Can the Human Mind Occur in the Physical Universe , 2007 .

[12]  Charan Ranganath,et al.  Doubts about Double Dissociations between Short-and Long-term Memory , 2022 .

[13]  Shaojuan Zhu,et al.  Simulation of associative neural networks , 2002, Proceedings of the 9th International Conference on Neural Information Processing, 2002. ICONIP '02..

[14]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition , 2012 .

[15]  W. Gerstner,et al.  Synaptic Consolidation: From Synapses to Behavioral Modeling , 2015, The Journal of Neuroscience.

[16]  M. Kiefer,et al.  Flexible establishment of functional brain networks supports attentional modulation of unconscious cognition , 2014, Human brain mapping.

[17]  Friedhelm Schwenker,et al.  Pattern classification and clustering: A review of partially supervised learning approaches , 2014, Pattern Recognit. Lett..

[18]  M. Tomasello,et al.  Does the chimpanzee have a theory of mind? 30 years later , 2008, Trends in Cognitive Sciences.

[19]  Christof Koch,et al.  A Test for Consciousness How will we know when we ’ ve built a sentient computer ? By making it solve a simple puzzle , 2011 .

[20]  A. Baddeley,et al.  Working memory and executive control. , 1996, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[21]  G Tononi,et al.  Integrated information theory of consciousness: an updated account. , 2012, Archives italiennes de biologie.

[22]  Günther Palm,et al.  Modelling of syntactical processing in the cortex , 2007, Biosyst..

[23]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[24]  F. Pulvermüller,et al.  Motor cognition–motor semantics: Action perception theory of cognition and communication , 2014, Neuropsychologia.

[25]  A. Baddeley Working Memory, Thought, and Action , 2007 .

[26]  Gustavo Deco,et al.  Predictive Coding in the Visual Cortex by a Recurrent Network with Gabor Receptive Fields , 2001, Neural Processing Letters.

[27]  Richard P. Cooper,et al.  Modelling high-level cognitive processes , 2002 .

[28]  Tara N. Sainath,et al.  FUNDAMENTAL TECHNOLOGIES IN MODERN SPEECH RECOGNITION Digital Object Identifier 10.1109/MSP.2012.2205597 , 2012 .

[29]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[30]  N. McGlynn Thinking fast and slow. , 2014, Australian veterinary journal.

[31]  M. Arbib Action to language via the mirror neuron system , 2006 .

[32]  J. Barry Richmond,et al.  Neural Coding , 2014, Encyclopedia of Computational Neuroscience.

[33]  Ulrich Rückert,et al.  Mixed Mode VLSI Implementation of a Neural Associative Memory , 1999 .

[34]  Henry Markram,et al.  Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations , 2002, Neural Computation.

[35]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[36]  Geoffrey E. Hinton,et al.  Acoustic Modeling Using Deep Belief Networks , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[37]  A. Borst Seeing smells: imaging olfactory learning in bees , 1999, Nature Neuroscience.

[38]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[39]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[40]  B. Sakmann,et al.  Active propagation of somatic action potentials into neocortical pyramidal cell dendrites , 1994, Nature.

[41]  H. Markram,et al.  Dendritic calcium transients evoked by single back‐propagating action potentials in rat neocortical pyramidal neurons. , 1995, The Journal of physiology.

[42]  B. Baars,et al.  Cognition, Brain, and Consciousness: Introduction to Cognitive Neuroscience , 2007 .

[43]  James G. King,et al.  Reconstruction and Simulation of Neocortical Microcircuitry , 2015, Cell.

[44]  R. Douglas,et al.  A silicon neuron , 1991, Nature.

[45]  J. Cacioppo,et al.  Brain imaging and cognitive neuroscience. Toward strong inference in attributing function to structure. , 1996, The American psychologist.

[46]  J. Ludden,et al.  Principles and Practice , 1998, Community-based Learning and Social Movements.

[47]  Chen Yu,et al.  A multimodal learning interface for grounding spoken language in sensory perceptions , 2003, ICMI '03.

[48]  Günther Palm,et al.  Cell assemblies in the cerebral cortex , 2014, Biological Cybernetics.

[49]  F. H. Adler Cybernetics, or Control and Communication in the Animal and the Machine. , 1949 .

[50]  Moshe Abeles Cell assemblies , 2011, Scholarpedia.

[51]  Sonja Grün,et al.  Analysis of Parallel Spike Trains , 2010 .

[52]  G. Rees The new phrenology: the limits of localizing cognitive processes in the brain , 2002 .

[53]  Günther Palm,et al.  Parallel processing for associative and neuronal networks , 1984, Biological Cybernetics.

[54]  J. Fodor Modularity of mind , 1983 .

[55]  Michael I. Jordan,et al.  The Handbook of Brain Theory and Neural Networks , 2002 .

[56]  W. Singer,et al.  Temporal binding and the neural correlates of sensory awareness , 2001, Trends in Cognitive Sciences.

[57]  A. Krikelis,et al.  Associative processing and processors , 1994, Computer.

[58]  Günther Palm,et al.  Neural associative memories and sparse coding , 2013, Neural Networks.

[59]  Alexander Zien,et al.  Semi-Supervised Learning , 2006 .

[60]  R. Yuste,et al.  The Brain Activity Map Project and the Challenge of Functional Connectomics , 2012, Neuron.

[61]  D. Hubel,et al.  Plasticity of ocular dominance columns in monkey striate cortex. , 1977, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[62]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[63]  Bernard J. Baars,et al.  Cognition, brain, and consciousness , 2007 .

[64]  Harald Haas,et al.  Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication , 2004, Science.

[65]  N. Spruston,et al.  Action potential initiation and backpropagation in neurons of the mammalian CNS , 1997, Trends in Neurosciences.

[66]  M. Kiefer,et al.  Conceptual representations in mind and brain: Theoretical developments, current evidence and future directions , 2012, Cortex.

[67]  H. Markram,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997, Science.

[68]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[69]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[70]  Philipp Koehn,et al.  Cognitive Psychology , 1992, Ageing and Society.

[71]  Günther Palm,et al.  Neural associative memories for the integration of language, vision and action in an autonomous agent , 2009, Neural Networks.

[72]  D. Premack,et al.  Does the chimpanzee have a theory of mind? , 1978, Behavioral and Brain Sciences.

[73]  John R. Anderson,et al.  Human Symbol Manipulation Within an Integrated Cognitive Architecture , 2005, Cogn. Sci..

[74]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[75]  Pieter R Roelfsema,et al.  Subtask sequencing in the primary visual cortex , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[76]  Rajesh P. N. Rao,et al.  Bayesian brain : probabilistic approaches to neural coding , 2006 .

[77]  D.W. Halpin,et al.  Lean construction and simulation , 2002, Proceedings of the Winter Simulation Conference.

[78]  Simon Farrell,et al.  Computational Modeling in Cognition: Principles and Practice , 2010 .

[79]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[80]  Rajesh P. N. Rao,et al.  Probabilistic Models of the Brain: Perception and Neural Function , 2002 .

[81]  Michael X. Cohen,et al.  Inferior Temporal, Prefrontal, and Hippocampal Contributions to Visual Working Memory Maintenance and Associative Memory Retrieval , 2004, The Journal of Neuroscience.

[82]  Xiaojin Zhu,et al.  Semi-Supervised Learning , 2010, Encyclopedia of Machine Learning.

[83]  Carver Mead,et al.  Analog VLSI and neural systems , 1989 .