Does Nonlinear Neural Network Dynamics Explain Human Confidence in a Sequence of Perceptual Decisions ?

Electrophysiological recordings during perceptual decision tasks in monkeys suggest that the degree of confidence in a decision is based on a simple neural signal produced by the neural decision process. Attractor neural networks provide an appropriate biophysical modeling framework, and account for the experimental results very well. However, it remains unclear whether attractor neural networks can account for confidence reports in humans. We present the results from an experiment in which participants are asked to perform an orientation discrimination task, followed by a confidence judgment. Here we show that an attractor neural network model quantitatively reproduces, for each participant, the relations between accuracy, response times and confidence. We show that the attractor neural network also accounts for confidence-specific sequential effects observed in the experiment (participants are faster on trials following high confidence trials). Remarkably, this is obtained as an inevitable outcome of the network dynamics, without any feedback specific to the previous decision (that would result in, e.g., a change in the model parameters before the onset of the next trial). Our results thus suggest that a metacognitive process such as confidence in one’s decision is linked to the intrinsically nonlinear dynamics of the decision-making neural network.

[1]  M. Shadlen,et al.  Choice Certainty Is Informed by Both Evidence and Decision Time , 2014, Neuron.

[2]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[3]  Jonathan D. Cohen,et al.  The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. , 2006, Psychological review.

[4]  Xiao-Jing Wang Decision Making in Recurrent Neuronal Circuits , 2008, Neuron.

[5]  E. Rolls,et al.  Decision-making, errors, and confidence in the brain. , 2010, Journal of neurophysiology.

[6]  Joshua I. Sanders,et al.  Signatures of a Statistical Computation in the Human Sense of Confidence , 2016, Neuron.

[7]  J. Nadal,et al.  Perceptual Decision-Making: Biases in Post-Error Reaction Times Explained by Attractor Network Dynamics , 2018, The Journal of Neuroscience.

[8]  Wei Ji Ma,et al.  Comparing Bayesian and non-Bayesian accounts of human confidence reports , 2018, PLoS Comput. Biol..

[9]  Roger Ratcliff,et al.  Parameter variability and distributional assumptions in the diffusion model. , 2013, Psychological review.

[10]  Geraint Rees,et al.  Relating Introspective Accuracy to Individual Differences in Brain Structure , 2010, Science.

[11]  Rubén Moreno-Bote,et al.  Decision Confidence and Uncertainty in Diffusion Models with Partially Correlated Neuronal Integrators , 2010, Neural Computation.

[12]  Timothy J. Pleskac,et al.  Two-stage dynamic signal detection: a theory of choice, decision time, and confidence. , 2010, Psychological review.

[13]  S. Bestmann,et al.  Response repetition biases in human perceptual decisions are explained by activity decay in competitive attractor models , 2016, eLife.

[14]  Adam Kepecs,et al.  A computational framework for the study of confidence in humans and animals , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[15]  J. Macke,et al.  Quantifying the effect of intertrial dependence on perceptual decisions. , 2014, Journal of vision.

[16]  J. Baranski,et al.  The calibration and resolution of confidence in perceptual judgments , 1994, Perception & psychophysics.

[17]  Scott D. Brown,et al.  The simplest complete model of choice response time: Linear ballistic accumulation , 2008, Cognitive Psychology.

[18]  Asher Koriat,et al.  The self-consistency model of subjective confidence. , 2012, Psychological review.

[19]  Timothy D. Hanks,et al.  Probabilistic Population Codes for Bayesian Decision Making , 2008, Neuron.

[20]  D Vickers,et al.  Effects of alternating set for speed or accuracy on response time, accuracy and confidence in a unidimensional discrimination task. , 1982, Acta psychologica.

[21]  F. Tuerlinckx,et al.  Factoring out nondecision time in choice reaction time data: Theory and implications. , 2016, Psychological review.

[22]  Xiao-Jing Wang,et al.  Engagement of Pulvino-cortical Feedforward and Feedback Pathways in Cognitive Computations , 2018, Neuron.

[23]  Jeffrey N. Rouder,et al.  Modeling Response Times for Two-Choice Decisions , 1998 .

[24]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[25]  D. Vickers Decision processes in visual perception , 1979 .

[26]  R. Duncan Luce,et al.  Response Times: Their Role in Inferring Elementary Mental Organization , 1986 .

[27]  Pratibha Mishra,et al.  Advanced Engineering Mathematics , 2013 .

[28]  Mario Pannunzi,et al.  Multiple Choice Neurodynamical Model of the Uncertain Option Task , 2017, PLoS Comput. Biol..

[29]  Florent Meyniel,et al.  The Sense of Confidence during Probabilistic Learning: A Normative Account , 2015, PLoS Comput. Biol..

[30]  Edgar C Merkle,et al.  An application of the poisson race model to confidence calibration. , 2006, Journal of experimental psychology. General.

[31]  H. Akaike,et al.  Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .

[32]  Anne E. Urai,et al.  Pupil-linked arousal is driven by decision uncertainty and alters serial choice bias , 2017, Nature Communications.

[33]  Christopher Summerfield,et al.  Metacognition in human decision-making: confidence and error monitoring , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[34]  Gustavo Deco,et al.  Confidence through consensus: a neural mechanism for uncertainty monitoring , 2016, Scientific Reports.

[35]  Paul Miller,et al.  Accuracy and response-time distributions for decision-making: linear perfect integrators versus nonlinear attractor-based neural circuits , 2013, Journal of Computational Neuroscience.

[36]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[37]  Frances S. Chance,et al.  Drivers and modulators from push-pull and balanced synaptic input. , 2005, Progress in brain research.

[38]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[39]  D. Raab DIVISION OF PSYCHOLOGY: STATISTICAL FACILITATION OF SIMPLE REACTION TIMES* , 1962 .

[40]  J. Ditterich Evidence for time‐variant decision making , 2006, The European journal of neuroscience.

[41]  B. Postle,et al.  Confidence boosts serial dependence in orientation estimation , 2018, bioRxiv.

[42]  Xiao-Jing Wang,et al.  Probabilistic Decision Making by Slow Reverberation in Cortical Circuits , 2002, Neuron.

[43]  Jillian H. Fecteau,et al.  Exploring the consequences of the previous trial , 2003, Nature Reviews Neuroscience.

[44]  M. Fay,et al.  Wilcoxon-Mann-Whitney or t-test? On assumptions for hypothesis tests and multiple interpretations of decision rules. , 2010, Statistics surveys.

[45]  A. Pouget,et al.  The Cost of Accumulating Evidence in Perceptual Decision Making , 2012, The Journal of Neuroscience.

[46]  Susan J. Galvin,et al.  Type 2 tasks in the theory of signal detectability: Discrimination between correct and incorrect decisions , 2003, Psychonomic bulletin & review.

[47]  D. Laming Choice reaction performance following an error , 1979 .

[48]  Edward L. Ionides,et al.  Monte Carlo profile confidence intervals , 2016 .

[49]  S. Fernberger Interdependence of judgments within the series for the method of constant stimuli. , 1920 .

[50]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[51]  D. Whitney,et al.  Serial Dependence in the Perception of Faces , 2014, Current Biology.

[52]  J. Jastrow,et al.  On small differences in sensation , 1884 .

[53]  R. Ratcliff,et al.  Modeling confidence and response time in recognition memory. , 2009, Psychological review.

[54]  Xiao-Jing Wang,et al.  A Recurrent Network Mechanism of Time Integration in Perceptual Decisions , 2006, The Journal of Neuroscience.

[55]  David J. Freedman,et al.  Choice-correlated activity fluctuations underlie learning of neuronal category representation , 2015, Nature Communications.

[56]  R. Wurtz,et al.  Visual Perception and Corollary Discharge , 2008, Perception.

[57]  Alexandre Pouget,et al.  Relation between Belief and Performance in Perceptual Decision Making , 2014, PloS one.

[58]  Gustavo Deco,et al.  Choice, difficulty, and confidence in the brain , 2010, NeuroImage.

[59]  M. Sommer,et al.  Frontal Eye Field Neurons with Spatial Representations Predicted by Their Subcortical Input , 2009, The Journal of Neuroscience.

[60]  Tom Verguts,et al.  A Postdecisional Neural Marker of Confidence Predicts Information-Seeking in Decision-Making , 2018, The Journal of Neuroscience.

[61]  Roozbeh Kiani,et al.  Neural Mechanisms of Post-error Adjustments of Decision Policy in Parietal Cortex , 2016, Neuron.

[62]  R. Gregory The Most Expensive Painting in the World , 2007, Perception.

[63]  M. Botvinick,et al.  Conflict monitoring and cognitive control. , 2001, Psychological review.

[64]  D. Vickers,et al.  Evidence for an accumulator model of psychophysical discrimination. , 1970, Ergonomics.

[65]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[66]  KongFatt Wong-Lin,et al.  Sequential Effects in Two-Choice Reaction Time Tasks: Decomposition and Synthesis of Mechanisms , 2009, Neural Computation.

[67]  A. Seth Post-decision wagering measures metacognitive content, not sensory consciousness , 2008, Consciousness and Cognition.

[68]  Philip L. Smith,et al.  The accumulator model of two-choice discrimination , 1988 .

[69]  Hatim A. Zariwala,et al.  Neural correlates, computation and behavioural impact of decision confidence , 2008, Nature.

[70]  Jonathan D. Cohen,et al.  Sequential effects: Superstition or rational behavior? , 2008, NIPS.

[71]  David A. Leopold,et al.  Stable perception of visually ambiguous patterns , 2002, Nature Neuroscience.

[72]  Anders Ledberg,et al.  Neurobiological Models of Two-Choice Decision Making Can Be Reduced to a One-Dimensional Nonlinear Diffusion Equation , 2008, PLoS Comput. Biol..

[73]  Alan Edelman,et al.  Julia: A Fresh Approach to Numerical Computing , 2014, SIAM Rev..

[74]  M. Sigman,et al.  Confidence as Bayesian Probability: From Neural Origins to Behavior , 2015, Neuron.

[75]  Rafal Bogacz,et al.  Parameterization of connectionist models , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[76]  Tom Verguts,et al.  Post-decisional sense of confidence shapes speed-accuracy tradeoff for subsequent choices , 2018, bioRxiv.

[77]  M. Shadlen,et al.  A role for neural integrators in perceptual decision making. , 2003, Cerebral cortex.

[78]  Ariel Zylberberg,et al.  The construction of confidence in a perceptual decision , 2012, Front. Integr. Neurosci..

[79]  Tatiana A. Engel,et al.  Same or Different? A Neural Circuit Mechanism of Similarity-Based Pattern Match Decision Making , 2011, The Journal of Neuroscience.

[80]  P. Goldman-Rakic,et al.  Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model. , 2000, Cerebral cortex.

[81]  J. Gold,et al.  Neural correlates of perceptual decision making before, during, and after decision commitment in monkey frontal eye field. , 2012, Cerebral cortex.

[82]  E S Geller,et al.  Confidence ill stimulus predictions and choice reaction time , 1973, Memory & cognition.

[83]  C. Law,et al.  The relative influences of priors and sensory evidence on an oculomotor decision variable during perceptual learning. , 2008, Journal of neurophysiology.

[84]  Jonathan D. Cohen,et al.  Mechanisms underlying dependencies of performance on stimulus history in a two-alternative forced-choice task , 2002, Cognitive, affective & behavioral neuroscience.

[85]  A. Tversky,et al.  The weighing of evidence and the determinants of confidence , 1992, Cognitive Psychology.

[86]  D. Whitney,et al.  Serial dependence in visual perception , 2011, Nature Neuroscience.

[87]  KongFatt Wong-Lin,et al.  Neural Circuit Dynamics Underlying Accumulation of Time-Varying Evidence During Perceptual Decision Making , 2007, Frontiers Comput. Neurosci..

[88]  M. Shadlen,et al.  Representation of Confidence Associated with a Decision by Neurons in the Parietal Cortex , 2009, Science.

[89]  Kobe Desender,et al.  Confidence predicts speed-accuracy tradeoff for subsequent decisions , 2019 .

[90]  E. Grushka Characterization of exponentially modified Gaussian peaks in chromatography. , 1972, Analytical chemistry.

[91]  Yutaka Komura,et al.  Responses of pulvinar neurons reflect a subject's confidence in visual categorization , 2013, Nature Neuroscience.

[92]  Joseph W Kable,et al.  Normative evidence accumulation in unpredictable environments , 2015, eLife.

[93]  Xiao-Jing Wang,et al.  Confidence estimation as a stochastic process in a neurodynamical system of decision making. , 2015, Journal of neurophysiology.

[94]  E. Rolls,et al.  Brain mechanisms for perceptual and reward-related decision-making , 2013, Progress in Neurobiology.

[95]  Sébastien Massoni,et al.  Emotion as a boost to metacognition: How worry enhances the quality of confidence , 2014, Consciousness and Cognition.

[96]  John-Dylan Haynes,et al.  The Relationship between Perceptual Decision Variables and Confidence in the Human Brain. , 2016, Cerebral cortex.

[97]  T. Birdsall,et al.  Two Types of ROC Curves and Definitions of Parameters , 1959 .

[98]  A. Koulakov,et al.  Orbitofrontal Cortex Is Required for Optimal Waiting Based on Decision Confidence , 2014, Neuron.

[99]  Tobias H. Donner,et al.  Adaptive History Biases Result from Confidence-Weighted Accumulation of past Choices , 2017, The Journal of Neuroscience.

[100]  J. D. Smith,et al.  The comparative psychology of uncertainty monitoring and metacognition. , 2003, The Behavioral and brain sciences.