Values and Actions in Aversion

[1]  P. Dayan,et al.  A Bayesian formulation of behavioral control , 2009, Cognition.

[2]  Peter Dayan,et al.  The role of value systems in decision making. , 2008 .

[3]  Peter Dayan,et al.  Hippocampal Contributions to Control: The Third Way , 2007, NIPS.

[4]  Joseph J. Paton,et al.  Expectation Modulates Neural Responses to Pleasant and Aversive Stimuli in Primate Amygdala , 2007, Neuron.

[5]  D. Hassabis,et al.  When Fear Is Near: Threat Imminence Elicits Prefrontal-Periaqueductal Gray Shifts in Humans , 2007, Science.

[6]  P. Dayan,et al.  Differential Encoding of Losses and Gains in the Human Striatum , 2007, The Journal of Neuroscience.

[7]  B. Sahakian,et al.  The neuropsychiatry of impulsivity , 2007, Current opinion in psychiatry.

[8]  R. Dolan,et al.  The neurobiology of punishment , 2007, Nature Reviews Neuroscience.

[9]  S. Kapur,et al.  Separate brain regions code for salience vs. valence during reward prediction in humans , 2007, Human brain mapping.

[10]  G. Loewenstein,et al.  Neural Predictors of Purchases , 2007, Neuron.

[11]  P. Dayan,et al.  Tonic dopamine: opportunity costs and the control of response vigor , 2007, Psychopharmacology.

[12]  M. Delgado,et al.  Fear of losing money? Aversive conditioning with secondary reinforcers. , 2006, Social cognitive and affective neuroscience.

[13]  Peter Dayan,et al.  Non-commercial Research and Educational Use including without Limitation Use in Instruction at Your Institution, Sending It to Specific Colleagues That You Know, and Providing a Copy to Your Institution's Administrator. All Other Uses, Reproduction and Distribution, including without Limitation Comm , 2022 .

[14]  Rudolf N. Cardinal,et al.  Neural systems implicated in delayed and probabilistic reinforcement , 2006, Neural Networks.

[15]  R. Dolan,et al.  Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans , 2006, Nature.

[16]  D. Kumaran,et al.  Frames, Biases, and Rational Decision-Making in the Human Brain , 2006, Science.

[17]  P. Dayan,et al.  Opinion TRENDS in Cognitive Sciences Vol.10 No.8 Full text provided by www.sciencedirect.com A normative perspective on motivation , 2022 .

[18]  J. O'Doherty,et al.  Is Avoiding an Aversive Outcome Rewarding? Neural Substrates of Avoidance Learning in the Human Brain , 2006, PLoS biology.

[19]  S. Ishii,et al.  Resolution of Uncertainty in Prefrontal Cortex , 2006, Neuron.

[20]  H. Yin,et al.  The role of the basal ganglia in habit formation , 2006, Nature Reviews Neuroscience.

[21]  G. Loewenstein.  The Pleasures and Pains of Information , 2006, Science.

[22]  G. Pagnoni,et al.  Neurobiological Substrates of Dread , 2006, Science.

[23]  B. Balleine,et al.  Parallel incentive processing: an integrated view of amygdala function , 2006, Trends in Neurosciences.

[24]  Joseph J. Paton,et al.  The primate amygdala represents the positive and negative value of visual stimuli during learning , 2006, Nature.

[25]  Raymond J. Dolan,et al.  Contingency awareness in human aversive conditioning involves the middle frontal gyrus , 2006, NeuroImage.

[26]  B. Balleine,et al.  Inactivation of dorsolateral striatum enhances sensitivity to changes in the action–outcome contingency in instrumental conditioning , 2006, Behavioural Brain Research.

[27]  P. Dayan,et al.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control , 2005, Nature Neuroscience.

[28]  B. Richmond,et al.  Neuronal Signals in the Monkey Basolateral Amygdala during Reward Schedules , 2005, The Journal of Neuroscience.

[29]  T. Robbins,et al.  Neural systems of reinforcement for drug addiction: from actions to habits to compulsion , 2005, Nature Neuroscience.

[30]  Karl J. Friston,et al.  Opponent appetitive-aversive neural processes underlie predictive learning of pain relief , 2005, Nature Neuroscience.

[31]  E. Bowman,et al.  Rat nucleus accumbens neurons predominantly respond to the outcome-related properties of conditioned stimuli rather than their behavioral-switching properties. , 2005, Journal of neurophysiology.

[32]  C. Carter,et al.  Outcome representations, counterfactual comparisons and the human orbitofrontal cortex: implications for neuroimaging studies of decision-making. , 2005, Brain research. Cognitive brain research.

[33]  B. Richmond,et al.  Neuronal firing in anterior cingulate neurons changes modes across trials in single states of multitrial reward schedules , 2005, Experimental Brain Research.

[34]  B. Balleine,et al.  Double Dissociation of Basolateral and Central Amygdala Lesions on the General and Outcome-Specific Forms of Pavlovian-Instrumental Transfer , 2005, The Journal of Neuroscience.

[35]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[36]  G. Quirk,et al.  Neuronal signalling of fear memory , 2004, Nature Reviews Neuroscience.

[37]  H. Fields.  State-dependent opioid control of pain , 2004, Nature Reviews Neuroscience.

[38]  Peter Dayan,et al.  Temporal difference models describe higher-order learning in humans , 2004, Nature.

[39]  T. Robbins,et al.  Limbic Corticostriatal Systems and Delayed Reinforcement , 2004, Annals of the New York Academy of Sciences.

[40]  Felisa González,et al.  Safety signals from avoidance learning but not from yoked classical conditioning training pass both summation and retardation tests for inhibition , 2004, Behavioural Processes.

[41]  F. Graeff.  Serotonin, the periaqueductal gray and panic , 2004, Neuroscience & Biobehavioral Reviews.

[42]  J. Stevens.  The selfish nature of generosity: harassment and food sharing in primates , 2004, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[43]  O. Hikosaka,et al.  Dopamine Neurons Can Represent Context-Dependent Prediction Error , 2004, Neuron.

[44]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[45]  Peter Dayan,et al.  Technical Note: Q-Learning , 2004, Machine Learning.

[46]  S. Kapur,et al.  Direct Activation of the Ventral Striatum in Anticipation of Aversive Stimuli , 2003, Neuron.

[47]  E. Koechlin,et al.  The Architecture of Cognitive Control in the Human Prefrontal Cortex , 2003, Science.

[48]  G. Schoenbaum,et al.  Lesions of Nucleus Accumbens Disrupt Learning about Aversive Outcomes , 2003, The Journal of Neuroscience.

[49]  Tatsuo K Sato,et al.  Correlated Coding of Motivation and Outcome of Decision by Dopamine Neurons , 2003, The Journal of Neuroscience.

[50]  G. Schoenbaum,et al.  Neural Encoding in Ventral Striatum during Olfactory Discrimination Learning , 2003, Neuron.

[51]  P. Dayan,et al.  Reward, Motivation, and Reinforcement Learning , 2002, Neuron.

[52]  A. Craig.  How do you feel? Interoception: the sense of the physiological condition of the body , 2002, Nature Reviews Neuroscience.

[53]  Sham M. Kakade,et al.  Opponent interactions between serotonin and dopamine , 2002, Neural Networks.

[54]  B. Everitt,et al.  Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex , 2002, Neuroscience & Biobehavioral Reviews.

[55]  B. Lumb.  Inescapable and Escapable Pain is Represented in Distinct Hypothalamic‐Midbrain Circuits: Specific Roles for aδ‐ and C‐Nociceptors , 2002, Experimental physiology.

[56]  E. Fehr,et al.  Altruistic punishment in humans , 2002, Nature.

[57]  A. Basbaum,et al.  Molecular mechanisms of nociception , 2001, Nature.

[58]  J. March,et al.  Adaptation as Information Restriction: The Hot Stove Effect , 2001 .

[59]  J. Dinsmoor.  Stimuli inevitably generated by behavior that avoids electric shock are inherently reinforcing. , 2001, Journal of the experimental analysis of behavior.

[60]  B. Balleine,et al.  The Role of the Nucleus Accumbens in Instrumental Conditioning: Evidence of a Functional Dissociation between Accumbens Core and Shell , 2001, The Journal of Neuroscience.

[61]  A. Tversky,et al.  Choices, Values, and Frames , 2000 .

[62]  Joseph E LeDoux.  Emotion Circuits in the Brain , 2000 .

[63]  J. Horvitz.  Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events , 2000, Neuroscience.

[64]  S. Ikemoto,et al.  The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking , 1999, Brain Research Reviews.

[65]  D. Price.  Psychological Mechanisms of Pain and Analgesia , 1999 .

[66]  M. Fendt,et al.  The neuroanatomical and neurochemical basis of conditioned fear , 1999, Neuroscience & Biobehavioral Reviews.

[67]  B. Balleine,et al.  Goal-directed instrumental action: contingency and incentive learning and their cortical substrates , 1998, Neuropharmacology.

[68]  T. Robbins,et al.  Different types of fear-conditioned behaviour mediated by separate nuclei within amygdala , 1997, Nature.

[69]  C. Gallistel,et al.  Toward a neurobiology of temporal cognition: advances and challenges , 1997, Current Opinion in Neurobiology.

[70]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[71]  N. Aplin,et al.  PSYCHOLOGICAL EXPECTED UTILITY THEORY AND ANTICIPATORY FEELINGS * A , 1997 .

[72]  F. Graeff,et al.  Role of 5-HT in stress, anxiety, and depression , 1996, Pharmacology Biochemistry and Behavior.

[73]  P. Dayan,et al.  A framework for mesencephalic dopamine systems based on predictive Hebbian learning , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[74]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[75]  T. Clutton‐Brock,et al.  Punishment in animal societies , 1995, Nature.

[76]  M. Fanselow.  Neural organization of the defensive behavior system responsible for fear , 1994, Psychonomic bulletin & review.

[77]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[78]  P. Richerson,et al.  Punishment allows the evolution of cooperation (or anything else) in sizable groups , 1992 .

[79]  R. Dantzer.  Fear and defence edited by P.F. Brain, S. Parmigiani, R. Blanchard and D. Mainardi. Harwood Academic Publishers, Chur, 1990, ISBN 3-7186-5015-0, 420 pp., USD 89.00 , 1991, Behavioural Processes.

[80]  D. Blanchard,et al.  Anti-predator defense as models of animal fear and anxiety. , 1990 .

[81]  A. Barto,et al.  Learning and Sequential Decision Making , 1989 .

[82]  G. Loewenstein.  Anticipation and the Valuation of Delayed Consumption , 1987 .

[83]  T. Yamagishi.  The provision of a sanctioning system as a public good , 1986 .

[84]  J. Thomson,et al.  Rights, Restitution, And Risk , 1986 .

[85]  S. Grossberg.  Some normal and abnormal behavioral syndromes due to transmitter gating of opponent processes. , 1984, Biological psychiatry.

[86]  Richard S. Sutton,et al.  Neuronlike adaptive elements that can solve difficult learning control problems , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[87]  P. Lovibond.  Facilitation of instrumental behavior by a Pavlovian appetitive conditioned stimulus. , 1983, Journal of experimental psychology. Animal behavior processes.

[88]  N. Mackintosh,et al.  Conditioning And Associative Learning , 1983 .

[89]  D. Dewsbury,et al.  Chimpanzee Politics: Power and Sex Among Apes. , 1983 .

[90]  Christopher D. Adams,et al.  Instrumental Responding following Reinforcer Devaluation , 1981 .

[91]  A G Barto,et al.  Toward a modern theory of adaptive networks: expectation and prediction. , 1981, Psychological review.

[92]  A. Dickinson.  Contemporary Animal Learning Theory , 1981 .

[93]  A. Tversky,et al.  The framing of decisions and the psychology of choice. , 1981, Science.

[94]  S. Mineka,et al.  Dissociation between conditioned emotional response and extended avoidance performance , 1980 .

[95]  R. Bolles,et al.  Comparisons of stimulus learning and response learning in a punishment situation , 1980 .

[96]  L. Abramson,et al.  Judgment of contingency in depressed and nondepressed students: sadder but wiser? , 1979, Journal of experimental psychology. General.

[97]  R. Hendersen,et al.  Avoidance of heat by rats: Effects of thermal context on rapidity of extinction , 1979 .

[98]  R. Solomon,et al.  An Opponent-Process Theory of Motivation , 1978 .

[99]  W. K. Honig,et al.  Handbook of Operant Behavior , 2022 .

[100]  S. Mineka,et al.  Determinants of fear over the course of avoidance learning , 1977 .

[101]  G. Atnip,et al.  Stimulus- and response-reinforcer contingencies in autoshaping, operant, classical, and omission training procedures in rats. , 1977, Journal of the experimental analysis of behavior.

[102]  M. Seligman,et al.  Learned helplessness: Theory and evidence. , 1976 .

[103]  R. Morris.  Preconditioning of reinforcing properties to an exteroceptive feedback stimulus , 1975 .

[104]  P. J. Bersh,et al.  The discriminative control of free-operant avoidance despite exposure to shock during the stimulus correlated with nonreinforcement. , 1975, Journal of the experimental analysis of behavior.

[105]  B D Sachs,et al.  Copulatory behavior of male rats given intermittent electric shocks: theoretical implications. , 1974, Journal of comparative and physiological psychology.

[106]  Peter A. de Villiers,et al.  The law of effect and avoidance: a quantitative relationship between response rate and shock-frequency reduction. , 1974 .

[107]  R. Solomon,et al.  An opponent-process theory of motivation. I. Temporal dynamics of affect. , 1974, Psychological review.

[108]  F. Graeff,et al.  Nondiscriminated avoidance of shock by pigeons pecking a key. , 1973, Journal of the experimental analysis of behavior.

[109]  D. Riess.  Shuttleboxes, Skinner boxes, and Sidman avoidance in rats: Acquisition and terminal performance as a function of response topography , 1971 .

[110]  Overmier Jb,et al.  Discriminative cue properties of different fears and their role in response selection in dogs. , 1971 .

[111]  J. Overmier,et al.  Discriminative cue properties of different fears and their role in response selection in dogs. , 1971, Journal of comparative and physiological psychology.

[112]  R. Weisman,et al.  The course of Pavlovian excitation and inhibition of fear in rats. , 1969, Journal of comparative and physiological psychology.

[113]  R. Weisman,et al.  Positive conditioned reinforcement of Sidman avoidance behavior in rats. , 1969 .

[114]  D. R. Williams,et al.  Auto-maintenance in the pigeon: sustained pecking despite contingent non-reinforcement. , 1969, Journal of the experimental analysis of behavior.

[115]  J. Anson,et al.  Facilitative effects of punishment on aggressive behavior in the Siamese fighting fish , 1969 .

[116]  R. Rescorla,et al.  Establishment of a positive reinforcer through contrast with shock. , 1969, Journal of comparative and physiological psychology.

[117]  R. Solomon,et al.  Some effects of delay of punishment on resistance to temptation in dogs. , 1968, Journal of personality and social psychology.

[118]  G. Biederman.  Discriminated avoidance conditioning: CS function during avoidance acquisition and maintenance , 1968 .

[119]  P. L. Brown,et al.  Auto-shaping of the pigeon's key-peck. , 1968, Journal of the experimental analysis of behavior.

[120]  W. H. Morse,et al.  Modulation of Elicited Behavior by a Fixed-Interval Schedule of Electric Shock Presentation , 1967, Science.

[121]  R. Church,et al.  Temporal relationship between response and punishment. , 1967, Journal of experimental psychology.

[122]  R M Church,et al.  Response suppression as a function of intensity and duration of a punishment. , 1967, Journal of comparative and physiological psychology.

[123]  J. Konorski.  Integrative activity of the brain : an interdisciplinary approach , 1967 .

[124]  A. Baron.  DELAYED PUNISHMENT OF A RUNWAY RESPONSE. , 1965, Journal of comparative and physiological psychology.

[125]  A. Catania,et al.  EFFECTS OF DRUGS ON AVOIDANCE AND ESCAPE BEHAVIOR. , 1964, Federation proceedings.

[126]  G. Biederman,et al.  Facilitation of discriminated avoidance learning by dissociation of CS and manipulandum , 1964 .

[127]  N. Azrin,et al.  Fixed-ratio escape reinforcement. , 1963, Journal of the experimental analysis of behavior.

[128]  A. Black,et al.  Conditioned suppression as a monitor of fear of the CS in the course of avoidance training. , 1963, Journal of comparative and physiological psychology.

[129]  R. Ulrich,et al.  Reflexive fighting in response to aversive stimulation. , 1962, Journal of the experimental analysis of behavior.

[130]  K. Breland,et al.  The misbehavior of organisms. , 1961 .

[131]  N. Azrin.  Effects of punishment intensity during variable-interval reinforcement. , 1960, Journal of the experimental analysis of behavior.

[132]  N. Azrin.  Some Effects of Two Intermittent Schedules of Immediate and Non-Immediate Punishment , 1956 .

[133]  W. Estes.  Discriminative conditioning; effects of a Pavlovian conditioned stimulus upon a subsequently established operant response. , 1948, Journal of experimental psychology.

[134]  O. Mowrer.  On the dual nature of learning—a re-interpretation of "conditioning" and "problem-solving." , 1947 .

[135]  B. Skinner,et al.  Some quantitative properties of anxiety , 1941 .

[136]  E. Tolman.  Purposive behavior in animals and men , 1932 .

[137]  J. Bentham.  A table of the springs of action , 1815 .