Get access

Surprise! Neural correlates of Pearce–Hall and Rescorla–Wagner coexist within the brain

Authors

  • Matthew R. Roesch,

    1. Department of Psychology, University of Maryland College Park, College Park, MD, USA
    2. Program in Neuroscience and Cognitive Science, University of Maryland College Park, College Park, MD, USA
    Search for more papers by this author
  • Guillem R. Esber,

    1. Department of Anatomy and Neurobiology, University of Maryland School of Medicine, Baltimore, MD, USA
    Search for more papers by this author
  • Jian Li,

    1. Psychology Department, New York University, New York, NY, USA
    2. Center for Neural Science, New York University, New York, NY, USA
    Search for more papers by this author
  • Nathaniel D. Daw,

    1. Psychology Department, New York University, New York, NY, USA
    2. Center for Neural Science, New York University, New York, NY, USA
    Search for more papers by this author
  • Geoffrey Schoenbaum

    1. Department of Anatomy and Neurobiology, University of Maryland School of Medicine, Baltimore, MD, USA
    2. Department of Psychiatry, University of Maryland School of Medicine, Baltimore, MD, USA
    3. NIDA Intramural Research Program, 251 Bayview Drive, Baltimore, 21224 MD, USA
    Search for more papers by this author

Dr G. Schoenbaum, as above.
E-mail: schoenbg@schoenbaumlab.org

Abstract

Learning theory and computational accounts suggest that learning depends on errors in outcome prediction as well as changes in processing of or attention to events. These divergent ideas are captured by models, such as Rescorla–Wagner (RW) and temporal difference (TD) learning on the one hand, which emphasize errors as directly driving changes in associative strength, vs. models such as Pearce–Hall (PH) and more recent variants on the other hand, which propose that errors promote changes in associative strength by modulating attention and processing of events. Numerous studies have shown that phasic firing of midbrain dopamine (DA) neurons carries a signed error signal consistent with RW or TD learning theories, and recently we have shown that this signal can be dissociated from attentional correlates in the basolateral amygdala and anterior cingulate. Here we will review these data along with new evidence: (i) implicating habenula and striatal regions in supporting error signaling in midbrain DA neurons; and (ii) suggesting that the central nucleus of the amygdala and prefrontal regions process the amygdalar attentional signal. However, while the neural instantiations of the RW and PH signals are dissociable and complementary, they may be linked. Any linkage would have implications for understanding why one signal dominates learning in some situations and not others, and also for appreciating the potential impact on learning of neuropathological conditions involving altered DA or amygdalar function, such as schizophrenia, addiction or anxiety disorders.

Get access to the full text of this article

Ancillary