Behavioral and neural properties of social reinforcement learning - PubMed
- ️Sat Jan 01 2011
Behavioral and neural properties of social reinforcement learning
Rebecca M Jones et al. J Neurosci. 2011.
Abstract
Social learning is critical for engaging in complex interactions with other individuals. Learning from positive social exchanges, such as acceptance from peers, may be similar to basic reinforcement learning. We formally test this hypothesis by developing a novel paradigm that is based on work in nonhuman primates and human imaging studies of reinforcement learning. The probability of receiving positive social reinforcement from three distinct peers was parametrically manipulated while brain activity was recorded in healthy adults using event-related functional magnetic resonance imaging. Over the course of the experiment, participants responded more quickly to faces of peers who provided more frequent positive social reinforcement, and rated them as more likeable. Modeling trial-by-trial learning showed ventral striatum and orbital frontal cortex activity correlated positively with forming expectations about receiving social reinforcement. Rostral anterior cingulate cortex activity tracked positively with modulations of expected value of the cues (peers). Together, the findings across three levels of analysis--social preferences, response latencies, and modeling neural responses--are consistent with reinforcement learning theory and nonhuman primate electrophysiological studies of reward. This work highlights the fundamental influence of acceptance by one's peers in altering subsequent behavior.
Conflict of interest statement
The authors report no conflicts of interest.
Figures

Task parameters. A, Three peers chosen by the participant were associated with distinct probabilities of positive reinforcement. B, Schematic of one trial within a run. The face of one peer (Cue) was displayed for 2 s, during which the face stimulus winked (500 ms) and participants pressed one of two buttons indicating in which eye the wink occurred, followed by a variable interstimulus interval (ISI), followed by the note outcome (Feedback). In this example, the participant received the note (positive social reinforcement) because it appeared in the middle hand. If the note appeared in one of the hands to the left or to the right of the middle hand, the participant did not receive the note (no positive social reinforcement). A variable intertrial interval (ITI) followed.

Behavioral responses to cues. A, Likeability ratings for the three peers before engaging in the task (pre-interaction) and after the task (post-interaction). B, Reaction times to the wink for the three peers, broken down by early and late trials of the experiment. C, Reaction times during the final (sixth) run of the experiment and during the run when the contingencies were reversed for the Rare and Continuous conditions.

Brain regions reflecting positive correlations with prediction errors. A, Circles denote activity in the ventral striatum. Image threshold p < 0.05, whole-brain corrected. B, Circle denotes activity in the lateral orbital frontal cortex. Image threshold p < 0.05, small volume corrected (see Materials and Methods). All statistical activations are displayed on a representative high-resolution axial image. The left side of the image corresponds to the right side of the brain.

Neural activity with positive correlations with learned cue value. Activity in the rostral anterior cingulate cortex reflects a positive correlation with expected values for the cues. Image threshold p < 0.05, whole-brain corrected. Statistical activations are displayed on a representative high-resolution sagittal image.
Similar articles
-
Adolescent-specific patterns of behavior and neural activity during social reinforcement learning.
Jones RM, Somerville LH, Li J, Ruberry EJ, Powers A, Mehta N, Dyke J, Casey BJ. Jones RM, et al. Cogn Affect Behav Neurosci. 2014 Jun;14(2):683-97. doi: 10.3758/s13415-014-0257-z. Cogn Affect Behav Neurosci. 2014. PMID: 24550063 Free PMC article.
-
Harris LT, Fiske ST. Harris LT, et al. Soc Neurosci. 2010;5(1):76-91. doi: 10.1080/17470910903135825. Soc Neurosci. 2010. PMID: 20119878 Free PMC article.
-
Causal Inference Gates Corticostriatal Learning.
Dorfman HM, Tomov MS, Cheung B, Clarke D, Gershman SJ, Hughes BL. Dorfman HM, et al. J Neurosci. 2021 Aug 11;41(32):6892-6904. doi: 10.1523/JNEUROSCI.2796-20.2021. Epub 2021 Jul 9. J Neurosci. 2021. PMID: 34244363 Free PMC article.
-
Prediction error in reinforcement learning: a meta-analysis of neuroimaging studies.
Garrison J, Erdeniz B, Done J. Garrison J, et al. Neurosci Biobehav Rev. 2013 Aug;37(7):1297-310. doi: 10.1016/j.neubiorev.2013.03.023. Epub 2013 Apr 6. Neurosci Biobehav Rev. 2013. PMID: 23567522 Review.
-
Steady-state visual evoked potentials as a research tool in social affective neuroscience.
Wieser MJ, Miskovic V, Keil A. Wieser MJ, et al. Psychophysiology. 2016 Dec;53(12):1763-1775. doi: 10.1111/psyp.12768. Epub 2016 Oct 4. Psychophysiology. 2016. PMID: 27699794 Free PMC article. Review.
Cited by
-
Moran EK, Culbreth AJ, Barch DM. Moran EK, et al. Curr Top Behav Neurosci. 2022;58:129-145. doi: 10.1007/7854_2022_321. Curr Top Behav Neurosci. 2022. PMID: 35503596
-
Social learning through prediction error in the brain.
Joiner J, Piva M, Turrin C, Chang SWC. Joiner J, et al. NPJ Sci Learn. 2017 Jun 16;2:8. doi: 10.1038/s41539-017-0009-2. eCollection 2017. NPJ Sci Learn. 2017. PMID: 30631454 Free PMC article.
-
Guyer AE, Benson B, Choate VR, Bar-Haim Y, Perez-Edgar K, Jarcho JM, Pine DS, Ernst M, Fox NA, Nelson EE. Guyer AE, et al. Dev Psychopathol. 2014 Feb;26(1):229-43. doi: 10.1017/S0954579413000941. Dev Psychopathol. 2014. PMID: 24444176 Free PMC article.
-
Fareri DS, Smith DV, Delgado MR. Fareri DS, et al. Soc Cogn Affect Neurosci. 2020 May 19;15(3):261-271. doi: 10.1093/scan/nsaa031. Soc Cogn Affect Neurosci. 2020. PMID: 32232362 Free PMC article.
-
Neural precursors of future liking and affective reciprocity.
Zerubavel N, Hoffman MA, Reich A, Ochsner KN, Bearman P. Zerubavel N, et al. Proc Natl Acad Sci U S A. 2018 Apr 24;115(17):4375-4380. doi: 10.1073/pnas.1802176115. Epub 2018 Apr 9. Proc Natl Acad Sci U S A. 2018. PMID: 29632195 Free PMC article. Clinical Trial.
References
-
- Alexander GE, DeLong MR, Strick PL. Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu Rev Neurosci. 1986;9:357–381. - PubMed
-
- Bandura A, Walters RH. Social learning and personality development. New York: Holt, Rinehart and Winston; 1963.
-
- Baumeister RF, Leary MR. The need to belong: desire for interpersonal attachments as a fundamental human motivation. Psychol Bull. 1995;117:497–529. - PubMed
-
- Botvinick M, Nystrom LE, Fissell K, Carter CS, Cohen JD. Conflict monitoring versus selection-for-action in anterior cingulate cortex. Nature. 1999;402:179–181. - PubMed
Publication types
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources