The temporal representation of experience in subjective mood - PubMed
- ️Fri Jan 01 2021
The temporal representation of experience in subjective mood
Hanna Keren et al. Elife. 2021.
Abstract
Humans refer to their mood state regularly in day-to-day as well as clinical interactions. Theoretical accounts suggest that when reporting on our mood we integrate over the history of our experiences; yet, the temporal structure of this integration remains unexamined. Here, we use a computational approach to quantitatively answer this question and show that early events exert a stronger influence on reported mood (a primacy weighting) compared to recent events. We show that a Primacy model accounts better for mood reports compared to a range of alternative temporal representations across random, consistent, or dynamic reward environments, different age groups, and in both healthy and depressed participants. Moreover, we find evidence for neural encoding of the Primacy, but not the Recency, model in frontal brain regions related to mood regulation. These findings hold implications for the timing of events in experimental or clinical settings and suggest new directions for individualized mood interventions.
Trial registration: ClinicalTrials.gov NCT03388606.
Keywords: anterior cingulate cortex; computational psychiatry; fMRI; human; mood; neuroscience; primacy model; reward.
Conflict of interest statement
HK, CZ, DJ, KC, AV, RR, FP, DN, AS No competing interests declared
Figures

(A) Participants played a probabilistic task where they experienced different reward prediction error values, while reporting subjective mood every 2-3 gambling trials. In each trial, participants chose whether to gamble between two monetary values or to receive a certain amount (Gamble decision). During Expectation, the chosen option remained on the screen, followed by the presentation of the Outcome value. (B)Mood ∝ βE∑j=1tγt−jEjpresents the expectation term of the mood models, where βE is the influence of expectation values on subjective mood reports. The expectation term of the Recency mood model as developed by Rutledge et al., 2014 is presented belowEt=Hight+Lowt2where it consists of the trial’s high and low gamble values. In the alternative Primacy model, as presented inEt=1t-1∑i=1t-1Aithe expectation term is replaced by the average of all previous outcomes (Ai). Moreover, as can be seen in Equations 6–8 in Materials and methods, the Primacy model has overall fewer parameters compared to the Recency model. The theoretical scaling curves for the influence of previous events on mood due to expected outcomes are presented for each model respectively below (see Figure 1—figure supplement 1 for additional illustrations).

In the Primacy model, the expectation term Ej is the unweighted average of previous outcomes. At each trial, all previous expectation terms are combined in an exponentially weighted sum: ∑j=1tγt-jEj . Here, we illustrate how this gives rise to a primacy weighting of previous outcomes that depends on the value of γ (each subplot represents a different magnitude of exponential weighting γ). The total height of each bar represents the influence of the outcome of the corresponding trial on the result of the exponential sum at the end of trial 9. Each color indicates the contributions of the outcomes that form an expectation term Ej at the end of trial j. The dark yellow block represents the contribution of the expectation term E1 from the end of trial 1 (comprised only of the first outcome). The gray blocks represent the contributions of the expectation term E2 that is being added from the end of trial 2 (which is the average of the outcomes from trials 1 and 2, and therefore it appears in both the first and the second bars). This continues for the rest of the expectation terms until the last expectation term E9 is added, which is formed by averaging the outcomes from trials 1 to 9 as shown by the blue bars.

(A) Reward prediction error (RPE) values received during each task version, averaged across all participants (shaded areas represent SEM). (B) The influence of RPE values on mood reports along the task, averaged across all participants (shaded areas are SEM). See Materials and methods for a link to the online repository from where the source data of this figure can be downloaded.

(A) Model comparison between the Primacy and the Recency models, using the streaming prediction criterion, where the model is predicting each mood rating using the preceding ratings. On the left, the trial-level errors in predicting mood with the Recency and the Primacy models are shown for all participants, during the structure-adaptive task (bold line depicts average across all participants). This error is calculated by predicting the t-th mood rating using all preceding (1 to t-1) mood ratings, and therefore fitting iterations start only as of the fourth mood rating (~15 gambling trials), which ensures that models have sufficient data to fit all parameters. The right panel presents the median of mean squared errors (MSEs) of the Primacy model relative to the Recency model in this criterion across all datasets (edges indicate 25th and 75th percentiles, and error bars show the most extreme data point not considered an outlier). (B) Model comparison between the Primacy and three variants of the Recency model, which also shows lower MSEs for the Primacy model. Values are median MSEs of the Primacy model relative to each of the alternative models (i.e., Recency with dynamic probability model marked with circles, Recency without the Certain term model marked with squares, and the Recency with outcomes as expectation model marked by crosses), and error bars are standard deviation across participants. The values used to derive these plots are available in Table 1, fit coefficients are presented in Figure 3—figure supplement 2, and a link for downloading all the modeling scripts can be found in Materials and methods.


(A) Equations S1 and S2 show the two additional parameters that were included in the Primacy model to test other scaling curves for most influential events on mood. (B) Examples of theoretical scaling curves that were tested with the extended model that were also outperformed by the Primacy model.

The left two columns show the task mood ratings and outcomes (A) above the expectation and reward prediction error (RPE) parameters of the Primacy (B) and the Recency (C) models (of a single participant during the Structured task). The rightmost column shows the average across all participants of mood ratings, above the combination between the expectation and RPE parameters of each model (shaded areas represent standard deviation).

(A) Extracting individual whole-brain BOLD signal activation maps (βbrain) during the time interval preceding each mood rating, and individual model parameters by fitting mood ratings with the Primacy model (βE). (B) Correlation across participants between the individual weights of the model expectation term, βE , and the individual voxel-wise neural activations. A significant cluster was received with a peak at [–3,52,6], size of 132 voxels, threshold at p = 0.0017 (after a multiple comparisons correction as well as a Bonferroni correction for the three 3dMVM models we tested). Below, the resulting cluster of significant correlation is presented aligned on the Automated Anatomical Labeling (AAL) brain atlas for spatial orientation (focus point of the image is at [–7.17,50,4.19], which is located in the ACC region). (C) A statistical comparison between the relation of brain activation to the Primacy versus the Recency models. We compared the regression coefficients of the correlation between participants’ brain activation and the Primacy expectation term weights versus the regression coefficients of the relation to the Recency model expectation term (see Figure 4—figure supplement 1 for the two images before thresholding and before contrasting against each other). This contrast showed a significantly stronger relation of the Primacy model expectation weight to brain signals at [–11,49,9], extending to a cluster of 529 voxels (p = 0.0017). See Materials and methods for a link to the online repository from where the neural analyses scripts and the presented images can be downloaded.

None of the Recency models’ clusters survived correction. Images show correlation across participants between the individual weights of the model expectation term, βE, and the individual whole-brain BOLD signal activation during the time interval preceding each mood rating (an uncorrected threshold of p = 0.05 and a minimal cluster size of 50 voxels).

Cluster peaks in the nucleus accumbens (NACC) and covers the ACC and Caudate (337 voxels, t = 4.96).
Similar articles
-
Association of Neural and Emotional Impacts of Reward Prediction Errors With Major Depression.
Rutledge RB, Moutoussis M, Smittenaar P, Zeidman P, Taylor T, Hrynkiewicz L, Lam J, Skandali N, Siegel JZ, Ousdal OT, Prabhu G, Dayan P, Fonagy P, Dolan RJ. Rutledge RB, et al. JAMA Psychiatry. 2017 Aug 1;74(8):790-797. doi: 10.1001/jamapsychiatry.2017.1713. JAMA Psychiatry. 2017. PMID: 28678984 Free PMC article.
-
The neural code of reward anticipation in human orbitofrontal cortex.
Kahnt T, Heinzle J, Park SQ, Haynes JD. Kahnt T, et al. Proc Natl Acad Sci U S A. 2010 Mar 30;107(13):6010-5. doi: 10.1073/pnas.0912838107. Epub 2010 Mar 15. Proc Natl Acad Sci U S A. 2010. PMID: 20231475 Free PMC article.
-
Ma L, Steinberg JL, Hasan KM, Narayana PA, Kramer LA, Moeller FG. Ma L, et al. Hum Brain Mapp. 2012 Aug;33(8):1850-67. doi: 10.1002/hbm.21329. Epub 2011 Jun 20. Hum Brain Mapp. 2012. PMID: 21692148 Free PMC article.
-
Not "just" a coincidence: frontal-striatal interactions in working memory and interval timing.
Lustig C, Matell MS, Meck WH. Lustig C, et al. Memory. 2005 Apr-May;13(3-4):441-8. doi: 10.1080/09658210344000404. Memory. 2005. PMID: 15952263 Review.
-
Neural representations of subjective reward value.
Peters J, Büchel C. Peters J, et al. Behav Brain Res. 2010 Dec 1;213(2):135-41. doi: 10.1016/j.bbr.2010.04.031. Epub 2010 Apr 24. Behav Brain Res. 2010. PMID: 20420859 Review.
Cited by
-
Naturalistic reinforcement learning.
Wise T, Emery K, Radulescu A. Wise T, et al. Trends Cogn Sci. 2024 Feb;28(2):144-158. doi: 10.1016/j.tics.2023.08.016. Epub 2023 Sep 29. Trends Cogn Sci. 2024. PMID: 37777463 Free PMC article. Review.
-
An experimental approach to training mood for resilience.
Mantas V, Kotoula V, Zheng C, Nielson DM, Stringaris A. Mantas V, et al. PLoS One. 2023 Sep 7;18(9):e0290881. doi: 10.1371/journal.pone.0290881. eCollection 2023. PLoS One. 2023. PMID: 37676862 Free PMC article.
-
Magnetoencephalographic correlates of mood and reward dynamics in human adolescents.
Liuzzi L, Chang KK, Zheng C, Keren H, Saha D, Nielson DM, Stringaris A. Liuzzi L, et al. Cereb Cortex. 2022 Jul 21;32(15):3318-3330. doi: 10.1093/cercor/bhab417. Cereb Cortex. 2022. PMID: 34921602 Free PMC article.
-
Hedonism as a motive for information search: biased information-seeking leads to biased beliefs.
Jiwa M, Cooper PS, Chong TT, Bode S. Jiwa M, et al. Sci Rep. 2023 Feb 6;13(1):2086. doi: 10.1038/s41598-023-29429-8. Sci Rep. 2023. PMID: 36747063 Free PMC article.
-
Computational models of subjective feelings in psychiatry.
Kao CH, Feng GW, Hur JK, Jarvis H, Rutledge RB. Kao CH, et al. Neurosci Biobehav Rev. 2023 Feb;145:105008. doi: 10.1016/j.neubiorev.2022.105008. Epub 2022 Dec 19. Neurosci Biobehav Rev. 2023. PMID: 36549378 Free PMC article. Review.
References
-
- Ambady N, Rosenthal R. Thin slices of expressive behavior as predictors of interpersonal consequences: a meta-analysis. Psychological Bulletin. 1992;111:256–274. doi: 10.1037/0033-2909.111.2.256. - DOI
-
- Braams BR, van Duijvenvoorde AC, Peper JS, Crone EA. Longitudinal changes in adolescent risk-taking: a comprehensive study of neural responses to rewards, pubertal development, and risk-taking behavior. Journal of Neuroscience. 2015;35:7226–7238. doi: 10.1523/JNEUROSCI.4764-14.2015. - DOI - PMC - PubMed
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources