Language-based affect assessments capture experiment-induced changes beyond rating scales.

Authors

Oskar Bång, Zhuojun Gu, August H Nilsson, Veerle C Eijsbroek, Clara Wiebel, Adithya V Ganesan, Katarina Kjell, H Andrew Schwartz, Oscar N E Kjell

Published in

Behavior research methods. Volume 58. Issue 12. Nov 03, 2026. Epub Nov 03, 2026.

Abstract

Language-based assessments (LBAs) have shown strong convergent and criterion validity cross-sectionally and longitudinally. However, no study has tested whether LBAs of affect can capture experiment-induced changes (i.e., causal validity). In this randomized mixed-design experiment, participants (N = 892) completed a mood induction procedure comprising different conditions (church, shopping mall, and park) using physical locations (N = 153) and online video clips (N = 739). Participants reported their pre- and post-induction affect through open-ended responses and ratings (i.e., the Positive and Negative Affect Schedule; PANAS). Using large language models and machine learning, we compared how accurately PANAS and language responses classified the experimental conditions. The LBA derived from the language responses exhibited significantly higher accuracy compared to the PANAS scores in classifying the conditions in both the training set (cross-validated AUC = .74 vs. .63), the online holdout set (AUC = .76 vs. .70), and the offline holdout set (AUC = .67 vs. .53). Apart from showing higher predictive accuracy, we assessed LBAs of specific affective dimensions (valence, arousal, and basic emotions). These analyses revealed that positive valence was most strongly expressed in the park condition, while anger was particularly elevated in the mall condition. We also visualized language differences across conditions, showing more calm and peaceful expressions in the park condition and more tired and bored expressions in the mall condition. These findings support the causal validity of language-based affect assessments and their ability to provide insights into affective states. We discuss the potential of using LBA in experimental psychological research.

PMID:
42980974
Bibliographic data and abstract were imported from PubMed on 05 Nov 2026.

Read full publication at:
Please sign in to see all details.

Stats

1-terrible, 9-excellent. How would you rate this publication? Sign in in to submit your rating.

Post a comment

You need to be signed in to post comments. You can sign in here.

Comments

There are no comments yet.