Understanding Changes of Emotion and Cognitive Effort in VR.

Authors

Riku Otono, John Moore, Jingruo Chen, Zane Karai, Kunal Gupta, Peta Murphy, Jo Nunnerley, Mark Billinghurst

Published in

IEEE transactions on visualization and computer graphics. Volume PP. Nov 02, 2026. Epub Nov 02, 2026.

Abstract

Understanding how cognitive and emotional states evolve during everyday activities is important for designing effective virtual reality (VR) systems for training and rehabilitation, such as for recovering from traumatic brain injury (TBI). However, less is known about how these internal states fluctuate during naturalistic VR tasks. In this work, we investigate cognitive and emotional state dynamics during a VR shopping activity designed for TBI rehabilitation. Twenty healthy participants performed budgeting, item selection, and decision-making tasks while interacting with a virtual coach in either a low-stimulus (quiet) or high-stimulus (busy) environment. During the task, participants reported on momentary mental workload while physiological signals were continuously recorded. After the session, participants retrospectively annotated perceived cognitive and emotional state changes over time. Our results showed higher perceived workload and physiological arousal in the busy environment, with galvanic skin response activity positively correlated with reported cognitive workload. We describe the implications of the research, its limitations, and directions for future work.

PMID:
42970654
Bibliographic data and abstract were imported from PubMed on 03 Nov 2026.

Read full publication at:
Please sign in to see all details.

Stats

1-terrible, 9-excellent. How would you rate this publication? Sign in in to submit your rating.

Post a comment

You need to be signed in to post comments. You can sign in here.

Comments

There are no comments yet.