Selective Visuo-Spatial Attention Revealed by Fine-grained Deep Visual Representations during Naturalistic Movie Watching.

Authors

Liting Wang, Xin Zhang, Pengcheng Xie, Shijie Zhao, Xintao Hu

Published in

NeuroImage. Pages 122202. Sep 06, 2026. Epub Sep 06, 2026.

Abstract

Selective visuo-spatial attention is a complex and dynamic process that prioritizes relevant visual information while suppressing irrelevant distractors. Recent studies have demonstrated that incorporating computational visual attention models with functional magnetic resonance imaging (fMRI) in naturalistic paradigms (e.g., movie-watching) offers valuable insights into the neural mechanisms underlying selective visual attention. However, prior research has typically treated these models as "black boxes", overlooking the heterogeneity of their elementary hidden units, such as the convolutional filters in a convolutional neural network (CNN). In this study, we investigate whether decomposing a CNN-based computational visual attention model into its constituent filters can advance our understanding of the neural mechanisms of selective visual attention. Specifically, we treated each filter as a distinct saliency-related feature channel and derived its temporal responses during movie-clip processing. These temporal responses served as filter-specific visual attention regressors in general linear model (GLM) analysis applied to movie-watching fMRI data to localize associated brain regions. Our results demonstrate that these filters can be grouped into three clusters with distinct cortical activation patterns. Notably, the primary cluster reliably mapped onto canonical fronto-parietal attention networks alongside higher-order visual cortices, showing remarkable consistency with the global attention regressor and suggesting that decomposed filters successfully capture core visuospatial components. Crucially, the filter-specific analysis revealed distinct neural response patterns beyond the global saliency representation, involving auditory regions and the default mode network (DMN) during naturalistic viewing. Furthermore, eye-tracking analysis confirmed that the filter units effectively capture an auditory bias in visual attention. These findings offer valuable insights into the neural basis of fine-grained visual attention representations, particularly under naturalistic viewing conditions.

PMID:
42702339
Bibliographic data and abstract were imported from PubMed on 07 Sep 2026.

Read full publication at:
Please sign in to see all details.

Stats

1-terrible, 9-excellent. How would you rate this publication? Sign in in to submit your rating.

Post a comment

You need to be signed in to post comments. You can sign in here.

Comments

There are no comments yet.