Authors
Jun Jiang, Qiangqiang Gu, Xin Zhou, Ruifeng Guo, Sunyang Fu, Andrew Wen, Liwei Wang, Nianyi Li, Qiuhao Lu, Rongzhen Zhang, Alexexander Banerjee DO, Peiliang Lou, Chen Wang, Yanshan Wang, Hongfang Liu
Published in
Scientific reports. Volume 16. Pages 34882. Epub Jul 28, 2026.
Abstract
Digital pathology has transformed how pathologists review and interpret tissue specimens, enabling remote access, efficient storage, and advanced visualization. Systematically analyzing pathologists' slide reviewing interactions can uncover opportunities to design AI-assisted tools that integrate seamlessly into routine practice. We present a proof-of-concept suite, PathInteract, for extracting pathology interaction signals from recorded slide-review videos. Mouse cursor movements, viewport actions (i.e., zooming and panning), and verbal narratives are extracted using multiple deep learning and computer vision moduals. Unlike prior methods requiring specialized software or equipment, our approach operates on screen recordings, enabling broader applicability. We developed PathInteract using QuPath-recorded diagnostic sessions with view-tracking logs and applied it to ten educational YouTube videos. Results revealed distinct interaction patterns between two pathologists with different levels of experience, tissue type, and use context. Cursor tracking and viewport detection achieved strong agreement with ground truth, while speech analysis highlighted differences in cell-level focus across diseases. PathInteract enables scalable analysis of reviewing interactions in digital pathology through video recording and supports repurposing of existing pathology videos towards building interpretable, multimodal pathology AI datasets.
The online version contains supplementary material available at https://doi.org/10.1038/s41598-026-61758-2.
PMID:
43019129
Bibliographic data and abstract were imported from PubMed on 13 Nov 2026.
Read full publication at:
Please sign in
to see all details.
Advertisement
Stats
- Recommendations n/a n/a positive of 0 vote(s)
- Views 2
- Comments 0