Hiring in life sciences? Share your open positions with our professional community. Read more Close

Advertisement

Interactive Pathology Reporting Using Eye Gaze, Natural Speech, and Large Language Models.

Created on 17 Nov 2026

Authors

Alana Lopes, Bojana Djordjevic, Emily A Goebel, Jose A Gomez, Brian Keller, Maria Florencia Mora, Joanna C Walsh, Luojun Wang, Bret Wehrli, Cady Zeman-Pocrnich, Shereen Zia, Matthew J Cecchini, Aaron D Ward

Published in

Archives of pathology & laboratory medicine. Oct 29, 2026. Epub Oct 29, 2026.

Abstract

Pathology reporting is essential to clinical workflow, but reports are entirely text based, and report completion disturbs pathologists' workflow. This article proposes an alternative pathology reporting workflow that addresses these issues.
To determine the feasibility of using a pathologist's eye gaze and natural speech during whole slide image (WSI) assessment with a large language model (LLM) to generate an interactive pathology report.
Ten pathologists assessed 3 WSIs in a controlled setting identifying preset tissue features, and 3 WSIs in an uncontrolled setting identifying any tissue features and measurements they desired. LLM accuracy, temporal eye gaze-natural speech delay, and number of report modifications were recorded. Eye gaze and voice data were collected to create an interactive multimedia pathology report; each finding linked to the corresponding WSI region. Pathologists subsequently completed a qualitative survey on their experience.
LLM feature identification accuracy was 99.7% and 98.3% for the controlled and uncontrolled setting, respectively. Measurement identification accuracy for the uncontrolled setting was 72.2%. All report modifications were made by using a custom interface after the uncontrolled setting; of the 19 report modifications, 18 (95%) supported pathologists' preferences rather than correcting report errors. Median temporal eye gaze-natural speech delay was 1.47 ± 0.96 seconds. All observers expressed that the proposed workflow could improve reporting efficiency and interphysician communication.
The LLM was better at identifying features than measurements, presumed to be due to the temporal eye gaze-natural speech delay. Future work is needed to further characterize this temporal delay.

PMID:
43042925
Bibliographic data and abstract were imported from PubMed on 17 Nov 2026.

Read full publication at:
Please sign in to see all details.

Advertisement

Stats

  • Community rating n/a 0 votes
  • Reviewers' rating n/a 0 votes
  • Your rating

1-terrible, 9-excellent. How would you rate this publication? Sign in in to submit your rating.

  • Recommendations n/a n/a positive of 0 vote(s)
  • Views 4
  • Comments 0

Recommended by

  • No recommendations yet.

Post a comment

You need to be signed in to post comments. You can sign in here.

Comments

There are no comments yet.

Advertisement