Can AI Predict Publication? Multimodal Large Language Models and the Structural Determinants of Surgical Scholarship.

Authors

Sohail Khan, Gavin McAfee, Alex Chiodo Ortiz, Ananya Devarajan, Deric Toro, Sarah Grega, Tyler Sanchez, Roberta Buccilli, Naoru Koizumi, Meng-Hao Li, Gerard Baltazar, Jorge Ortiz

Published in

The American surgeon. Pages 31348261487667. Sep 14, 2026. Epub Sep 14, 2026.

Abstract

BackgroundWhether artificial intelligence can identify publishable scientific work is untested. We evaluated whether a multimodal large language model (MLLM) could predict, from poster content alone, which abstracts at the American Association for the Surgery of Trauma (AAST) Annual Meetings reached publication, and characterized the investigator, institutional, and domain level determinants situating model performance.MethodsWe retrospectively analyzed 260 abstracts from the 2021-2022 AAST Annual Meetings. Bibliographic searches confirmed publication, and investigator sex, race, and ethnicity were inferred from public data. Variables were compared by t-tests and Pearson χ² or Fisher exact tests, with multivariable logistic regression. GPT-4.1 scored poster images on a six-domain rubric averaged over 30 iterations.ResultsGPT-4.1 predicted publication with 58.5% accuracy overall (P = .009), but performance was domain-dependent, 74.2% in Violence, Societal, and Behavioral and 62.2% in Hemorrhage, Resuscitation, and Vascular Control, falling to chance in Critical Care and Outcomes and Systems, Technology, and Process Optimization. 142 (54.6%) reached publication at a mean of 13.4 months. Multicenter origin was the only independent predictor (P = .02). Hispanic investigators were underrepresented among first (P = .03) and senior (P = .01) authors, absent from the published Hemorrhage, Resuscitation, and Vascular Control subset.DiscussionThe model predicted publication where scientific content carried the signal and fell to chance where advancement depended on institutional factors absent from the poster-multicenter scaffolding, mentorship, and senior author fluency. Publication is determined jointly by what is legible on the page and structural advantage the model cannot read.

PMID:
42740422
Bibliographic data and abstract were imported from PubMed on 15 Sep 2026.

Read full publication at:
Please sign in to see all details.

Stats

1-terrible, 9-excellent. How would you rate this publication? Sign in in to submit your rating.

Post a comment

You need to be signed in to post comments. You can sign in here.

Comments

There are no comments yet.