Analyzing Online Discourse of Retrograde Cricopharyngeal Dysfunction: A Human-Validated LLM Study.

Authors

Spencer T Johnson, Nancy Jiang

Published in

Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery. Oct 29, 2026. Epub Oct 29, 2026.

Abstract

Perform a human-validated large language model (LLM) analysis of an online Reddit community dedicated to retrograde cricopharyngeal dysfunction (R-CPD), characterizing common themes, symptoms, treatment experiences, and diagnostic barriers.
Cross-sectional, observational analysis of patient-generated online discourse using LLM-based thematic classification validated against human adjudication.
r/NoBurp, a public Reddit community dedicated to R-CPD.
All posts from March 2014 to December 2025 were extracted and deduplicated. A 400-post subset was human-adjudicated to establish a reference standard for interrater comparison (precision, recall, F1 score, Cohen's kappa). All posts were analyzed with ChatGPT-5.2 for theme identification, temporal trends, symptoms frequency, and sentiment analysis. A bibliometric analysis compared annual R-CPD publication volume to annual Reddit post volume.
20,299 unique posts were analyzed. The five dominant themes were core symptom burden (56.5%), treatment experience (53.3%), healthcare navigation (26.0%), self-management (15.2%), and reflux-related symptoms (12.5%). Annual post volume rose sharply years before the major increase in R-CPD-related publications. Interrater agreement was high for botulinum toxin/procedural treatment (k = 0.70, 95% CI [0.64-0.77], F1 = 0.81), moderate for core symptom burden (k = 0.44, 95% CI [0.36-0.52], F1 = 0.77), and slight-to-fair for diagnostic journey/healthcare navigation (k = 0.22, 95% CI [0.15-0.29], F1 = 0.38).
Patients experience prolonged diagnostic journeys marked by clinician unfamiliarity with R-CPD, often identifying their condition through online communities. Rising patient discourse preceded growth in the published literature, suggesting that r/NoBurp functioned not only as a support forum but also as an accelerator of R-CPD research.

PMID:
42958846
Bibliographic data and abstract were imported from PubMed on 30 Oct 2026.

Read full publication at:
Please sign in to see all details.

Stats

1-terrible, 9-excellent. How would you rate this publication? Sign in in to submit your rating.

Post a comment

You need to be signed in to post comments. You can sign in here.

Comments

There are no comments yet.