Hiring in life sciences? Share your open positions with our professional community. Read more Close

Advertisement

Quantifying the prevalence and impact of overreaching causal claims in social science.

Created on 25 Aug 2026

Authors

Calvin Isch, Timothy Dörr, Neil Fasching, Grace Jennings, Duncan J Watts

Published in

Nature human behaviour. Aug 24, 2026. Epub Aug 24, 2026.

Abstract

Across the social sciences, many studies use cross-sectional designs that reveal associations but are generally unable to support direct causal claims, yet authors of such articles may make or imply causal claims anyway. Here, to examine the prevalence of such 'overreaching' causal language, we analysed 194,631 cross-sectional articles using large language models. Over the period 1980-2024, an average of 46% of articles contained causal language in their titles or abstracts, where the annual rate has risen almost threefold since 2000 from 20% to 60%. To examine the effects of such language, we conducted a human-subjects experiment (N = 1, 105), finding that readers frequently indicate abstracts with this phrasing provide causal evidence but that methodological labels (β = -0.4, 95% confidence interval -0.56 to -0.19) and associational wording (β = -0.3, 95% confidence interval -0.43 to -0.07) reduce this tendency. Experiments with five LLMs revealed that model summaries of these articles (N = 100 each) can amplify causal overstatement, removing hedges and introducing causal claims where articles used strictly associational phrasing; however, prompting caution diminishes this pattern.

PMID:
42637914
Bibliographic data and abstract were imported from PubMed on 25 Aug 2026.

Read full publication at:
Please sign in to see all details.

Advertisement

Stats

  • Community rating n/a 0 votes
  • Reviewers' rating n/a 0 votes
  • Your rating

1-terrible, 9-excellent. How would you rate this publication? Sign in in to submit your rating.

  • Recommendations n/a n/a positive of 0 vote(s)
  • Views 94
  • Comments 0

Recommended by

  • No recommendations yet.

Post a comment

You need to be signed in to post comments. You can sign in here.

Comments

There are no comments yet.

Advertisement