Hiring in life sciences? Share your open positions with our professional community. Read more Close

Advertisement

Circular validation in diagnostic research: re-examination of a widely cited study on primary hemostasis screening.

Created on 13 Nov 2026

Authors

Andreas Calatzis, Michael Spannagl, Georg Wittmann

Published in

Frontiers in medicine. Volume 13. Pages 1909484. Epub Oct 29, 2026.

Abstract

A 2004 study reported high sensitivities for laboratory assays used in the preoperative detection of primary hemostasis disorders and has since been widely cited. A re-evaluation of its methodological validity is performed.
The study design and calculations were reviewed focusing on the definition of "impaired hemostasis" and the derivation of diagnostic performance. A synthetic dataset of random values was generated, and assay-specific cut-offs were defined to reproduce the proportions of positive results reported in the original study. The detection of "impaired hemostasis" was then calculated using a self-referential approach.
Three sets of performance figures are provided in the 2004 study. In one set, the results of the evaluated tests were used to define the reference standard against which their own sensitivities and specificities were then calculated (incorporation bias). For one assay a second set of performance figures was reported. The index test had been performed first in all patients; the further diagnostic work-up and the classification of clinical findings depended on its result (verification bias). The cut-off used for the index test was determined post hoc by ROC analysis, which often inflates performance metrics. The sensitivity and specificity values reported for the individual questionnaire items are likewise affected by incorporation bias. The synthetic dataset reproduced the reported detection rates despite consisting of random numbers.
The widely cited results of the 2004 study cannot be used as evidence of diagnostic accuracy, because the reference standard was established using the very tests whose performance was then evaluated against it.

PMID:
43021824
Bibliographic data and abstract were imported from PubMed on 13 Nov 2026.

Read full publication at:
Please sign in to see all details.

Advertisement

Stats

  • Community rating n/a 0 votes
  • Reviewers' rating n/a 0 votes
  • Your rating

1-terrible, 9-excellent. How would you rate this publication? Sign in in to submit your rating.

  • Recommendations n/a n/a positive of 0 vote(s)
  • Views 9
  • Comments 0

Recommended by

  • No recommendations yet.

Post a comment

You need to be signed in to post comments. You can sign in here.

Comments

There are no comments yet.

Advertisement