Implementation of an artificial intelligence-based system for mammography in the compulsory medical insurance program: results of a 3-year study.

Authors

Yuriy Vasilev, Denis Rumyantsev, Anton Vladzymyrskyy, Olga Omelyanskaya, Kirill Arzamasov, Alexander Bazhin, Lev Pestrenin, Larisa Rodionova, Ilya Naletov, Arina Varlamova, Valery Belotsky, Emilia Starikova

Published in

Quantitative imaging in medicine and surgery. Volume 16. Issue 9. Pages 734. Sep 01, 2026. Epub Aug 10, 2026.

Abstract

The integration of artificial intelligence (AI) into mammography holds significant potential for addressing the increasing workload and radiologist burnout, yet its widespread clinical adoption is hindered by critical limitations in current validation practices. Existing frameworks frequently fail to account for AI's dynamic evolution through retraining, data heterogeneity, and real-world deployment within healthcare systems such as compulsory medical insurance (CMI). This study aims to ensure continuous quality control of a mammography AI solution during its implementation in the CMI system by applying a novel lifecycle-based testing and monitoring methodology that addresses these specific gaps.
The observational study incorporated retrospective functional and calibration testing, alongside prospective technical and clinical monitoring, interspersed with AI system updates. Anonymized digital mammograms from women aged ≥18 years underwent analysis. Prospective monitoring included all mammograms from participating sites (no exclusion criteria), capturing continuous real-world clinical data. The mammography AI system utilized U-Net++ and Mask2Former architectures, trained on ~4,000 mammograms. Key metrics encompassed area under the curve (AUC), accuracy, sensitivity, specificity, technical defect rates, and clinical assessment scores.
The test dataset comprised 404,502 mammograms from 206 medical organizations and three mammography equipment manufacturers. A total of 336 radiologists participated. The testing and monitoring period lasted 2 years and 5 months. Over this time, AUC increased by 10.8% (from 0.83 to 0.92), accuracy by 16.9% (from 0.77 to 0.90), sensitivity by 4.8% (from 0.84 to 0.88), and specificity by 30.0% (from 0.70 to 0.91). The average technical defect rate decreased by 26.7% (from 3.0% to 0.8%), and the clinical assessment score rose by 47.8% (from 54.38% to 80.36%). The study culminated in the integration of the AI system into the regional CMI program. A key limitation of this study is the relatively small retrospective calibration testing dataset (100 mammograms) and the lack of external validation on independent datasets from other regions or countries.
Iterative testing with prospective real-world monitoring, interleaved developer updates, and radiologist feedback substantially enhanced mammography AI performance. This lifecycle testing methodology demonstrates feasibility for clinical integration and CMI program deployment, balancing rigorous validation with continuous improvement. Future work will focus on expanding the retrospective calibration testing dataset and scaling the approach to a national level within the CMI framework.

PMID:
42701602
Bibliographic data and abstract were imported from PubMed on 06 Sep 2026.

Read full publication at:
Please sign in to see all details.

Stats

1-terrible, 9-excellent. How would you rate this publication? Sign in in to submit your rating.

Post a comment

You need to be signed in to post comments. You can sign in here.

Comments

There are no comments yet.