Authors
Haojie Qin, Enhao Fu, Yongchao Yang, Yawen Liu, Mingzhu Jia, Zhiling Tian, Zhe Zheng, Siyun Guo, Ningguo Liu
Published in
Fa yi xue za zhi. Volume 42. Issue 2. Pages 102-111. Apr 25, 2026.
Abstract
To construct a multimodal forensic pathology database based on artificial intelligence (AI) technology and explore methods for integrating pre-trained models into multimodal databases.
A hybrid storage architecture consisting of MySQL, Redis and OSS was employed to manage desensitized multimodal data. Data entry was optimized using optical character recognition (OCR) and natural language processing (NLP) technologies. OCR performance was evaluated and optimized using cosine distance, character error rate (CER), and word error rate (WER) to meet practical operational requirements. An intelligent retrieval model was developed using the ChatGLM3-6B model and retrieval-augmented generation (RAG) technology. Model performance was evaluated using ranking metrics including Precision@K, Recall@K, discounted cumulative gain (DCG), and normalized discounted cumulative gain (NDCG).
The database demonstrated satisfactory baseline performance. The response times were maintained within 150 ms for single-query condition and within 2 s for multiple-query conditions. The average disk read throughput reached 950 MB/s. In concurrent performance tests, the database achieved a maximum throughput of 1 200 queries per second (QPS), meeting multimodal data management demands. OCR evaluation showed high recognition accuracy; for high-quality documents, the cosine distance, CER, and WER achieved 0.02, 1.5%, and 3.2%, respectively. Intelligent retrieval results indicated that Precision@K remained consistently high (0.69-1.00), while NDCG values remained above 0.87 for all evaluations. When K=100, the NDCG surpassed 0.95 for all queries, meeting expected performance requirements.
The multimodal forensic pathology database constructed in this study demonstrates good stability and operational efficiency and can meet the requirements of routine forensic practice for multimodal data storage, management, and analysis. The intelligent retrieval capabilities, based on pre-trained large language models (LLMs), can be applied to conversational information retrieval from forensic reports and related documents, providing a novel approach to the management and analysis of multimodal databases.
PMID:
42442826
Bibliographic data and abstract were imported from PubMed on 14 Jul 2026.
Read full publication at:
Please sign in
to see all details.
Advertisement
Stats
- Recommendations n/a n/a positive of 0 vote(s)
- Views 7
- Comments 0