PE-MedSAM2: Parameter-Efficient Adaptation of MedSAM2 for 2D Medical Image Segmentation.

Authors

Xuejia Yuan, Zongjian Yang, Yu Guo, Fanhui Kong, Jiquan Ma

Published in

IEEE transactions on bio-medical engineering. Volume PP. Sep 07, 2026. Epub Sep 07, 2026.

Abstract

Foundation models such as MedSAM2 achieve strong zero-shot segmentation, but standard fine-tuning updates 11.73 M parameters, limiting deployment in resource-constrained clinical environments. Existing parameter-efficient fine-tuning (PEFT) methods typically focus on reducing storage cost, with less attention to computational complexity and inference latency. We aim to adapt MedSAM2 to 2D clinical modalities with near-transparent overhead across parameters, FLOPs, and latency.
We propose PE-MedSAM2, a lightweight adaptation framework organizing four complementary modules along two orthogonal axes (channel vs. spatial; feature enhancement vs. computation reduction): a Low-Rank Adapter (LRA) for domain transfer with 0.002 M parameters; a Parameter-Free Feature Enhancement (PFFE) module that uses fixed multi-scale gradient operators to extract high-frequency spatial priors without learnable parameters; an Ultra-Lightweight Adapter (ULA) that decouples spatial and channel transformations via depthwise separable convolutions; and a Dynamic Sparse Attention (DSA) module that concentrates attention on gradient-guided salient tokens.
Across five RGB- like 2D benchmarks spanning polyps, skin lesions, and cell nuclei, PE-MedSAM2 attains the highest Dice similarity coefficient on four and the best average surface distance on four of five; on a sixth benchmark, chest radiography, it again improves over its MedSAM2 baseline. Relative to MedSAM2, the framework adds only 0.294 M trainable parameters, 0.89 G MACs (+0.7%), and roughly 1.2 ms latency.
Multi-dimensional lightweight modules can reconcile segmentation quality with strict computational budgets when adapting video-centric foundation models to 2D clinical data.
PE-MedSAM2 enables deployment of foundation-model-based segmentation in resource-constrained clinical settings while maintaining competitive contour fidelity. Code is available at https://github.com/Yexika/PE-MedSAM2.

PMID:
42704794
Bibliographic data and abstract were imported from PubMed on 08 Sep 2026.

Read full publication at:
Please sign in to see all details.

Stats

1-terrible, 9-excellent. How would you rate this publication? Sign in in to submit your rating.

Post a comment

You need to be signed in to post comments. You can sign in here.

Comments

There are no comments yet.