人工智能
计算机视觉
计算机科学
图像分割
分割
模式识别(心理学)
尺度空间分割
医学影像学
图像处理
图像(数学)
特征提取
适应(眼睛)
基于分割的对象分类
噪音(视频)
特征(语言学)
可视化
图像纹理
作者
Yuan Xuejia,Zongjian Yang,Yu Guo,Fanhui Kong,Jiquan Ma
标识
DOI:10.1109/tbme.2026.3731109
摘要
OBJECTIVE: Foundation models such as MedSAM2 achieve strong zero-shot segmentation, but standard fine-tuning updates 11.73 M parameters, limiting deployment in resource-constrained clinical environments. Existing parameter-efficient fine-tuning (PEFT) methods typically focus on reducing storage cost, with less attention to computational complexity and inference latency. We aim to adapt MedSAM2 to 2D clinical modalities with near-transparent overhead across parameters, FLOPs, and latency. METHODS: We propose PE-MedSAM2, a lightweight adaptation framework organizing four complementary modules along two orthogonal axes (channel vs. spatial; feature enhancement vs. computation reduction): a Low-Rank Adapter (LRA) for domain transfer with 0.002 M parameters; a Parameter-Free Feature Enhancement (PFFE) module that uses fixed multi-scale gradient operators to extract high-frequency spatial priors without learnable parameters; an Ultra-Lightweight Adapter (ULA) that decouples spatial and channel transformations via depthwise separable convolutions; and a Dynamic Sparse Attention (DSA) module that concentrates attention on gradient-guided salient tokens. RESULTS: Across five RGB- like 2D benchmarks spanning polyps, skin lesions, and cell nuclei, PE-MedSAM2 attains the highest Dice similarity coefficient on four and the best average surface distance on four of five; on a sixth benchmark, chest radiography, it again improves over its MedSAM2 baseline. Relative to MedSAM2, the framework adds only 0.294 M trainable parameters, 0.89 G MACs (+0.7%), and roughly 1.2 ms latency. CONCLUSION: Multi-dimensional lightweight modules can reconcile segmentation quality with strict computational budgets when adapting video-centric foundation models to 2D clinical data. SIGNIFICANCE: PE-MedSAM2 enables deployment of foundation-model-based segmentation in resource-constrained clinical settings while maintaining competitive contour fidelity. Code is available at https://github.com/Yexika/PE-MedSAM2.
科研通智能强力驱动
Strongly Powered by AbleSci AI