计算机科学
人工智能
一般化
图像复原
融合机制
利用
编码(集合论)
特征提取
特征(语言学)
图像融合
图像(数学)
机器学习
还原(数学)
模式识别(心理学)
缩小
可视化
源代码
连贯性(哲学赌博策略)
图像处理
钥匙(锁)
计算机视觉
降级(电信)
数据挖掘
背景(考古学)
实体造型
人工神经网络
门控
机制(生物学)
光学(聚焦)
图像分割
灵活性(工程)
绩效改进
上下文模型
任务分析
网络体系结构
数据建模
作者
Yongzhen Wang,Yongjun Li,Zhuoran Zheng,Xiao–Ping Zhang,Mingqiang Wei
标识
DOI:10.1109/tip.2025.3638662
摘要
Natural images are often degraded by complex, composite degradations such as rain, snow, and haze, which adversely impact downstream vision applications. While existing image restoration efforts have achieved notable success, they are still hindered by two critical challenges: limited generalization across dynamically varying degradation scenarios and a suboptimal balance between preserving local details and modeling global dependencies. To overcome these challenges, we propose M2Restore, a novel Mixture-of-Experts (MoE)-based Mamba-CNN fusion framework for efficient and robust all-in-one image restoration. M2Restore introduces three key contributions: First, to boost the model's generalization across diverse degradation conditions, we exploit a CLIP-guided MoE gating mechanism that fuses task-conditioned prompts with CLIP-derived semantic priors. This mechanism is further refined via cross-modal feature calibration, which enables precise expert selection for various degradation types. Second, to jointly capture global contextual dependencies and fine-grained local details, we design a dual-stream architecture that integrates the localized representational strength of CNNs with the long-range modeling efficiency of Mamba. This integration enables collaborative optimization of global semantic relationships and local structural fidelity, preserving global coherence while enhancing detail restoration. Third, we introduce an edge-aware dynamic gating mechanism that adaptively balances global modeling and local enhancement by reallocating computational attention to degradation-sensitive regions. This targeted focus leads to more efficient and precise restoration. Extensive experiments across multiple image restoration benchmarks validate the superiority of M2Restore in both visual quality and quantitative performance. Code is available at https://github.com/yz-wang/M2Restore.
科研通智能强力驱动
Strongly Powered by AbleSci AI