Cross Paradigm Representation and Alignment Transformer for Image Deraining

计算机科学 稳健性(进化) 人工智能 变压器 代表(政治) 模式识别(心理学) 特征提取 计算机视觉 特征学习 像素 水准点(测量) 融合 图像融合 图像纹理 频道(广播) 特征(语言学) 图像(数学) 填写 传感器融合 空间分析 数据挖掘 图像处理
作者
Shasha Zou,Yi Zou,Juncheng Li,Guangwei Gao,Guo-Jun Qi
标识
DOI:10.48550/arxiv.2504.16455
摘要

Transformer-based networks have achieved strong performance in low-level vision tasks like image deraining by utilizing spatial or channel-wise self-attention. However, irregular rain patterns and complex geometric overlaps challenge single-paradigm architectures, necessitating a unified framework to integrate complementary global-local and spatial-channel representations. To address this, we propose a novel Cross Paradigm Representation and Alignment Transformer (CPRAformer). Its core idea is the hierarchical representation and alignment, leveraging the strengths of both paradigms (spatial-channel and global-local) to aid image reconstruction. It bridges the gap within and between paradigms, aligning and coordinating them to enable deep interaction and fusion of features. Specifically, we use two types of self-attention in the Transformer blocks: sparse prompt channel self-attention (SPC-SA) and spatial pixel refinement self-attention (SPR-SA). SPC-SA enhances global channel dependencies through dynamic sparsity, while SPR-SA focuses on spatial rain distribution and fine-grained texture recovery. To address the feature misalignment and knowledge differences between them, we introduce the Adaptive Alignment Frequency Module (AAFM), which aligns and interacts with features in a two-stage progressive manner, enabling adaptive guidance and complementarity. This reduces the information gap within and between paradigms. Through this unified cross-paradigm dynamic interaction framework, we achieve the extraction of the most valuable interactive fusion information from the two paradigms. Extensive experiments demonstrate that our model achieves state-of-the-art performance on eight benchmark datasets and further validates CPRAformer's robustness in other image restoration tasks and downstream applications.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
刚刚
英俊的铭应助蔚亭采纳,获得10
刚刚
rtaxa完成签到,获得积分0
刚刚
顾矜应助momo采纳,获得10
刚刚
CC完成签到,获得积分10
刚刚
刚刚
清秋发布了新的文献求助10
刚刚
1秒前
FW桥发布了新的文献求助10
2秒前
英姑应助炙热奇异果采纳,获得10
2秒前
六水居士完成签到,获得积分10
2秒前
2秒前
TT发布了新的文献求助10
2秒前
HIT_C完成签到 ,获得积分10
3秒前
公子渔发布了新的文献求助10
3秒前
4秒前
匹诺曹完成签到,获得积分10
4秒前
求思东观令完成签到,获得积分10
4秒前
科研通AI2S应助张晓倩采纳,获得10
5秒前
5秒前
cuiyiyi发布了新的文献求助10
5秒前
5秒前
5秒前
Missy完成签到,获得积分10
6秒前
李爱国应助清秋采纳,获得10
6秒前
淮浦完成签到,获得积分10
6秒前
睡呀完成签到,获得积分10
7秒前
陈宇华完成签到,获得积分10
7秒前
bkagyin应助甚也采纳,获得10
7秒前
彭于晏应助学术蝗虫采纳,获得10
7秒前
YANJie完成签到,获得积分10
8秒前
8秒前
Babe应助KYT80153841采纳,获得10
9秒前
科研通AI6.4应助咸鱼咸采纳,获得10
9秒前
CY完成签到,获得积分10
10秒前
aidiiiiisk完成签到 ,获得积分10
10秒前
Tugeouc发布了新的文献求助10
11秒前
虚幻三问发布了新的文献求助10
11秒前
11秒前
年过半摆应助阿飞采纳,获得20
11秒前
高分求助中
Clinical Epidemiology: The Essentials, 6e 10000
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
The Graphene Handbook (2019 Edition) 800
Adhesion Science: Principles & Practice 800
Signals, Systems, and Signal Processing 610
IEST-RP-CC018: Cleanroom Cleaning and Sanitization: Operating and Monitoring Procedures 600
Fundamentals of Pharmaceutical and Biologics Regulations: A Global Perspective, Second Edition 600
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 工程类 有机化学 化学工程 生物化学 计算机科学 物理 内科学 复合材料 催化作用 物理化学 光电子学 电极 细胞生物学 基因 无机化学
热门帖子
关注 科研通微信公众号,转发送积分 6539791
求助须知:如何正确求助?哪些是违规求助? 8331088
关于积分的说明 17852241
捐赠科研通 5644699
什么是DOI,文献DOI怎么找? 2935929
邀请新用户注册赠送积分活动 1912063
关于科研通互助平台的介绍 1772700