计算机科学
可解释性
人工智能
像素
模式识别(心理学)
编码(集合论)
安全性令牌
图像分辨率
图像(数学)
计算机视觉
计算机安全
集合(抽象数据类型)
程序设计语言
作者
Aiping Zhang,Wenqi Ren,Yi Liu,Xiaochun Cao
出处
期刊:
[Institute of Electrical and Electronics Engineers]
日期:2023-10-01
卷期号:: 12682-12691
被引量:10
标识
DOI:10.1109/iccv51070.2023.01169
摘要
Transformer-based methods have demonstrated impressive results on single-image super-resolution (SISR) task. However, self-attention mechanism is computationally expensive when applied to the entire image. As a result, current approaches divide low-resolution input images into small patches, which are processed separately and then fused to generate high-resolution images. Nevertheless, this conventional regular patch division is too coarse and lacks interpretability, resulting in artifacts and non-similar structure interference during attention operations. To address these challenges, we propose a novel super token interaction network (SPIN). Our method employs superpixels to cluster local similar pixels to form the explicable local regions and utilizes intra-superpixel attention to enable local information interaction. It is interpretable because only similar regions complement each other and dissimilar regions are excluded. Moreover, we design a super-pixel cross-attention module to facilitate information propagation via the surrogation of superpixels. Extensive experiments demonstrate that the proposed SPIN model performs favorably against the state-of-the-art SR methods in terms of accuracy and lightweight. Code is available at https://github.com/ArcticHare105/SPIN.
科研通智能强力驱动
Strongly Powered by AbleSci AI