计算机科学
人工智能
像素
脱模
彩色滤光片阵列
多光谱图像
图像处理
计算机视觉
特征(语言学)
模式识别(心理学)
卷积(计算机科学)
图像(数学)
人工神经网络
彩色凝胶
彩色图像
图层(电子)
化学
语言学
哲学
有机化学
薄膜晶体管
作者
Kai Feng,Yongqiang Zhao,Jonathan Cheung-Wai Chan,Seong G. Kong,Xun Zhang,Binglu Wang
标识
DOI:10.1109/tci.2021.3102052
摘要
This paper presents a mosaic convolution-attention network (MCAN) for demosaicing spectral mosaic images captured using multispectral filter array (MSFA) imaging sensors. MSFA-based multispectral imaging systems acquire multispectral information of a scene in a single snap-shot operation. A complete multispectral image is reconstructed by demosaicing an MSFA-based spectral mosaic image. To avoid aliasing and artifacts in demosaicing, we utilize joint spatial-spectral correlation in a raw mosaic image. The proposed MCAN includes a mosaic convolution module (MCM) and a mosaic attention module (MAM). The MCM extracts features via a learning approach with a margin between splitting the periodic spectral mosaic and keeping the underlying spatial information of the raw image. Based on the strategy of position-sensitive weight sharing, MCM assigns the same weight to pixels with the same relative position in an MSFA. The MAM uses a position-sensitive feature aggregation strategy to describe the loading of mosaic patterns within the feature maps, which gradually reduces mosaic distortion through the attention mechanism. The experimental results on synthetic as well as real-world data show that the proposed scheme outperforms state-of-the-art methods in terms of spatial details and spectral fidelity.
科研通智能强力驱动
Strongly Powered by AbleSci AI