计算机科学
人工智能
卷积神经网络
特征(语言学)
编码(集合论)
模式识别(心理学)
基本事实
增采样
图像(数学)
光学(聚焦)
图像分辨率
领域(数学)
卷积(计算机科学)
计算机视觉
人工神经网络
数学
语言学
集合(抽象数据类型)
物理
哲学
程序设计语言
光学
纯数学
作者
Qing Cai,Jinxing Li,Huafeng Li,Yee‐Hong Yang,Feng Wu,David Zhang
标识
DOI:10.1109/tip.2022.3154614
摘要
Single image super-resolution (SISR) using deep convolutional neural networks (CNNs) achieves the state-of-the-art performance. Most existing SISR models mainly focus on pursuing high peak signal-to-noise ratio (PSNR) and neglect textures and details. As a result, the recovered images are often perceptually unpleasant. To address this issue, in this paper, we propose a texture and detail-preserving network (TDPN), which focuses not only on local region feature recovery but also on preserving textures and details. Specifically, the high-resolution image is recovered from its corresponding low-resolution input in two branches. First, a multi-reception field based branch is designed to let the network fully learn local region features by adaptively selecting local region features in different reception fields. Then, a texture and detail-learning branch supervised by the textures and details decomposed from the ground-truth high resolution image is proposed to provide additional textures and details for the super-resolution process to improve the perceptual quality. Finally, we introduce a gradient loss into the SISR field and define a novel hybrid loss to strengthen boundary information recovery and to avoid overly smooth boundary in the final recovered high-resolution image caused by using only the MAE loss. More importantly, the proposed method is model-agnostic, which can be applied to most off-the-shelf SISR networks. The experimental results on public datasets demonstrate the superiority of our TDPN on most state-of-the-art SISR methods in PSNR, SSIM and perceptual quality. We will share our code on https://github.com/tocaiqing/TDPN.
科研通智能强力驱动
Strongly Powered by AbleSci AI