计算机科学
人工智能
一般化
图像质量
人工神经网络
领域知识
质量(理念)
场景统计
机器学习
图像(数学)
注释
深度学习
模式识别(心理学)
计算机视觉
感知
数学
数学分析
哲学
认识论
神经科学
生物
作者
Tianshu Song,Leida Li,Jinjian Wu,Yuzhe Yang,Yaqian Li,Yandong Guo,Guangming Shi
标识
DOI:10.1109/tmm.2022.3233244
摘要
Blind image quality assessment (BIQA) for in-the-wild images has achieved great progress by training advanced deep neural networks. However, the current BIQA models are suffering the generalization challenge, meaning that a well-trained BIQA model is still very limited in evaluating images with different distributions. Deep BIQA models are data-intensive, but the annotation of image quality labels is extremely expensive. To design a generalizable BIQA model with few training samples is highly desired. Motivated by the above fact, this paper presents a knowledge-guided BIQA (KG-IQA) framework by integrating domain knowledge from the human visual system (HVS) and natural scene statistics (NSS). Specifically, the quality-aware HVS and NSS features are first extracted as prior knowledge. Then, we embed the two types of knowledge into the conventional deep neural network by learning to predict the HVS and NSS features, producing the knowledge-enhanced quality features, based on which the final image quality score is obtained. We conduct extensive experiments and comparisons on five authentically distorted IQA datasets. The experimental results demonstrate that the introduction of knowledge greatly reduces the requirement on the amount of training images, and the proposed KG-IQA model achieves superior performance in terms of both prediction accuracy and generalization ability.
科研通智能强力驱动
Strongly Powered by AbleSci AI