Toward Generalized and Realistic Unpaired Image Dehazing via Region-Aware Physical Constraints

计算机科学 图像(数学) 计算机视觉 人工智能 图像处理
作者
Kaihao Lin,Guoqing Wang,Tianyu Li,Yuhui Wu,Chong Li,Yang Yang,Heng Tao Shen
出处
期刊:IEEE Transactions on Circuits and Systems for Video Technology [Institute of Electrical and Electronics Engineers]
卷期号:35 (3): 2753-2767 被引量:10
标识
DOI:10.1109/tcsvt.2024.3497594
摘要

Supervised dehazing models, trained on synthetic hazy-clean image pairs, often face a notable decline in performance when applied to real-world scenes. Consequently, CycleGAN-based unpaired dehazing methods are proposed to improve the model’s generalization. One successful approach among these methods involves decomposing the physical properties of the atmospheric scattering model (ASM). However, estimating physical properties individually from input images is difficult without supervised labels, which ignores the semantic consistency between different physical regions. We claim semantic region information can offer additional geometric spatial constraints for estimating physical properties, as natural images can be divided into regions with similar scene depths. Motivated by this, we propose a novel generalized and realistic unpaired image dehazing framework via region-aware physical constraints (RPC-Dehaze). Our approach utilizes fine-grained semantic region maps from the Segment Anything Model (SAM) in a specially designed region prompt enhancement module. This enables the dehazing and hazing cyclic networks to learn region-aware physical constraints, leading to accurate estimation of haze imaging physical properties. In contrast to existing unpaired methods that treat dehazing and hazing networks equally, we incorporate Retinex theory into the hazing network, allowing it to learn diverse illumination effects in different regions. We adaptively refine the Retinex-based illumination component, resulting in more realistic hazy images. To further facilitate unsupervised learning in our framework, we propose a physical consensual contrastive regularization to ensure compact representation constraints in the latent feature space. Extensive experiments on synthetic and real image datasets show our method surpasses state-of-the-art unpaired dehazing methods in both effectiveness and generalization capability.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
刚刚
1秒前
3秒前
伏玉完成签到,获得积分10
3秒前
3秒前
慕青的应助被Paradox采纳,获得10
4秒前
4秒前
张谋发布了新的文献求助10
4秒前
樱三枫完成签到,获得积分10
5秒前
6秒前
TYM发布了新的文献求助10
7秒前
7秒前
shangchen发布了新的文献求助10
7秒前
8秒前
樱三枫发布了新的文献求助10
8秒前
8秒前
Onepiece完成签到 ,获得积分10
8秒前
9秒前
10秒前
10秒前
LIU发布了新的文献求助10
10秒前
建辰十五发布了新的文献求助10
11秒前
11秒前
Noor发布了新的文献求助10
12秒前
12秒前
SU完成签到,获得积分10
12秒前
zou完成签到,获得积分10
13秒前
yaozi发布了新的文献求助10
13秒前
christinao发布了新的文献求助10
13秒前
14秒前
14秒前
王亚娟发布了新的文献求助10
15秒前
15秒前
dong发布了新的文献求助10
16秒前
洋葱头完成签到,获得积分10
16秒前
chun完成签到,获得积分20
16秒前
超级飞侠完成签到,获得积分10
17秒前
17秒前
yaozi完成签到,获得积分10
18秒前
csy发布了新的文献求助10
18秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
Aspects of Post-SPE Phonology 2000
CLSI VET01S Ed7 Performance Standards for Antimicrobial Disk and Dilution Susceptibility Tests for Bacteria Isolated From Animals 1000
Performance standards for antimicrobial disk and dilution susceptibility tests for bacteria isolated from animals 888
Rosenblum, Global Change Biology 800
Holistic Discourse Analysis, Second Edition by Robert E. Longacre (2012-09-10) 666
Berberine regulates the TLR4 signaling pathway to suppress hypoxia-induced proliferation and migration of pulmonary arterial smooth muscle cells 530
热门求助领域 (近24小时)
化学 材料科学 医学 生物 计算机科学 工程类 纳米技术 物理 有机化学 化学工程 内科学 生物化学 复合材料 催化作用 心理学 细胞生物学 无机化学 电极 光电子学 人工智能
热门帖子
关注 科研通微信公众号,转发送积分 7867065
求助须知:如何正确求助?哪些是违规求助? 9384111
关于积分的说明 20747347
捐赠科研通 7467624
什么是DOI,文献DOI怎么找? 3349536
关于科研通互助平台的介绍 2490729
邀请新用户注册赠送积分活动 2375072