D3PM: Dual-Stream Denoising Diffusion Probabilistic Model for Change Detection in Multimodal Remote Sensing Images

概率逻辑 遥感 计算机科学 变更检测 降噪 扩散 图像去噪 对偶(语法数字) 人工智能 计算机视觉 模式识别(心理学) 地质学 热力学 物理 文学类 艺术
作者
Fenlong Jiang,Xinlong Huo,Mingyang Zhang,Maoguo Gong,Yan Pu,Yu Zhou,Wei Zhao,Ziyu Guan
出处
期刊:IEEE Transactions on Geoscience and Remote Sensing [Institute of Electrical and Electronics Engineers]
卷期号:63: 1-15 被引量:5
标识
DOI:10.1109/tgrs.2025.3564959
摘要

Detecting land cover changes from multi-temporal and multi-modal remote sensing images acquired by different sensors at the same location is a complex yet highly valuable task. Recently, diffusion models, exemplified by the Denoising Diffusion Probabilistic Model (DDPM), have garnered significant attention for their remarkable performance and straightforward architecture. These models excel in image generation, distribution modeling, and feature extraction, making them highly promising for advancing Multimodal Change Detection (MCD). In this paper, we propose a Dual-stream Denoising Diffusion Probabilistic Model (D3PM) to address the challenges of MCD. Specifically, D3PM leverages DDPM to design two distinct processing streams, one for each image modality. The first stream employs an unconditional DDPM, whose denoising encoder-decoder network can achieve robust feature extraction. The second stream employs a conditional DDPM to facilitate modal translation, enabling the extracted features to align with the characteristics of the other modality, thereby improving cross-modality comparability. To further enhance performance, we constructed a CD task branch based on the decoder features of the two DDPMs across multiple denoising time steps. Additionally, we designed a collaborative learning optimization strategy with asynchronous time steps, fostering cross-task knowledge sharing and mutual enhancement while preserving the integrity of individual task learning. Experimental results on multiple public datasets demonstrate the effectiveness and superiority of the proposed D3PM, which achieves efficient modal transformation and alignment, mitigates modal heterogeneity interference, and significantly improves detection performance.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
共享精神应助生动枫采纳,获得10
刚刚
贝贝托完成签到,获得积分10
刚刚
诚心明杰关注了科研通微信公众号
1秒前
雪落发布了新的文献求助10
1秒前
尔尔完成签到,获得积分10
1秒前
Ning完成签到,获得积分10
2秒前
2秒前
木子完成签到,获得积分10
3秒前
yuanfangyi0306完成签到,获得积分10
3秒前
暴躁的凌柏完成签到 ,获得积分10
3秒前
不安的面包完成签到,获得积分10
3秒前
谭佳文完成签到,获得积分20
4秒前
xk完成签到,获得积分10
4秒前
李爱波完成签到,获得积分10
4秒前
4秒前
5秒前
zoey发布了新的文献求助10
5秒前
ding应助鳕鱼采纳,获得10
5秒前
大一京城完成签到 ,获得积分10
5秒前
董婷婷完成签到,获得积分20
5秒前
5秒前
光亮向真完成签到,获得积分10
5秒前
5秒前
6秒前
香蕉觅云应助取个名儿吧采纳,获得10
6秒前
贪玩水蜜桃完成签到,获得积分10
6秒前
DH发布了新的文献求助10
6秒前
今后应助汪天宇采纳,获得10
7秒前
段asd完成签到,获得积分20
7秒前
李爱波发布了新的文献求助10
8秒前
ip07in13完成签到,获得积分10
8秒前
丘比特应助刘旭成采纳,获得10
8秒前
keyanbaicai完成签到,获得积分10
8秒前
9秒前
舒克发布了新的文献求助10
9秒前
xjx完成签到,获得积分10
9秒前
lizhiqian2024发布了新的文献求助10
9秒前
emma发布了新的文献求助10
9秒前
9秒前
9秒前
高分求助中
Principles of Economics, 11th Edition 10000
University Physics with Modern Physics, 16th edition 10000
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
Arthritis and Related Conditions, An Issue of Orthopedic Clinics 1000
Development of a Bridge Weigh-In-Motion System: A technology to convert the bridge response to the passage of traffic into data on vehicle configurations, speeds, times of travel and weights 1000
ズームレンズの光学設計に関する研究 800
Fundamentals of Pharmaceutical and Biologics Regulations: A Global Perspective, Second Edition 700
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 工程类 有机化学 化学工程 生物化学 计算机科学 内科学 物理 复合材料 催化作用 细胞生物学 无机化学 光电子学 物理化学 电极 基因
热门帖子
关注 科研通微信公众号,转发送积分 7291808
求助须知:如何正确求助?哪些是违规求助? 8910725
关于积分的说明 18862338
捐赠科研通 6959105
什么是DOI,文献DOI怎么找? 3209405
关于科研通互助平台的介绍 2379007
邀请新用户注册赠送积分活动 2185278