Bipartite Spatial Transformer Difference Network for Unsupervised Change Detection in Misaligned Images

计算机科学 变更检测 人工智能 变压器 模式识别(心理学) 计算机视觉 遥感 地质学 物理 电压 量子力学
作者
Ling Hu,Qichao Liu,Jia Liu,Zhihui Wei,Liang Xiao
出处
期刊:IEEE Transactions on Geoscience and Remote Sensing [Institute of Electrical and Electronics Engineers]
卷期号:63: 1-19 被引量:1
标识
DOI:10.1109/tgrs.2025.3600456
摘要

Unsupervised change detection algorithms typically identify changed areas by comparing pixels or ground objects in co-registered bi-temporal images. However, due to small viewpoint variations in misaligned images and unknown changed regions between bi-temporal images, image registration becomes extremely challenging, and misaligned pixels may lead to a mass of false alarms. To address this issue, we develop a bidirectional spatial transformer network (BidSTN) capable of identifying the spatial shifts of corresponding key points in pre- and post-event images. It allows us to compute the coordinate offset relationships between misaligned images with small viewpoint variations and achieve spatial interpolation and registration using a thin-plate spline function. Building on the BidSTN, the bipartite spatial transformer difference network (BSTDN) is constructed by integrating encoders and decoders with feature difference minimization and cross-reconstruction constraints. It concurrently learns the distribution-consistent features of bi-temporal images in the feature space and their coordinate offset relationships, enabling the spatial registration and change detection of heterogeneous images within a single learning process. Furthermore, we incorporate a series of iterative refining modules (RMs) based on the aligned images and deep features. These modules enhance the accuracy of change detection by learning real changes within two distinct feature spaces and continuously refining the change map. Finally, by cascading the BSTDN and RMs, an unsupervised cross-modal registration-detection joint framework is constructed. Extensive experiments on both real and simulated datasets validate the framework’s superiority in suppressing misalignment artifacts, with F1 scores improving by an average of 15.83% (real dataset) and 11.12% (simulated dataset) compared to the best baseline methods. Code is available at https://github.com/lh-rs/BSTDN.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
Aruo完成签到,获得积分10
刚刚
略略略完成签到,获得积分10
1秒前
你好棒呀完成签到,获得积分10
1秒前
凡事发生必有利于我完成签到 ,获得积分10
1秒前
淮栀发布了新的文献求助10
2秒前
酷炫安雁完成签到,获得积分10
3秒前
lbx完成签到,获得积分10
4秒前
donglingyabo完成签到,获得积分10
4秒前
隐形的水绿完成签到 ,获得积分10
5秒前
snow完成签到 ,获得积分10
6秒前
热情的水杯完成签到,获得积分10
7秒前
村上武生完成签到,获得积分10
7秒前
A吞完成签到,获得积分10
8秒前
vanilla完成签到,获得积分10
10秒前
祈愿a完成签到,获得积分10
13秒前
13秒前
等风来完成签到 ,获得积分10
14秒前
david_x完成签到,获得积分10
14秒前
英姑的应助被飘逸的雪珍采纳,获得10
14秒前
初晴完成签到 ,获得积分10
14秒前
阿莴鹅完成签到,获得积分10
15秒前
15秒前
16秒前
liuniuliannian完成签到,获得积分10
16秒前
17秒前
18秒前
19秒前
linhappy完成签到,获得积分10
19秒前
哈哈啊哈发布了新的文献求助10
21秒前
拓跋涵易发布了新的文献求助10
21秒前
DuesKing完成签到,获得积分10
22秒前
WangWaud完成签到,获得积分10
22秒前
LiGanZe完成签到,获得积分10
22秒前
23秒前
24秒前
宁宁小王777完成签到,获得积分10
24秒前
24秒前
渐入佳境完成签到 ,获得积分10
25秒前
2021完成签到 ,获得积分10
27秒前
大模型的应助被木槐采纳,获得10
27秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 2000
Sex, Aging, and Death in a Medieval Medical Compendium: Trinity College Cambridge MS R.14.52, Its Texts, Language, and Scribe 500
高分子基功能界面水蒸发材料与应用研究 500
外场增强的水汽发电研究 500
基于结构调控的功能化水诱导发电材料与器件研究 500
基于界面调控的高效湿气发电材料与器件研究 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8190389
求助须知:如何正确求助?哪些是违规求助? 9577524
关于积分的说明 21853071
捐赠科研通 7789340
什么是DOI,文献DOI怎么找? 3436395
关于科研通互助平台的介绍 2560220
邀请新用户注册赠送积分活动 2483032