Hybrid Attention-Aware Transformer Network Collaborative Multiscale Feature Alignment for Building Change Detection

变压器 计算机科学 特征(语言学) 变更检测 电子工程 人工智能 工程类 电气工程 电压 语言学 哲学
作者
Chuan Xu,Zhaoyi Ye,Liye Mei,Haonan Yu,Jianchen Liu,Yaxiaer Yalikun,Shuangtong Jin,Sheng Liu,Wei Yang,Cheng Lei
出处
期刊:IEEE Transactions on Instrumentation and Measurement [Institute of Electrical and Electronics Engineers]
卷期号:73: 1-14 被引量:36
标识
DOI:10.1109/tim.2024.3373089
摘要

Building change detection (BCD) is essential for urban dynamic measurement. Deep learning has demonstrated significant potential in image processing, providing powerful feature extraction capabilities for BCD tasks. However, existing methods do not adequately mine multiscale feature information and ignore the importance of multiscale feature alignment, leading to an inadequate representation of the internal structure. Therefore, we propose a hybrid attention-aware Transformer network (HATNet) designed to effectively extract and interact with multiscale context information. Specifically, HATNet first incorporates a hybrid attention-aware feature extractor (HAFE) module that integrates self-attention (SA) and coordinate-attention (CA) to effectively extract complementary multiscale features. The SA establishes long-range dependencies between multiscale features, while the CA captures spatial dependencies and preserves positional details. Then, we devise a building saliency detection enhancement (BSDE) module that utilizes three independent channels to facilitate the identification and localization of changed buildings, fostering a symbiotic relationship between unchanged and changed areas. Furthermore, we adopt a coarse-to-fine feature interaction (CFFI) module to progressively fuse multiscale features using a hierarchical strategy. In order to better locate the changed detail features, we introduce a global feature alignment (GFA) module to achieve global multiscale feature alignment. HATNet surpasses eight BCD methods on LEVIR-CD, WHU-CD, and S2Looking-CD datasets. The experimental results provide compelling evidence of our method to precisely detect and measure building changes. The codes are available at https://github.com/yzygit1230/HATNet.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
思源应助CDN采纳,获得10
刚刚
cnas发布了新的文献求助10
1秒前
时光漫步完成签到,获得积分10
2秒前
务实乘云发布了新的文献求助10
3秒前
123完成签到,获得积分10
3秒前
bkagyin应助Carbon_R采纳,获得10
3秒前
4秒前
4秒前
陈星完成签到,获得积分10
4秒前
儒雅的雁山完成签到 ,获得积分10
5秒前
5秒前
yuuu完成签到 ,获得积分10
6秒前
难过的一一完成签到,获得积分10
6秒前
唐很甜完成签到 ,获得积分10
6秒前
大旗应助程绪洋采纳,获得10
6秒前
7秒前
勤劳问芙完成签到,获得积分10
7秒前
科研通AI6.4应助crystal采纳,获得10
7秒前
biomds完成签到,获得积分10
8秒前
大模型应助友好的小翠采纳,获得10
8秒前
viviwuyx完成签到,获得积分20
8秒前
Rye227完成签到,获得积分10
8秒前
9秒前
yyf完成签到,获得积分10
9秒前
9秒前
酷波er应助liuxinyi010采纳,获得10
10秒前
ding应助ZRT采纳,获得10
10秒前
Irony发布了新的文献求助10
10秒前
10秒前
赘婿应助圆圆901234采纳,获得10
10秒前
10秒前
HHH发布了新的文献求助10
11秒前
浑天与完成签到,获得积分10
11秒前
CTL完成签到,获得积分10
12秒前
12秒前
12秒前
林场发布了新的文献求助20
12秒前
NICO完成签到,获得积分10
13秒前
JamesPei应助Hujia采纳,获得10
13秒前
雾雾完成签到,获得积分20
13秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
Principles of town planning: translating concepts to applications 1000
1 Peter and Christ's Descent to the Dead in Its Early Christian Reception 700
Perfectionism in School 600
Organizational Behavior 510
Management and the Arts 510
Matrix Methods in Data Mining and Pattern Recognition Second Edition 510
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 工程类 有机化学 化学工程 生物化学 计算机科学 内科学 物理 复合材料 催化作用 细胞生物学 无机化学 光电子学 物理化学 电极 基因
热门帖子
关注 科研通微信公众号,转发送积分 7727714
求助须知:如何正确求助?哪些是违规求助? 9280203
关于积分的说明 20136430
捐赠科研通 7305346
什么是DOI,文献DOI怎么找? 3302562
关于科研通互助平台的介绍 2455803
邀请新用户注册赠送积分活动 2310718