计算机科学
编码器
像素
变压器
人工智能
变更检测
Boosting(机器学习)
先验与后验
虚假关系
模式识别(心理学)
数据挖掘
计算机视觉
机器学习
电压
哲学
物理
操作系统
认识论
量子力学
作者
Wenhao Liu,Zhuoyuan Yu,Bin Luo
标识
DOI:10.1109/tgrs.2025.3527009
摘要
Change Detection (CD) using deep learning is crucial for analyzing changes on the earth’s surface. Yet, obtaining accurate, extensive pixel-level labels is difficult and time-consuming. Consequently, there is growing interest in weakly supervised change detection (WSCD) using image-level labels, praised for its high efficiency in label acquisition. Nonetheless, the lack of adequate supervision leads many existing WSCD methods to adopt intricate processes, neglecting the inherent information present in the networks. To overcome these challenges, we propose ACWCD, an end-to-end encoder-decoder framework based on transformers for WSCD using image-level labels. The proposed framework is primarily designed for ViT-related backbones. It generates effective pseudo labels by tapping into the localizing prowess of class activation mapping (CAMs) and simultaneously utilizes these labels for pixel-level supervision during training. Specifically, ACWCD comprises two pivotal components: The Attention Refinement (AR) module and the Change Priori (CP) constraint. By harnessing the inherent multi-head self-attention (MHSA) of transformers, the AR module refines CAMs by producing change attention from MHSA, thereby refining the pseudo labels. Furthermore, utilizing prior knowledge, the CP constraint prevents the AR module from processing samples with unchanged image-level labels, thus addressing the issue of AR generating spurious change areas. Additionally, an exclusive threshold is assigned to each pair of images to help differentiate pseudo labels. It also imposes penalties based on the proportion of mispredictions, using the designed plug-and-play loss function. To validate the performance of ACWCD, experiments are conducted on three high-resolution remote sensing datasets. The outcomes reveal that the proposed framework not only achieves new state-of-the-art (SOTA) performance within the WSCD domain but also exhibits substantial scalability, as it does not involve any complex processes, serving as a useful baseline for future research. The code is available at https://github.com/WenhaoLiu03/ACWCD.
科研通智能强力驱动
Strongly Powered by AbleSci AI