AEKAN: Exploring Superpixel-Based AutoEncoder Kolmogorov-Arnold Network for Unsupervised Multimodal Change Detection

自编码 计算机科学 人工智能 无监督学习 变更检测 模式识别(心理学) 人工神经网络
作者
Tongfei Liu,Jianjian Xu,Tao Lei,Yingbo Wang,Xiaogang Du,Weichuan Zhang,Zhiyong Lv,Maoguo Gong
出处
期刊:IEEE Transactions on Geoscience and Remote Sensing [Institute of Electrical and Electronics Engineers]
卷期号:63: 1-14 被引量:21
标识
DOI:10.1109/tgrs.2024.3515258
摘要

Multimodal change detection (MCD) has garnered significant interest due to its capacity to address a variety of emergencies in a timely and effective manner. However, discrepancies in sensors and imaging techniques often hinder the direct comparison of heterogeneous remote sensing images (HRSIs), making it difficult to extract change information. To overcome this challenge, we propose a novel superpixel-based AutoEncoder Kolmogorov-Arnold Network (AEKAN) for unsupervised MCD. The primary objective of AEKAN is to excavate the latent commonality features between HRSIs. Notably, commonality features in unchanged regions are generally more pronounced than those in changed regions, which can be leveraged to assess change magnitude. To achieve this, the proposed method utilizes the Kolmogorov-Arnold Network (KAN), renowned for its capability to model data distributions, to extract these commonality features between HRSIs. Concretely, the proposed AEKAN consists of a Siamese KAN encoder and dual KAN decoders. The Siamese encoder aims to map HRSIs and extract latent commonality features, while the dual decoders reconstruct original bitemporal images from these features. In addition, we incorporate a hierarchical commonality loss function within the Siamese encoder to train AEKAN. This loss function is designed to intentionally guide the network in capturing commonality features by minimizing the discrepancies in features extracted from HRSIs at each layer of the Siamese encoder. The extracted commonality features are then adopted to quantify the change magnitude between images through mean square error (MSE). Extensive experiments on five MCD datasets demonstrate that the proposed AEKAN outperforms existing methods. The source code is available at: https://github.com/TongfeiLiu/AEKAN-for-MCD.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
ColinWine完成签到,获得积分10
刚刚
zyjjjj完成签到,获得积分10
2秒前
LL完成签到,获得积分10
3秒前
4秒前
11发布了新的文献求助10
4秒前
传奇3应助LLN采纳,获得10
5秒前
乐乐应助玛奇朵采纳,获得10
5秒前
三方完成签到,获得积分10
6秒前
侧耳倾听完成签到 ,获得积分10
7秒前
Cassiopiea19完成签到,获得积分10
7秒前
8秒前
缥缈谷冬完成签到,获得积分10
8秒前
11完成签到,获得积分20
9秒前
shuoliu完成签到 ,获得积分10
9秒前
郭竞阳发布了新的文献求助10
10秒前
温柔的刀发布了新的文献求助200
15秒前
咩咩咩完成签到,获得积分10
17秒前
专注的凌丝给wu的求助进行了留言
18秒前
18秒前
20秒前
21秒前
22秒前
24秒前
玛卡巴卡发布了新的文献求助30
26秒前
哒哒哒发布了新的文献求助30
26秒前
思源应助djbj2022采纳,获得10
29秒前
谦让的道之完成签到 ,获得积分10
30秒前
31秒前
刘艺娜完成签到,获得积分10
32秒前
Super枫完成签到,获得积分10
33秒前
小太阳在营业完成签到,获得积分0
35秒前
船长完成签到,获得积分10
37秒前
Hanif5329完成签到,获得积分10
37秒前
ashenliu发布了新的文献求助10
38秒前
yuyuyu完成签到,获得积分10
38秒前
小时完成签到 ,获得积分10
47秒前
47秒前
YDSG完成签到,获得积分10
49秒前
49秒前
江水边完成签到 ,获得积分10
50秒前
高分求助中
液晶指向矢仿真分析数据集 8888
Invited Discussant 63O and 64O 1000
Dr. Dirk Wiechmann on Lingual Orthodontics: Part I 888
Ideology and Meaning-Making under the Putin Regime 750
化工技术经济第五版电子版 500
Petrology and Plate Tectonics 500
Writing Systems 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 工程类 有机化学 计算机科学 化学工程 生物化学 物理 内科学 复合材料 催化作用 光电子学 物理化学 电极 细胞生物学 基因 遗传学
热门帖子
关注 科研通微信公众号,转发送积分 6880529
求助须知:如何正确求助?哪些是违规求助? 8580181
关于积分的说明 18229959
捐赠科研通 6263549
什么是DOI,文献DOI怎么找? 3055054
关于科研通互助平台的介绍 2065338
邀请新用户注册赠送积分活动 2032715