计算机科学
代码库
机器学习
杠杆(统计)
稳健性(进化)
人工智能
变更检测
一般化
任务(项目管理)
水准点(测量)
数据挖掘
依赖关系(UML)
航程(航空)
监督学习
标记数据
数据建模
作者
Kaiyu Li,Xiangyong Cao,Yupeng Deng,Chao Pang,Zepeng Xin,Hui Qiao,Tieliang Gong,Deyu Meng,Zhi Wang
标识
DOI:10.1609/aaai.v40i8.37554
摘要
Monitoring Earth's evolving land covers requires methods capable of detecting changes across a wide range of categories and contexts. Existing change detection methods are hindered by their dependency on predefined classes, reducing their effectiveness in open-world applications. To address this issue, we introduce open-vocabulary change detection (OVCD), a novel task that bridges vision and language to detect changes across any category. Considering the lack of high-quality data and annotation, we propose two training-free frameworks, M-C-I and I-M-C, which leverage and integrate off-the-shelf foundation models for the OVCD task. The insight behind the M-C-I~framework is to discover all potential changes and then classify these changes, while the insight of I-M-C~framework is to identify all targets of interest and then determine whether their states have changed. Based on these two frameworks, we instantiate to obtain several methods, e.g., SAM-DINOv2-SegEarth-OV, Grounding-DINO-SAM2-DINO, etc. Extensive evaluations on 4 benchmark datasets demonstrate the superior generalization and robustness of our OVCD methods over existing supervised and unsupervised methods. To support continued exploration, we release DynamicEarth, a dedicated codebase designed to advance research and application of OVCD.
科研通智能强力驱动
Strongly Powered by AbleSci AI