计算机科学
分割
人工智能
可扩展性
目标检测
对象(语法)
全视子
嵌入
分类器(UML)
遥感
词汇
地理编码
地理信息系统
图像分割
特征提取
帕斯卡(单位)
计算机视觉
情报检索
数据挖掘
像素
语义学(计算机科学)
模式识别(心理学)
上下文图像分类
遥感应用
信息抽取
深度学习
作者
Xinyang Pu,Jing Liu,Qiyu Chen,Hui Shen,Feng Xu
标识
DOI:10.1109/tgrs.2026.3672643
摘要
Existing open-world remote sensing foundation models rely on text-to-image alignment for open vocabulary semantic segmentation or object detection. However, semantic segmentation lacks instance-level delineation, while object detection fails to provide dense prediction for uncountable geographic features. Current approaches lack a unified solution for comprehensive panoptic understanding that jointly addresses semantic segmentation, instance segmentation, and object detection across all geographic elements. To bridge this gap, we propose PanoEarth, the first open-vocabulary panoptic segmentation framework for remote sensing images, which integrates these tasks within a unified architecture. Our framework incorporates a scalable training strategy to compensate missing background semantic information in instance segmentation data, enabling dense panoptic perception. Through the introduction of a domainspecific text embedding classifier to guide fine-tuning and establish precise mask query-to-category alignment, PanoEarth achieves competitive zero-shot open-vocabulary performance. We curate a large-scale panoptic dataset comprising 150k images spanning 111 geographic categories and millions of instances across landcover types, infrastructure elements, and fine-grained object subtypes. In zero-shot experiments, PanoEarth surpasses task-specific state-of-the-art models across multiple datasets and tasks. The joint co-training version enables unified extraction of 111 geographic categories, enabling hierarchical analysis from landcover mapping to fine-grained instance recognition. The source code is available at: https://github.com/xypu98/PanoEarth.
科研通智能强力驱动
Strongly Powered by AbleSci AI