高光谱成像
遥感
计算机科学
人工智能
稳健性(进化)
多光谱图像
计算机视觉
RGB颜色模型
模式识别(心理学)
遥感应用
光谱特征
基本事实
异常检测
冗余(工程)
光谱带
图像分辨率
地球观测
全光谱成像
合成孔径雷达
VNIR公司
作者
Li Pang,Xinqiao Wu,Jing Yao,Pedram Ghamisi,Jun Zhou,Zhengchao Chen,Deyu Meng,Xiangyong Cao
标识
DOI:10.1109/mgrs.2026.3739301
摘要
Hyperspectral remote sensing provides dense spectral measurements that are indispensable for material-level Earth observation, yet the construction of a general-purpose hyperspectral foundation model (HFM) remains difficult. Two bottlenecks are especially limiting. First, large hyperspectral corpora rarely provide high spatial resolution together with reliable dense annotations. Second, many hyperspectral models are still trained almost from scratch, so the geometric and interactive priors learned by modern vision foundation models are not fully reused. To alleviate these issues, we present HyperSAM, a promptable HFM that couples a data-centric hyperspectral synthesis pipeline with a spectral adaptation architecture based on Segment Anything Model 3 (SAM3). On the data side, HyperSAM synthesizes full-spectrum hyperspectral cubes from high-resolution SpaceNet multispectral imagery through a physics-informed abundance-transfer generator, while SAM3-derived pseudo-masks provide object-centric supervision. On the model side, the latest implementation uses a frozen SAM3 red, green, blue (RGB) image branch, a trainable hyperspectral side encoder initialized from the RGB vision transformer (ViT), ControlNet-style zero-initialized feature injection, and a lightweight mixture-of-experts (MoE) mask refiner. To enhance training robustness against noisy pseudo-labels, cross-modal sample selection (CromSS)-style confidence selection is incorporated for noisy-label weighting. Extensive experiments show that HyperSAM obtains strong generalization on diverse hyperspectral tasks (e.g., classification, anomaly detection, change detection, target detection, and airborne oil-spill mapping) and that high-quality synthetic hyperspectral data can be more effective than simply scaling noisy hyperspectral supervision.
科研通智能强力驱动
Strongly Powered by AbleSci AI