高光谱成像
判别式
计算机科学
上下文图像分类
人工智能
特征(语言学)
欧几里德距离
公制(单位)
模式识别(心理学)
特征向量
计算机视觉
一致性(知识库)
特征提取
机器学习
深度学习
特征学习
语义鸿沟
降维
协方差
线性判别分析
支持向量机
欧几里得空间
作者
Qiaoli Zhang,Jiangtao Peng,Weiwei Sun
标识
DOI:10.1109/tgrs.2025.3615225
摘要
Deep learning has advanced hyperspectral image classification (HSIC), but label scarcity remains a significant challenge. Traditional unimodal methods usually produce unstable prototypes, while multimodal methods suffer from cross-modal semantic misalignment. Moreover, standard metrics fail to capture high-order feature correlations, further limiting the discriminative ability of the model. To address these issues, we propose a query-oriented dynamic multimodal alignment (QODMA) method, which integrates visual-textual guidance with dual-distance metric learning for few-shot HSIC. Specifically, a query-oriented dynamic attention (QODA) module is designed to bridge the modality gap by aligning visual and textual features through query-driven attention interactions. A bidirectional attention mechanism is constructed to employ contrastive learning to enhance intra-class compactness. Additionally, a dual-distance metric learning (DML) module that combines the Euclidean distance and Brownian distance covariance (BDC) metrics is employed to refine the feature space representation, thereby enhancing the discriminative ability of the model. To mitigate domain shift, an inter-domain structural consistency loss (IDSCL) is constructed. Experimental results on four public hyperspectral data sets demonstrate that the proposed QODMA outperforms state-of-the-art few-shot classification methods.
科研通智能强力驱动
Strongly Powered by AbleSci AI