计算机科学
高光谱成像
人工智能
接头(建筑物)
合成孔径雷达
模式识别(心理学)
遥感
传感器融合
融合
生成语法
人工神经网络
雷达成像
特征提取
计算机视觉
数据建模
深度学习
生成模型
雷达跟踪器
图像融合
训练集
干涉合成孔径雷达
特征学习
作者
Hongzhan Zhang,Wenbo Yu,Liqiang Zhang,Rui Liu,Min Ma,Baoqing Nie
标识
DOI:10.1109/tgrs.2026.3731586
摘要
Hyperspectral (HS) images and synthetic aperture radar (SAR) data provide complementary information for land cover interpretation. However, their cross-modal collaboration remains insufficient in multisatellite observation systems. Moreover, both remote sensing (RS) modalities are sensitive to environmental interference, hindering critical feature acquisition. To overcome these challenges, a generative modality-specific learning-enhanced collaborative fusion network called GenMSLnet is proposed for HS and SAR joint classification. Our core innovation is modality-specific feature learning, directly guided by the RS inherent properties. The framework couples a multiscale dual-stream generative adversarial network (MDGAN) for modality-specific feature learning with a transformer-based dual-path cross-attention (TDCA) network for complementary fusion. MDGAN comprises dual streams for HS image (HSI) and SAR data. The former captures spectral–spatial details by multiscale feature extraction and attention, while the latter employs orientation-aware sampling to capture geometry- and orientation-sensitive backscattering signals. A residual separable U-Net discriminator (RSU-NetD) incorporating depthwise separable channel attention residual blocks (DSCA ResBlocks) is considered to strengthen feature discrimination. TDCA balances RS modality contributions by introducing a novel gated bidirectional dynamic cross-attention mechanism. Experiments demonstrate that GenMSLnet outperforms state-of-the-art techniques quantitatively and qualitatively. Codes will be available athttps://github.com/zhanghongzhan-123/GenMSLnet
科研通智能强力驱动
Strongly Powered by AbleSci AI