高光谱成像
非线性系统
计算机科学
可解释性
人工智能
编码器
模式识别(心理学)
非线性失真
空间分析
变压器
计算机视觉
特征提取
冗余(工程)
像素
人工神经网络
算法
多项式的
混合(物理)
数据建模
光谱带
杂乱
预处理器
作者
Chentong Wang,Jincheng Gao,Fei Zhu,Abderrahim Halimi,Cédric Richard
标识
DOI:10.1109/tgrs.2026.3658361
摘要
Transformers have shown significant success in hyperspectral unmixing (HU). However, challenges remain. Transformer-based unmixing networks, built on Vision Transformer (ViT) or Swin Transformer, struggle to effectively capture essential multi-scale and long-range spatial correlations. Additionally, these networks predominantly rely on the linear mixing model, lacking the flexibility to accommodate scenarios with significant nonlinear effects. To address these limitations, we propose a multi-scale Dilated Transformer-based unmixing network for nonlinear HU (DTU-Net). Its encoder integrates two branches: a spatial branch mainly employing Multi-Scale Dilated Attention (MSDA) to uniquely capture intricate multi-scale and long-range spatial correlations via adaptive receptive fields, and a spectral branch utilizing 3D-CNNs with channel attention. This design enables comprehensive extraction as well as integration of multi-level spatial and spectral features. The decoder is specifically designed to accommodate both linear and nonlinear mixing. It explicitly models the polynomial post-nonlinear mixing model (PPNMM) by learning nonlinear coefficients as pixel-wise features, which enhances interpretability by directly reflecting the pixel-level nonlinear mixing strength. Experiments on synthetic, ray tracing, and real datasets validate the effectiveness of the proposed DTU-Net, demonstrating its superior performance compared to both PPNMM-derived and advanced unmixing networks. The code is available at: https: //github.com/ChentongWang/DTU-Net.
科研通智能强力驱动
Strongly Powered by AbleSci AI