DA-LGNet: Enhancing Spatial-Spectral feature representation with Dual-Attention Local-General Network for Hyperspectral images and Multispectral images Fusion

Hyperspectral image and Multispectral image (HSI-MSI) fusion aims to fuse a registered high-resolution multi-spectral image (HR-MSI) with a low-resolution hyperspectral image (LR-HSI) to generate a spatially enhanced HSI with high spectral resolution. Current fusion methods often make insufficient utilization of spatial and spectral prior information, including spatial self-similarity and inter-spectral correlations, resulting in a degradation in image fidelity. Therefore, we propose a novel HSI-MSI fusion network, called DA-LGNet, designed to learn spatial-spectral priors with a dual-attention mechanism for feature enhancement and utilize the advantages of the large kernel attention for global and local feature representation. Specifically, the large kernel attention module (LKAM) can efficiently extract and integrate long-range dependencies and detailed textual information. The dual-attention enhancement module (DAEM) incorporates the position attention mechanism with the channel attention mechanism, flexibly capturing spatial and spectral prior information, which are crucial for restoring high-resolution HSI (HR-HSI). Extensive experiments on two datasets demonstrate that our DA-LGNet importantly outper-forms other state-of-the-art methods.