MSSSHANet: Hyperspectral and multispectral image fusion algorithm based on multi-scale spatial-spectral hybrid attention network

Abstract In order to solve the problems of scale difference, inconspicuous spatial feature expression, redundancy, and overlapping of spectral feature information in hyperspectral and multispectral image fusion (HS-MS fusion), a fusion algorithm based on multi-scale space-spectrum hybrid attention network is designed in this paper. The algorithm enhances the capability of shallow feature extraction through the multi-scale mechanism, uses the space-spectrum hybrid attention mechanism to mine the correlation between deep space and spectrum, designs a cross-spectrum fusion module to realize the effective reconstruction of spatial and spectral information, and uses the loss function to constrain the difference between the fused image and the reference image (Ref) in terms of color, detail edge, and spatial structure. Experiments were conducted on PaviaU, IndianP, and HINS datasets, and compared to algorithms such as ResTFNet, SSRNET, MoGDCN, DBSR, and Fusformer. The proposed algorithm, MSSSHANet, performs better in spectral curve smoothness, spectral difference value, RMSE, PSNR, ERGAS, and SAM value, which plays an active role in improving fusion quality. However, the generalization ability of the proposed algorithm in special remote sensing tasks needs to be verified, and future research will focus on data preprocessing optimization and the development of time-spatial-spectral integration fusion technology.