S²CMamba: A Mamba-Based Pansharpening Model Incorporating Spatial and Spectral Consistency

Prevailing pan-sharpening methods tackle the ill-posed challenge of reconstructing high-resolution multispectral (HRMS) images from low-resolution multispectral (LRMS) and panchromatic (PAN) inputs. This ill-posed nature introduces distortions such as blurred spatial edges and spectral color deviations, which compromise the fidelity of the reconstructed image. To address this, we propose S²CMamba, a dual-branch framework that leverages Mamba’s efficient contextual modeling and enforces spatial and spectral consistency through tailored priors, effectively alleviating the ill-posed nature of the pan-sharpening. The spatial context branch utilizes the Windowed Spatial Local Mamba (WSLM) for local details and the Global Spatial Interaction Mamba (GSIM) for long-range structures. Within WSLM, a Manifold Preservation (MP) constraint is proposed to align HRMS features with the low-dimensional manifold consistency of PAN and LRMS, thereby mitigating high-dimensional distortions and enhancing spatial consistency. Meanwhile, the spectral branch integrates multi-scale feature extraction and designed Spectral Context Mamba (SCM) to capture spectral context. Moreover, the spatial and spectral properties of multispectral images are investigated, and the wavelet transforms are introduced for better accomplish consistency. By incorporating contextual information, S²CMamba reduces the ambiguity of the solution space, while wavelet-based consistency constraints and designed MP prior further alleviate the ill-posed nature. Extensive experiments on benchmark datasets demonstrate that S²CMamba surpasses state-of-the-art methods, validating the efficacy of this approach in addressing the ill-posed nature of pan-sharpening tasks.