TriCLFF: a multi-modal feature fusion framework using contrastive learning for spatial domain identification

Spatial transcriptomics (ST) encompasses rich multi-modal information related to cell state and organization. Precisely identifying spatial domains with consistent gene expression patterns and histological features is a critical task in ST analysis, which requires comprehensive integration of multi-modal information. Here, we propose TriCLFF, a contrastive learning-based multi-modal feature fusion framework, to effectively integrate spatial associations, gene expression levels, and histological features in a unified manner. Leveraging an advanced feature fusion mechanism, our proposed TriCLFF framework outperforms existing state-of-the-art methods in terms of accuracy and robustness across four datasets (mouse brain anterior, mouse olfactory bulb, human dorsolateral prefrontal cortex, and human breast cancer) from different platforms (10x Visium and Stereo-seq) for spatial domain identification. TriCLFF also facilitates the identification of finer-grained structures in breast cancer tissues and detects previously unknown gene expression patterns in the human dorsolateral prefrontal cortex, providing novel insights for understanding tissue functions. Overall, TriCLFF establishes an effective paradigm for integrating spatial multi-modal data, demonstrating its potential for advancing ST research. The source code of TriCLFF is available online at https://github.com/HBZZ168/TriCLFF.