Cell-GraphCompass: modeling single cells with graph structure foundation model

ABSTRACT Cells in the human body are regulated by sophisticated networks of gene regulation, which allows them to fulfill their cellular destiny and function. Inspired by the advancements in large language models, there have been several attempts focusing on constructing foundation models with single-cell transcriptomic data to decipher gene regulatory networks. However, these models tend to impose a sequential structure on genes within each cell, which may omit intrinsic biological characteristics and lack the utilization of other available prior knowledge. In this paper, we introduce Cell-GraphCompass (CGCompass), the pioneering foundation model that employs graph pre-training to model genes and cells. We use three types of gene-related information as node features for constructing cell graphs and collect data from three perspectives depicting relationships between genes as edge features. We pre-trained the model with over 50 million human cells and then fine-tuned it to a broad spectrum of tasks, such as batch integration, cell type annotation, single-cell gene perturbation and in silico gene knockout predictions, achieving commendable performance. Overall, CGCompass provides a practical architecture for leveraging graph pre-training to incorporate prior knowledge in constructing a foundation model for single-cell analysis.