计算机科学
人工智能
图形
自然语言处理
编码器
投影(关系代数)
数据建模
语义学(计算机科学)
依赖关系图
图论
理论计算机科学
亲密度
任务分析
领域知识
领域(数学分析)
抽象
深度学习
场景图
人工神经网络
算法
依赖关系(UML)
节点(物理)
模式识别(心理学)
编码(内存)
实证研究
机器学习
完全图
作者
Yuena Lin,Gengyu Lyu,Haichun Cai,Deng-Bao Wang,Haobo Wang,Zhen Yang
标识
DOI:10.1109/tkde.2025.3590482
摘要
Burgeoning graph contrastive learning (GCL) stands out in the graph domain with low annotated costs and high model performance improvements, which is typically composed of three standard configurations: 1) graph data augmentation (GraphDA), 2) multi-branch graph neural network (GNN) encoders and projection heads, 3) and contrastive loss. Unfortunately, the diverse GraphDA may corrupt graph semantics to different extents and meanwhile greatly burdens the time complexity on hyperparameter search. Besides, the multi-branch contrastive framework also demands considerable training consumption on encoding and projecting. In this paper, we propose one simplified GCL model to simultaneously address these problems via the minimal components of a general graph contrastive framework, i.e., a GNN encoder and a projection head. The proposed model treats the node representations generated by the GNN encoder and the projection head as positive pairs while considering all other representations as negatives, which not only liberates the model from the dependency on GraphDA but also streamlines the traditional multi-branch contrastive learning framework into a more efficient single-streamlined one. Through the in-depth theoretical analysis on the objective function, the mystery of why the proposed model works is illustrated. Empirical experiments on multiple public datasets demonstrate that the proposed model still ensures performance to be comparative with current advanced self-supervised GNNs.
科研通智能强力驱动
Strongly Powered by AbleSci AI