Rethinking Graph Contrastive Learning: An Efficient Single-View Approach via Instance Discrimination

计算机科学 图形 人工智能 编码器 理论计算机科学 特征学习 机器学习 模式识别(心理学) 操作系统
作者
Yuan Gao,Xin Li,Hui Yan
出处
期刊:IEEE Transactions on Multimedia [Institute of Electrical and Electronics Engineers]
卷期号:26: 3616-3625 被引量:5
标识
DOI:10.1109/tmm.2023.3313267
摘要

With the successful integration of contrastive learning and graph neural networks, graph contrastive learning (GCL) has demonstrated superior performance in graph representation learning. Majority of earlier works tend to utilize dual-view frameworks. However, they require high computational costs; additionally, we observed that they can hardly obtain robust result as the training processes swing between two important metrics: alignment and uniformity. We address these problems by designing a novel single-view paradigm called Light Single-view Graph Contrastive Learning (LSGCL). To reduce time consumption, we use a single-view framework. Specifically, the input graph is fed directly into a message-passing pattern encoder by concatenating the row-wise normalized hidden representations. Next, a novel single-view instance discrimination is applied, redefining the anchor, positive, and negative samples. The anchor is the positive sample, and the other nodes are negative. We also discuss why LSGCL can successfully achieve the trade-off between alignment and uniformity. In particular, the obtained representation is perfectly aligned, and visualizations show that the representation can provide cutting-edge value under uniformity. Albeit simple, our LSGCL can produce comparable performance or better than state-of-the-art methods while only incurring about 20% time cost compared to the state-of-the-art baselines.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
firefly完成签到 ,获得积分10
1秒前
慕青应助高瑞琪采纳,获得10
1秒前
海开心呀完成签到,获得积分10
1秒前
隐形曼青应助小屁孩采纳,获得10
2秒前
丙队长发布了新的文献求助10
2秒前
2秒前
2秒前
3秒前
4秒前
gulugulu完成签到 ,获得积分10
4秒前
于吉武发布了新的文献求助10
4秒前
NingJi完成签到,获得积分10
5秒前
Jasper应助科研通管家采纳,获得10
7秒前
王一凡发布了新的文献求助10
7秒前
颂歌998应助科研通管家采纳,获得10
7秒前
7秒前
祝你发财完成签到,获得积分10
7秒前
冬无青山发布了新的文献求助10
7秒前
英俊的铭应助科研通管家采纳,获得10
8秒前
思源应助科研通管家采纳,获得10
8秒前
小松弟应助科研通管家采纳,获得10
8秒前
豆包发布了新的文献求助10
8秒前
田様应助科研通管家采纳,获得10
8秒前
Violet发布了新的文献求助10
8秒前
8秒前
搜集达人应助科研通管家采纳,获得10
8秒前
9秒前
9秒前
科研通AI2S应助科研通管家采纳,获得10
9秒前
9秒前
11完成签到,获得积分10
9秒前
脑洞疼应助科研通管家采纳,获得10
9秒前
上官若男应助科研通管家采纳,获得10
9秒前
情怀应助科研通管家采纳,获得10
10秒前
英姑应助科研通管家采纳,获得10
10秒前
斯文败类应助科研通管家采纳,获得10
10秒前
10秒前
脑洞疼应助科研通管家采纳,获得10
10秒前
我是老大应助科研通管家采纳,获得10
10秒前
漂亮的宛筠完成签到,获得积分10
10秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
Positive Art Therapy Theory and Practice 800
Effects of Two Weeks of Red Light Therapy on Choroidal Thickness and Axial Length in Young Adults 700
Management and the Arts 510
Matrix Methods in Data Mining and Pattern Recognition Second Edition 510
The Neuroscience of Language 400
Common Foundations of American and East Asian Modernisation: From Alexander Hamilton to Junichero Koizumi 400
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 工程类 有机化学 化学工程 生物化学 计算机科学 内科学 物理 复合材料 催化作用 细胞生物学 无机化学 光电子学 物理化学 电极 基因
热门帖子
关注 科研通微信公众号,转发送积分 7672624
求助须知:如何正确求助?哪些是违规求助? 9239419
关于积分的说明 19900251
捐赠科研通 7242100
什么是DOI,文献DOI怎么找? 3285348
关于科研通互助平台的介绍 2443477
邀请新用户注册赠送积分活动 2287512