Large language models reduce public knowledge sharing on online Q&A platforms

计算机科学 知识共享 知识管理 万维网
作者
R. Maria del Rio-Chanona,Nadzeya Laurentsyeva,Johannes Wachs
出处
期刊:PNAS nexus [Oxford University Press]
卷期号:3 (9) 被引量:5
标识
DOI:10.1093/pnasnexus/pgae400
摘要

Abstract Large language models (LLMs) are a potential substitute for human-generated data and knowledge resources. This substitution, however, can present a significant problem for the training data needed to develop future models if it leads to a reduction of human-generated content. In this work, we document a reduction in activity on Stack Overflow coinciding with the release of ChatGPT, a popular LLM. To test whether this reduction in activity is specific to the introduction of this LLM, we use counterfactuals involving similar human-generated knowledge resources that should not be affected by the introduction of ChatGPT to such extent. Within 6 months of ChatGPT’s release, activity on Stack Overflow decreased by 25% relative to its Russian and Chinese counterparts, where access to ChatGPT is limited, and to similar forums for mathematics, where ChatGPT is less capable. We interpret this estimate as a lower bound of the true impact of ChatGPT on Stack Overflow. The decline is larger for posts related to the most widely used programming languages. We find no significant change in post quality, measured by peer feedback, and observe similar decreases in content creation by more and less experienced users alike. Thus, LLMs are not only displacing duplicate, low-quality, or beginner-level content. Our findings suggest that the rapid adoption of LLMs reduces the production of public data needed to train them, with significant consequences.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
刚刚
刚刚
CH发布了新的文献求助10
1秒前
2秒前
2秒前
大模型应助XQZ采纳,获得30
2秒前
爆米花应助XQZ采纳,获得10
2秒前
jinyue完成签到 ,获得积分10
2秒前
大个应助XQZ采纳,获得10
2秒前
李健应助XQZ采纳,获得10
3秒前
大个应助XQZ采纳,获得30
3秒前
3秒前
枝枝完成签到 ,获得积分10
4秒前
mmyhn发布了新的文献求助10
4秒前
4秒前
4秒前
ggbgemini完成签到,获得积分10
5秒前
甜甜的白筠完成签到 ,获得积分10
5秒前
炙热的雪糕完成签到,获得积分10
5秒前
agoodred完成签到 ,获得积分10
6秒前
6秒前
毕业比耶完成签到,获得积分10
8秒前
8秒前
9秒前
polaris发布了新的文献求助10
9秒前
江南达尔贝完成签到 ,获得积分10
9秒前
所所应助犹豫的大碗采纳,获得10
10秒前
10秒前
文艺的骁发布了新的文献求助10
11秒前
11秒前
JamesPei应助ggbgemini采纳,获得10
12秒前
huxuehong完成签到 ,获得积分10
12秒前
12秒前
stark完成签到,获得积分10
12秒前
Druvis完成签到,获得积分10
13秒前
海晏发布了新的文献求助10
14秒前
shancui发布了新的文献求助30
15秒前
Druvis发布了新的文献求助10
16秒前
16秒前
慕青应助CH采纳,获得10
17秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
Principles of town planning: translating concepts to applications 1000
Management and the Arts 510
Matrix Methods in Data Mining and Pattern Recognition Second Edition 510
核安全综合知识2024版 500
Photothermal Science and Techniques 500
Essentials of Carbohydrate Chemistry and Biochemistry, 4th Edition 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 工程类 有机化学 化学工程 生物化学 计算机科学 内科学 物理 复合材料 催化作用 细胞生物学 无机化学 光电子学 物理化学 电极 基因
热门帖子
关注 科研通微信公众号,转发送积分 7717641
求助须知:如何正确求助?哪些是违规求助? 9272035
关于积分的说明 20089276
捐赠科研通 7293875
什么是DOI,文献DOI怎么找? 3299140
关于科研通互助平台的介绍 2453167
邀请新用户注册赠送积分活动 2306484