清晨好,您是今天最早来到科研通的研友!由于当前在线用户较少,发布求助请尽量完整地填写文献信息,科研通机器人24小时在线,伴您科研之路漫漫前行!

The impact of text topic and assumed human vs. AI authorship on competence and quality assessment

能力(人力资源) 心理学 质量评定 社会心理学 工程类 外部质量评估 运营管理
作者
Sebastian Proksch,Julia Schühle,Elisabeth Streeb,Finn Weymann,Teresa Luther,Joachim Kimmerle
出处
期刊:Frontiers in artificial intelligence [Frontiers Media]
卷期号:7: 1412710-1412710 被引量:31
标识
DOI:10.3389/frai.2024.1412710
摘要

Background While Large Language Models (LLMs) are considered positively with respect to technological progress and abilities, people are rather opposed to machines making moral decisions. But the circumstances under which algorithm aversion or algorithm appreciation are more likely to occur with respect to LLMs have not yet been sufficiently investigated. Therefore, the aim of this study was to investigate how texts with moral or technological topics, allegedly written either by a human author or by ChatGPT, are perceived. Methods In a randomized controlled experiment, n = 164 participants read six texts, three of which had a moral and three a technological topic (predictor text topic). The alleged author of each text was randomly either labeled “ChatGPT” or “human author” (predictor authorship). We captured three dependent variables: assessment of author competence, assessment of content quality, and participants' intention to submit the text in a hypothetical university course (sharing intention). We hypothesized interaction effects, that is, we expected ChatGPT to score lower than alleged human authors for moral topics and higher than alleged human authors for technological topics and vice versa. Results We only found a small interaction effect for perceived author competence, p = 0.004, d = 0.40, but not for the other dependent variables. However, ChatGPT was consistently devalued compared to alleged human authors across all dependent variables: there were main effects of authorship for assessment of the author competence, p < 0.001, d = 0.95; for assessment of content quality, p < 0.001, d = 0.39; as well as for sharing intention, p < 0.001, d = 0.57. There was also a small main effect of text topic on the assessment of text quality, p = 0.002, d = 0.35. Conclusion These results are more in line with previous findings on algorithm aversion than with algorithm appreciation. We discuss the implications of these findings for the acceptance of the use of LLMs for text composition.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
郭橐驼完成签到 ,获得积分10
2秒前
2秒前
美满的幻竹完成签到,获得积分10
3秒前
陶醉的莫茗完成签到,获得积分10
5秒前
纯情的阁发布了新的文献求助10
7秒前
7秒前
8秒前
9秒前
纯情的阁发布了新的文献求助10
11秒前
xun发布了新的文献求助10
12秒前
夏雪儿发布了新的文献求助10
12秒前
纯情的阁发布了新的文献求助30
13秒前
上官若男的应助被xun采纳,获得10
18秒前
夏雪儿完成签到,获得积分10
27秒前
昏睡的友菱完成签到,获得积分10
32秒前
32秒前
32秒前
糟糕的问丝完成签到,获得积分10
33秒前
科研通AI6.4的应助被纯情的阁采纳,获得10
38秒前
40秒前
北极星完成签到 ,获得积分10
42秒前
简单代梅完成签到,获得积分10
43秒前
44秒前
55秒前
体贴的小霜完成签到,获得积分10
58秒前
59秒前
精明的彩虹完成签到,获得积分10
1分钟前
科研通AI6.4的应助被纯情的阁采纳,获得10
1分钟前
科研通AI6.2的应助被纯情的阁采纳,获得10
1分钟前
所所的应助被纯情的阁采纳,获得30
1分钟前
1分钟前
顺心安雁完成签到,获得积分10
1分钟前
1分钟前
1分钟前
桐桐的应助被西红柿采纳,获得10
1分钟前
1分钟前
Qian完成签到 ,获得积分10
1分钟前
动听一德完成签到,获得积分10
1分钟前
1分钟前
无语的羞花完成签到,获得积分10
1分钟前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1500
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
John McDowells Bildungstheorie 800
八旗制度の研究 600
Analyses de reconnaissances de dettes passées devant les échevins d'Ypres (1249-1291) 600
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8158905
求助须知:如何正确求助?哪些是违规求助? 9554522
关于积分的说明 21719373
捐赠科研通 7748459
什么是DOI,文献DOI怎么找? 3427107
关于科研通互助平台的介绍 2552006
邀请新用户注册赠送积分活动 2471370