亲爱的研友该休息了!由于当前在线用户较少,发布求助请尽量完整地填写文献信息,科研通机器人24小时在线,伴您度过漫漫科研夜!身体可是革命的本钱,早点休息,好梦!

Identifying ChatGPT-Written Patient Education Materials Using Text Analysis and Readability

可读性 医学 人工智能 自然语言处理 等级 语法 计算机科学 语言学 心理学 数学教育 哲学 程序设计语言
作者
Silas Monje,Sophie Ulene,Alexis C. Gimovsky
出处
期刊:American Journal of Perinatology [Thieme Medical Publishers (Germany)]
卷期号:41 (16): 2229-2231 被引量:9
标识
DOI:10.1055/a-2302-8604
摘要

Objective Artificial intelligence (AI)-based text generators such as Chat Generative Pre-Trained Transformer (ChatGPT) have come into the forefront of modern medicine. Given the similarity between AI-generated and human-composed text, tools need to be developed to quickly differentiate the two. Previous work has shown that simple grammatical analysis can reliably differentiate AI-generated text from human-written text. Study Design In this study, ChatGPT was used to generate 25 articles related to obstetric topics similar to those made by the American College of Obstetrics and Gynecology (ACOG). All articles were geared towards patient education. These AI-generated articles were then analyzed for their readability and grammar using validated scoring systems and compared to real articles from ACOG. Results Characteristics of the 25 AI-generated articles included fewer overall characters than original articles (mean 3,066 vs. 7,426; p < 0.0001), a greater average word length (mean 5.3 vs. 4.8; p < 0.0001), and a lower Flesch–Kincaid score (mean 46 vs. 59; p < 0.0001). With this knowledge, a new scoring system was develop to score articles based on their Flesch–Kincaid readability score, number of total characters, and average word length. This novel scoring system was tested on 17 new AI-generated articles related to obstetrics and 7 articles from ACOG, and was able to differentiate between AI-generated articles and human-written articles with a sensitivity of 94.1% and specificity of 100% (Area Under the Curve [AUC] 0.99). Conclusion As ChatGPT is more widely integrated into medicine, it will be important for health care stakeholders to have tools to separate originally written documents from those generated by AI. While more robust analyses may be required to determine the authenticity of articles written by complex AI technology in the future, simple grammatical analysis can accurately characterize current AI-generated texts with a high degree of sensitivity and specificity. Key Points
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
Jasper应助科研通管家采纳,获得10
4秒前
情怀应助科研通管家采纳,获得10
4秒前
4秒前
花非花雾非雾完成签到,获得积分10
5秒前
31秒前
里昂义务发布了新的文献求助10
35秒前
葛力完成签到,获得积分10
56秒前
Gustavo给Gustavo的求助进行了留言
1分钟前
跳跃的凡阳完成签到,获得积分10
1分钟前
小马甲应助科研通管家采纳,获得10
2分钟前
天天快乐应助科研通管家采纳,获得10
2分钟前
2分钟前
魔幻初丹完成签到,获得积分10
2分钟前
Job发布了新的文献求助30
2分钟前
zhh完成签到,获得积分10
2分钟前
危机的棒棒糖完成签到,获得积分10
3分钟前
小喵不上课完成签到 ,获得积分10
4分钟前
九月半夏完成签到,获得积分10
4分钟前
会盟完成签到 ,获得积分10
4分钟前
Orange应助九月半夏采纳,获得10
4分钟前
Zoe完成签到 ,获得积分10
4分钟前
大胆醉卉完成签到,获得积分10
4分钟前
4分钟前
九月半夏发布了新的文献求助10
4分钟前
神勇寄风完成签到,获得积分10
5分钟前
隐形的芷文完成签到,获得积分10
5分钟前
zhang568完成签到 ,获得积分10
6分钟前
大医仁心完成签到 ,获得积分10
6分钟前
lipc完成签到,获得积分10
6分钟前
6分钟前
WEI发布了新的文献求助10
6分钟前
现代的初之完成签到,获得积分10
6分钟前
6分钟前
6分钟前
WEI完成签到,获得积分10
6分钟前
FashionBoy应助WEI采纳,获得10
6分钟前
JaneChen完成签到 ,获得积分10
7分钟前
野性的苗条完成签到,获得积分10
7分钟前
Oo关注了科研通微信公众号
7分钟前
落后乘风完成签到,获得积分10
7分钟前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
China Pluperfect I: Epistemology of Past and Outside in Chinese Art 520
Matrix Methods in Data Mining and Pattern Recognition Second Edition 510
Cosmos as Art Object: Studies in Plato's Timaeus and Other Dialogues 500
What is the Future of Psychotherapy in Digital Age? Technology, AI Bots, and Psychotherapy after Covid 444
Management and the Arts 310
Teaching Social and Emotional Learning in Physical Education 300
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 工程类 有机化学 化学工程 生物化学 计算机科学 内科学 物理 复合材料 催化作用 细胞生物学 无机化学 光电子学 物理化学 电极 基因
热门帖子
关注 科研通微信公众号,转发送积分 7633957
求助须知:如何正确求助?哪些是违规求助? 9208054
关于积分的说明 19748203
捐赠科研通 7202416
什么是DOI,文献DOI怎么找? 3275015
关于科研通互助平台的介绍 2436932
邀请新用户注册赠送积分活动 2271900