Diagnostic Accuracy of Differential-Diagnosis Lists Generated by Generative Pretrained Transformer 3 Chatbot for Clinical Vignettes with Common Chief Complaints: A Pilot Study

作者
Takanobu Hirosawa,Yukinori Harada,Masashi Yokose,Tetsu Sakamoto,Ren Kawamura,Taro Shimizu
出处
期刊:International Journal of Environmental Research and Public Health [Multidisciplinary Digital Publishing Institute]
卷期号:20 (4): 3378-3378 被引量:370
标识
DOI:10.3390/ijerph20043378
摘要

The diagnostic accuracy of differential diagnoses generated by artificial intelligence (AI) chatbots, including the generative pretrained transformer 3 (GPT-3) chatbot (ChatGPT-3) is unknown. This study evaluated the accuracy of differential-diagnosis lists generated by ChatGPT-3 for clinical vignettes with common chief complaints. General internal medicine physicians created clinical cases, correct diagnoses, and five differential diagnoses for ten common chief complaints. The rate of correct diagnosis by ChatGPT-3 within the ten differential-diagnosis lists was 28/30 (93.3%). The rate of correct diagnosis by physicians was still superior to that by ChatGPT-3 within the five differential-diagnosis lists (98.3% vs. 83.3%, p = 0.03). The rate of correct diagnosis by physicians was also superior to that by ChatGPT-3 in the top diagnosis (53.3% vs. 93.3%, p < 0.001). The rate of consistent differential diagnoses among physicians within the ten differential-diagnosis lists generated by ChatGPT-3 was 62/88 (70.5%). In summary, this study demonstrates the high diagnostic accuracy of differential-diagnosis lists generated by ChatGPT-3 for clinical cases with common chief complaints. This suggests that AI chatbots such as ChatGPT-3 can generate a well-differentiated diagnosis list for common chief complaints. However, the order of these lists can be improved in the future.

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
刚刚
1秒前
小Z完成签到,获得积分10
2秒前
2秒前
xuliang完成签到,获得积分10
2秒前
3秒前
沐木发布了新的文献求助30
5秒前
yrz完成签到,获得积分20
6秒前
斯文败类的应助被xwx采纳,获得10
7秒前
徐丹枫发布了新的文献求助10
7秒前
7秒前
乌龙茶发布了新的文献求助10
7秒前
我是老大的应助被科研通管家采纳,获得10
7秒前
深情安青的应助被科研通管家采纳,获得10
8秒前
8秒前
FashionBoy的应助被科研通管家采纳,获得50
8秒前
情怀的应助被科研通管家采纳,获得10
8秒前
Hase的应助被科研通管家采纳,获得30
8秒前
秋风的应助被科研通管家采纳,获得10
8秒前
华仔的应助被科研通管家采纳,获得10
8秒前
酷波er的应助被科研通管家采纳,获得10
8秒前
CipherSage的应助被科研通管家采纳,获得20
9秒前
勤奋一一的应助被科研通管家采纳,获得10
9秒前
研友_VZG7GZ的应助被科研通管家采纳,获得10
9秒前
9秒前
王英霖的应助被科研通管家采纳,获得20
9秒前
秋风的应助被科研通管家采纳,获得20
9秒前
syvshc的应助被科研通管家采纳,获得10
9秒前
李爱国的应助被科研通管家采纳,获得10
9秒前
科研通AI2S的应助被科研通管家采纳,获得10
10秒前
Luna666完成签到,获得积分10
10秒前
乐乐的应助被科研通管家采纳,获得10
10秒前
10秒前
wanci的应助被科研通管家采纳,获得50
10秒前
10秒前
丁亦竹发布了新的文献求助100
11秒前
能干灯泡发布了新的文献求助10
12秒前
赘婿的应助被观山青采纳,获得10
12秒前
传奇3的应助被平常的路人采纳,获得10
12秒前
我家电脑完成签到 ,获得积分10
13秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
八旗制度の研究 600
Boundaries and Bodhisattvas 500
高分子基功能界面水蒸发材料与应用研究 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8181767
求助须知:如何正确求助?哪些是违规求助? 9571480
关于积分的说明 21818225
捐赠科研通 7778030
什么是DOI,文献DOI怎么找? 3433524
关于科研通互助平台的介绍 2557696
邀请新用户注册赠送积分活动 2479598