Do ChatGPT and Google Differ in Answers to Commonly Asked Patient Questions Regarding Total Shoulder and Total Elbow Arthroplasty?

医学 时间轴 多项选择 封闭式问题 考试(生物学) 常见问题 医学教育 分类 显著性差异 计算机科学 人工智能 古生物学 统计 数学 考古 生物 内科学 历史
作者
Shebin Tharakan,Brandon Klein,Lucas E. Bartlett,Aaron Atlas,Stephen A. Parada,Randy M. Cohn
出处
期刊:Journal of Shoulder and Elbow Surgery [Elsevier]
被引量:7
标识
DOI:10.1016/j.jse.2023.11.014
摘要

Abstract

Background

Artificial intelligence (AI) and large language models (LLM) offer a new potential resource for patient education. The answers by ChatGPT, a LLM AI text bot, to frequently asked questions (FAQs) were compared to answers provided by a contemporary Google search to determine the reliability of information provided by these sources for patient education in upper extremity arthroplasty.

Methods

"Total shoulder arthroplasty" (TSA) and "total elbow arthroplasty" (TEA) were entered into Google Search and ChatGPT 3.0 to determine the ten most frequently asked questions (FAQs). On Google, the FAQs were obtained through the "people also ask" section, while ChatGPT was asked to provide the ten most FAQs. Each question, answer, and reference(s) cited were recorded. A modified version of the Rothwell system was used to categorize questions into 10 subtopics: special activities, timeline of recovery, restrictions, technical details, cost, indications/management, risks and complications, pain, longevity, and evaluation of surgery. Each reference was categorized into the following groups: commercial, academic, medical practice, single surgeon personal, or social media. Questions for TSA and TEA were combined for analysis and compared between Google and ChatGPT with a two sample Z-test for proportions.

Results

Overall, most questions were related to procedural indications or management (17.5%). There were no significant differences between Google and ChatGPT between question categories. The majority of references were from academic websites (65%). ChatGPT produced a greater number of academic references compared to Google (80% vs 50%; p=0.047), while Google more commonly provided medical practice references (25% vs 0%; p=0.017).

Conclusion

In conjunction with patient-physician discussions, AI LLMs may provide a reliable resource for patients. By providing information based on academic references, these tools have the potential to improve health literacy and improved shared decision making for patients searching for information about TSA and TEA.

Clinical Significance

With the rising prevalence of AI programs, it is essential to understand how these applications affect patient education in medicine.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
更新
大幅提高文件上传限制,最高150M (2024-4-1)

科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
ming完成签到,获得积分10
2秒前
我爱学习呢完成签到,获得积分10
3秒前
美好乐松完成签到,获得积分10
6秒前
清爽玉米完成签到,获得积分10
6秒前
8秒前
神说要有光完成签到 ,获得积分10
9秒前
cctv18应助傲娇凉面采纳,获得10
10秒前
cctv18应助傲娇凉面采纳,获得30
10秒前
酷炫书芹应助请叫我鬼才采纳,获得10
11秒前
nuonuomimi完成签到,获得积分10
11秒前
黄橙子完成签到 ,获得积分10
15秒前
指尖心事完成签到,获得积分10
16秒前
寻道图强应助风中的蘑菇采纳,获得30
16秒前
何睦完成签到 ,获得积分10
16秒前
非主流的毛线完成签到,获得积分10
20秒前
cocobear完成签到 ,获得积分10
22秒前
冷傲机器猫完成签到,获得积分10
23秒前
甄半雪完成签到 ,获得积分10
27秒前
zhao完成签到 ,获得积分10
27秒前
GJL关闭了GJL文献求助
27秒前
28秒前
思睿完成签到,获得积分0
31秒前
33秒前
墨之默完成签到,获得积分10
34秒前
谦虚完成签到 ,获得积分20
35秒前
橙子发布了新的文献求助10
36秒前
yhy完成签到 ,获得积分10
37秒前
GraceWu发布了新的文献求助10
38秒前
研友_Z1eDgZ完成签到,获得积分10
39秒前
猪猪女孩完成签到,获得积分10
40秒前
聪明的鹤完成签到 ,获得积分10
43秒前
HappyFlight9898完成签到,获得积分10
45秒前
livra1058完成签到,获得积分10
46秒前
GraceWu完成签到,获得积分10
47秒前
lwtsy完成签到,获得积分10
48秒前
简单幸福完成签到 ,获得积分10
48秒前
MEMSforever发布了新的文献求助10
50秒前
烤全鱼呢关注了科研通微信公众号
51秒前
lpx43完成签到,获得积分10
53秒前
吴大宝完成签到,获得积分10
56秒前
高分求助中
좌파는 어떻게 좌파가 됐나:한국 급진노동운동의 형성과 궤적 2500
Sustainability in Tides Chemistry 1500
TM 5-855-1(Fundamentals of protective design for conventional weapons) 1000
Cognitive linguistics critical concepts in linguistics 800
Threaded Harmony: A Sustainable Approach to Fashion 799
Livre et militantisme : La Cité éditeur 1958-1967 500
氟盐冷却高温堆非能动余热排出性能及安全分析研究 500
热门求助领域 (近24小时)
化学 医学 生物 材料科学 工程类 有机化学 生物化学 物理 内科学 纳米技术 计算机科学 化学工程 复合材料 基因 遗传学 催化作用 物理化学 免疫学 量子力学 细胞生物学
热门帖子
关注 科研通微信公众号,转发送积分 3052675
求助须知:如何正确求助?哪些是违规求助? 2709898
关于积分的说明 7418335
捐赠科研通 2354494
什么是DOI,文献DOI怎么找? 1246139
科研通“疑难数据库(出版商)”最低求助积分说明 605951
版权声明 595921