Using Large Language Models to Generate Retina Patient Education Material: A Comparative Analysis With American Society of Retina Specialists Patient Brochures

可读性 误传 病人教育 视网膜 心理学 医学 质量(理念) 理解力 眼科 验光服务 易读性 视网膜 利克特量表 计算机科学 医学教育 医学物理学 英语 技术员 考试(生物学) 青光眼 特殊教育 显著性差异 梅德林 患者满意度
作者
Khaldon F. Abbas,Monali S. Malvankar‐Mehta,Verena Juncal,Phil L. Hooper,Sheidow TG
出处
期刊:Journal of vitreoretinal diseases [SAGE Publishing]
卷期号:: 24741264261460669-24741264261460669
标识
DOI:10.1177/24741264261460669
摘要

Purpose: To evaluate the readability, quality, and misinformation of patient education materials generated by large language models, including ChatGPT-4o (OpenAI), Gemini 1.5 Pro (Google), and Copilot Pro (Microsoft), compared with American Society of Retina Specialists (ASRS) brochures for retinal diseases. Methods: A cross-sectional comparative analysis was performed by generating patient education materials on 3 retinal conditions: retinal detachment, diabetic retinopathy, and age-related macular degeneration. Materials were created using a general prompt (prompt A) and a prompt specifying a sixth-grade readability level (prompt B). Readability was evaluated using 6 validated metrics. Quality was assessed through DISCERN and the Patient Education Materials Assessment Tool. Misinformation was graded using a 5-point Likert scale. Assessments were performed independently by 2 masked retina specialists. Results: Average readability of Gemini (11.65; P = .005) and Copilot (11.23; P = .003) materials was significantly better than that of ASRS materials (14.17), whereas ChatGPT showed no significant difference (12.85; P = .06). ChatGPT’s average readability was significantly lower compared with Gemini (12.85 vs 11.65; P = .01) and Copilot (12.85 vs 11.23; P < .001). Prompt B significantly improved readability across all large language models relative to ASRS but still exceeded the sixth-grade readability level. DISCERN scores were comparable across groups. ASRS materials had an understandability score of 74.37%, which was significantly lower than ChatGPT (94.44%; P = .02) and Gemini 1.5 (95.83%, P = .02) scores. No significant differences were observed for actionability or misinformation. Readability showed no significant correlation with quality or misinformation ( P > .05). Conclusions: Large language models, when appropriately prompted, can generate retina-related patient education material with superior readability compared with existing ASRS brochures, while maintaining comparable quality and accuracy. Large language models represent a promising approach for addressing literacy barriers, though expert oversight remains essential.

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
1秒前
我是老大的应助被水水的采纳,获得10
1秒前
纯情的阁发布了新的文献求助100
1秒前
纯情的阁发布了新的文献求助10
1秒前
orixero的应助被亦禾子啊采纳,获得10
2秒前
NexusExplorer的应助被Zhupegnju采纳,获得10
2秒前
liao完成签到,获得积分10
3秒前
3秒前
3秒前
激情的怜晴完成签到,获得积分10
3秒前
夜子完成签到,获得积分10
4秒前
芝士完成签到 ,获得积分10
4秒前
米露完成签到 ,获得积分10
4秒前
纯情的阁发布了新的文献求助150
4秒前
隐形曼青的应助被孤独的冷安采纳,获得10
4秒前
烟花的应助被陆羽采纳,获得10
5秒前
纯情的阁发布了新的文献求助10
5秒前
纯情的阁发布了新的文献求助10
5秒前
陈陈完成签到 ,获得积分10
5秒前
daidai完成签到 ,获得积分10
5秒前
乐乐的应助被kj采纳,获得10
5秒前
wang完成签到,获得积分10
6秒前
Whywhy完成签到,获得积分10
6秒前
秋彤发布了新的文献求助20
6秒前
阳光的小土豆完成签到,获得积分20
6秒前
6秒前
7秒前
百十余发布了新的文献求助10
7秒前
隔壁老王发布了新的文献求助10
7秒前
早点睡觉完成签到 ,获得积分10
7秒前
Nowaki发布了新的文献求助10
7秒前
8秒前
星辰大海的应助被八木采纳,获得10
8秒前
赵一晨发布了新的文献求助10
8秒前
纯情的阁发布了新的文献求助10
8秒前
可莉完成签到 ,获得积分0
8秒前
8秒前
8秒前
纯情的阁发布了新的文献求助20
8秒前
李健的应助被还单身的香旋采纳,获得10
9秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
John McDowells Bildungstheorie 800
八旗制度の研究 600
What Else Can I Tell You?: A Pragmatic Study of English Rhetorical Questions as Discursive and Argumentative Acts 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8163922
求助须知:如何正确求助?哪些是违规求助? 9557995
关于积分的说明 21743022
捐赠科研通 7754548
什么是DOI,文献DOI怎么找? 3428401
关于科研通互助平台的介绍 2553053
邀请新用户注册赠送积分活动 2473008