Performance of popular large language models in glaucoma patient education: A randomized controlled study

青光眼 随机对照试验 医学 计算机科学 心理学 眼科 内科学
作者
Yuyu Cao,Wei Lü,Runhan Shi,Fuying Liu,Steven H. Liu,Xinwei Xu,Jin Yang,Guangyu Rong,Changchang Xin,Xujiao Zhou,Xinghuai Sun,Jiaxu Hong
出处
期刊:Advances in ophthalmology practice and research [Elsevier BV]
卷期号:5 (2): 88-94 被引量:10
标识
DOI:10.1016/j.aopr.2024.12.002
摘要

Purpose: The advent of chatbots based on large language models (LLMs), such as ChatGPT, has significantly transformed knowledge acquisition. However, the application of LLMs in glaucoma patient education remains elusive. In this study, we comprehensively compared the performance of four common LLMs - Qwen, Baichuan 2, ChatGPT-4.0, and PaLM 2 - in the context of glaucoma patient education. Methods: Initially, senior ophthalmologists were asked with scoring responses generated by the LLMs, which were answers to the most frequent glaucoma-related questions posed by patients. The Chinese Readability Platform was employed to assess the recommended reading age and reading difficulty score of the four LLMs. Subsequently, optimized models were filtered, and 29 glaucoma patients participated in posing questions to the chatbots and scoring the answers within a real-world clinical setting. Attending ophthalmologists were also required to score the answers across five dimensions: correctness, completeness, readability, helpfulness, and safety. Patients, on the other hand, scored the answers based on three dimensions: satisfaction, readability, and helpfulness. Results: In the first stage, Baichuan 2 and ChatGPT-4.0 outperformed the other two models, though ChatGPT-4.0 had higher recommended reading age and reading difficulty scores. In the second stage, both Baichuan 2 and ChatGPT-4.0 demonstrated exceptional performance among patients and ophthalmologists, with no statistically significant differences observed. Conclusions: Our research identifies Baichuan 2 and ChatGPT-4.0 as prominent LLMs, offering viable options for glaucoma education.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
cc完成签到,获得积分10
刚刚
StuXuhao发布了新的文献求助10
1秒前
苹果秋灵完成签到,获得积分10
1秒前
alika完成签到 ,获得积分10
1秒前
西湖牛肉羹完成签到,获得积分10
1秒前
2秒前
Lucas的应助被lucky采纳,获得10
2秒前
大模型的应助被Yolo采纳,获得10
2秒前
共享精神的应助被JG采纳,获得10
2秒前
h11的应助被闾丘曼安采纳,获得10
2秒前
null的应助被科研通管家采纳,获得10
2秒前
大个的应助被科研通管家采纳,获得10
3秒前
上官若男的应助被科研通管家采纳,获得10
3秒前
温柔青旋完成签到,获得积分10
3秒前
null的应助被科研通管家采纳,获得10
3秒前
酷波er的应助被科研通管家采纳,获得10
3秒前
ssw完成签到,获得积分10
3秒前
null的应助被科研通管家采纳,获得10
3秒前
小蘑菇的应助被WBH36323采纳,获得10
3秒前
Owen的应助被科研通管家采纳,获得10
3秒前
123完成签到,获得积分10
3秒前
深情安青的应助被科研通管家采纳,获得10
3秒前
Ava的应助被科研通管家采纳,获得10
3秒前
3秒前
4秒前
斯文哑铃完成签到,获得积分10
4秒前
研友_VZG7GZ的应助被陌路孤星采纳,获得10
4秒前
syqlyd完成签到 ,获得积分10
4秒前
卷毛完成签到,获得积分10
4秒前
4秒前
NexusExplorer的应助被Rudy_Li采纳,获得10
4秒前
10000完成签到,获得积分10
4秒前
4秒前
怡然的啤酒完成签到,获得积分10
5秒前
碧蓝紫山完成签到,获得积分10
5秒前
惊雷Jww完成签到,获得积分10
5秒前
小斌完成签到,获得积分10
5秒前
5秒前
zxx发布了新的文献求助10
5秒前
5秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1500
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
John McDowells Bildungstheorie 800
八旗制度の研究 600
Analyses de reconnaissances de dettes passées devant les échevins d'Ypres (1249-1291) 600
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8159542
求助须知:如何正确求助?哪些是违规求助? 9555044
关于积分的说明 21724263
捐赠科研通 7749434
什么是DOI,文献DOI怎么找? 3427246
关于科研通互助平台的介绍 2552263
邀请新用户注册赠送积分活动 2471618