Readability and Quality of Large Language Model Patient Education for Trigeminal Neuralgia: A Cross-Sectional Study

可读性 病人教育 质量(理念) 医学 医学教育 病人护理 医学物理学 计算机科学 梅德林 心理学 自然语言处理 质量管理 理解力 模拟病人 患者满意度 多媒体 语言模型
作者
Hao Wei,Sisi Sun,Mingxin Liu,Yi Jin
出处
期刊:Journal of Visualized Experiments [MyJOVE]
卷期号: (234)
标识
DOI:10.3791/70833
摘要

Large language models (LLMs) are increasingly used for patient health education, yet the readability and educational quality of LLM-generated information on trigeminal neuralgia (TN) have been insufficiently evaluated. This cross-sectional benchmarking study compared TN educational content generated by five publicly available LLMs (Doubao, DeepSeek, Wenxin Yiyan, Tongyi Qianwen, and GPT-5). Twenty frequently asked TN questions covering basic disease knowledge, etiology/risk factors, diagnosis, treatment, and prevention/rehabilitation were presented to each model using standardized prompts. Readability was assessed using seven established indices, educational suitability using the Patient Education Materials Assessment Tool for Understandability and Actionability (PEMAT), and overall information quality using the Global Quality Score (GQS). Two clinical experts independently evaluated all responses, with disagreements resolved by a senior adjudicator. Statistical analyses compared model performance, thematic differences, and correlations among the evaluation metrics. Significant differences were observed among the models for readability, PEMAT, and GQS scores. GPT-5 generated the most linguistically complex responses but achieved the highest ratings for educational suitability and information quality. In contrast, Wenxin Yiyan produced the most readable text but generally scored lower on PEMAT and GQS. Content category influenced readability, with prevention/rehabilitation and etiology/risk-factor topics being more difficult to read, whereas PEMAT and GQS remained relatively consistent across themes. Readability indices showed strong internal consistency and weak-to-moderate positive correlations with PEMAT and GQS, while PEMAT and GQS demonstrated a moderate positive correlation. These findings suggest that model selection influences expert-rated educational suitability and overall information quality, whereas topic complexity primarily affects readability. Because patient comprehension, satisfaction, trust, health outcomes, factual accuracy, and clinical safety were not evaluated, these results should be interpreted as an expert-rated benchmarking analysis rather than evidence of clinical readiness.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
丘比特的应助被September采纳,获得10
刚刚
青枣不甜完成签到,获得积分10
1秒前
cdercder的应助被fsdgsd采纳,获得10
1秒前
所所的应助被学阿斗采纳,获得10
2秒前
YXM发布了新的文献求助10
2秒前
纯真大象发布了新的文献求助10
2秒前
2秒前
maT发布了新的文献求助10
2秒前
szztty发布了新的文献求助10
3秒前
小马甲的应助被kuku采纳,获得10
3秒前
sunny完成签到,获得积分10
4秒前
qin202569发布了新的文献求助10
4秒前
繁荣的瑛的应助被楠小楠采纳,获得10
5秒前
初景的应助被楠小楠采纳,获得20
5秒前
科研通AI2S的应助被楠小楠采纳,获得10
5秒前
科研通AI6.4的应助被楠小楠采纳,获得10
5秒前
余香的应助被楠小楠采纳,获得10
5秒前
orixero的应助被细心又菡采纳,获得10
5秒前
DW的应助被楠小楠采纳,获得10
5秒前
Sea完成签到,获得积分10
5秒前
Lucas的应助被明理诗槐采纳,获得10
6秒前
科研通AI6.3的应助被楠小楠采纳,获得10
6秒前
123的应助被楠小楠采纳,获得100
6秒前
充电宝的应助被楠小楠采纳,获得10
6秒前
天天向上的应助被楠小楠采纳,获得10
6秒前
kkkk发布了新的文献求助10
6秒前
7秒前
ce完成签到 ,获得积分10
7秒前
molihuakai的应助被迷路依白采纳,获得10
8秒前
纯真大象完成签到,获得积分10
8秒前
yyds发布了新的文献求助50
9秒前
molihuakai的应助被D调的华丽采纳,获得10
9秒前
华仔的应助被D调的华丽采纳,获得10
9秒前
hzq完成签到,获得积分10
9秒前
CarryLJR的应助被龙澍采纳,获得10
9秒前
科目三的应助被D调的华丽采纳,获得10
9秒前
10秒前
华仔的应助被D调的华丽采纳,获得10
10秒前
脑洞疼的应助被D调的华丽采纳,获得10
10秒前
隐形曼青的应助被D调的华丽采纳,获得10
10秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
Grapes 1000
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
John McDowells Bildungstheorie 800
八旗制度の研究 600
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8178960
求助须知:如何正确求助?哪些是违规求助? 9569638
关于积分的说明 21805682
捐赠科研通 7774071
什么是DOI,文献DOI怎么找? 3432955
关于科研通互助平台的介绍 2556897
邀请新用户注册赠送积分活动 2478640