Artificial intelligence as a modality to enhance the readability of neurosurgical literature for patients

医学 模态(人机交互) 可读性 治疗方式 医学物理学 人工智能 外科 语言学 计算机科学 哲学
作者
Gage A. Guerra,Sophie Grove,Jonathan Le,Hayden L. Hofmann,Ishan Shah,Sweta Bhagavatula,Benjamin B. Fixman,David Gómez,Benjamin S. Hopkins,Jonathan Dallas,Giovanni Enrico Cacciamani,Racheal Peterson,Gabriel Zada
出处
期刊:Journal of Neurosurgery [American Association of Neurological Surgeons]
卷期号:142 (4): 1-7 被引量:12
标识
DOI:10.3171/2024.6.jns24617
摘要

OBJECTIVE: In this study the authors assessed the ability of Chat Generative Pretrained Transformer (ChatGPT) 3.5 and ChatGPT4 to generate readable and accurate summaries of published neurosurgical literature. METHODS: Abstracts published in journal issues released between June 2023 and August 2023 (n = 150) were randomly selected from the top 5 ranked neurosurgical journals according to Google Scholar. ChatGPT models were instructed to generate a readable layperson summary of the original abstract from a statistically validated prompt. Readability results and grade-level indicators (RR-GLIs) scores were calculated for GPT3.5- and GPT4-generated summaries and original abstracts. Two physicians independently rated the accuracy of ChatGPT-generated layperson summaries to assess scientific validity. One-way ANOVA followed by pairwise t-test with Bonferroni correction were performed to compare readability scores. Cohen's kappa was used to assess interrater agreement between the two rater physicians. RESULTS: Analysis of 150 original abstracts showed a statistically significant difference for all RR-GLIs between the ChatGPT-generated summaries and original abstracts. The readability scores are formatted as follows (original abstract mean, GPT3.5 summary mean, GPT4 summary mean, p value): Flesch-Kincaid reading grade (12.55, 7.80, 7.70, p < 0.0001); Gunning fog score (15.46, 10.00, 9.00, p < 0.0001); Simple Measure of Gobbledygook (SMOG) index (11.30, 7.13, 6.60, p < 0.0001); Coleman-Liau index (14.67, 11.32, 10.26, p < 0.0001); automated readability index (10.87, 8.50, 7.75, p < 0.0001); and Flesch-Kincaid reading ease (33.29, 68.45, 69.55, p < 0.0001). GPT4-generated summaries demonstrated higher RR-GLIs than GPT3.5-generated summaries in the following categories: Gunning fog score (0.0003); SMOG index (0.027); Coleman-Liau index (< 0.0001); sentences (< 0.0001); complex words (< 0.0001); and % complex words (0.0035). A total of 68.4% and 84.2% of GPT3.5- and GPT4-generated summaries, respectively, maintained moderate scientific accuracy according to the two physician-reviewers. CONCLUSIONS: The findings demonstrate promising potential for application of the ChatGPT in patient education. GPT4 is an accessible tool that can be an immediate solution to enhancing the readability of current neurosurgical literature. Layperson summaries generated by GPT4 would be a valuable addition to a neurosurgical journal and would be likely to improve comprehension for patients using internet resources like PubMed.

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
无极微光的应助被失眠茗采纳,获得20
1秒前
dongtan完成签到 ,获得积分10
1秒前
1秒前
1秒前
1秒前
哲学家完成签到,获得积分10
2秒前
2秒前
爱吃香菜完成签到,获得积分10
2秒前
lulu发布了新的文献求助10
3秒前
4秒前
4秒前
4秒前
5秒前
5秒前
6秒前
ZYC发布了新的文献求助10
6秒前
昏睡的乌冬面完成签到 ,获得积分10
7秒前
DD发布了新的文献求助10
7秒前
夏日行发布了新的文献求助20
8秒前
科研通AI6.3的应助被yn107采纳,获得10
9秒前
上官若男的应助被牧百川采纳,获得10
10秒前
无花果的应助被有魅力的寄凡采纳,获得10
10秒前
ajing发布了新的文献求助20
11秒前
soilman发布了新的文献求助10
12秒前
bingbing发布了新的文献求助10
12秒前
asdfghjkl发布了新的文献求助10
13秒前
13秒前
烟味完成签到,获得积分10
13秒前
月凯完成签到 ,获得积分10
14秒前
旺旺哥哥发布了新的文献求助10
14秒前
14秒前
Maestro_S的应助被gengar采纳,获得10
16秒前
十一完成签到,获得积分20
17秒前
PAPA完成签到,获得积分10
20秒前
21秒前
21秒前
十一发布了新的文献求助10
22秒前
23秒前
思源的应助被nhzz2023采纳,获得10
23秒前
Cheney完成签到 ,获得积分10
23秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
八旗制度の研究 600
Improving the wear resistance of vehicle gear oil by oil soluble LaF3 nanoparticles and typical additives of gear oil 500
Boundaries and Bodhisattvas 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8183621
求助须知:如何正确求助?哪些是违规求助? 9572918
关于积分的说明 21828010
捐赠科研通 7780809
什么是DOI,文献DOI怎么找? 3434031
关于科研通互助平台的介绍 2558243
邀请新用户注册赠送积分活动 2480496