Large Language Model Assistant for Emergency Department Discharge Documentation

文档 急诊科 医疗急救 计算机科学 程序设计语言 医学 护理部
作者
Ji Woo Song,Junseong Park,Ji Hoon Kim,Seng Chan You
出处
期刊:JAMA network open [American Medical Association]
卷期号:8 (10): e2538427-e2538427
标识
DOI:10.1001/jamanetworkopen.2025.38427
摘要

Importance Emergency department (ED) discharge documentation is time-consuming and often incomplete. Objective To develop a large language model (LLM) assistant that generates ED discharge notes and to evaluate its effectiveness on documentation quality and workflow efficiency. Design, Setting, and Participants This comparative effectiveness study, which was conducted at a 2400-bed tertiary care hospital in South Korea, consisted of 2 primary phases: a development phase and sequential validation of the LLM assistant. In the randomized sequential prospective validation, 6 emergency physicians first wrote discharge notes manually (session 1), then edited LLM-generated drafts after a 1-hour washout period (session 2). Three independent physicians evaluated 300 note sets (each containing a manual note, an LLM draft, and an LLM-assisted note). For model development and validation, patient records from ED visits between September 1, 2022, and August 31, 2023, were used. The inclusion criteria encompassed adult patients (aged ≥17 years) and pediatric patients with nondisease conditions (eg, trauma, poisoning, or burns). Emergency physicians selected 592 representative cases for training and 50 for validation. Exposure A commercially available text generation transformer model was used as a core LLM, fine-tuned using the 592 training cases. Two distinct processing pipelines were implemented within the LLM assistant due to different input data: (1) for patients managed solely by emergency physicians, using the ED initial record and prescription list, and (2) for those requiring specialty consultations, using the ED initial record and consultation request form. Main Outcomes and Measures Quality of notes using 4C metrics (completeness, correctness, conciseness, and clinical utility) on a Likert scale ranging from 1 to 5 and time taken to complete the notes manually and with the LLM assistant. Results Of the 50 test cases, the mean (SD) patient age was 57.7 (23.1) years, and 28 patients (56%) were female. LLM-assisted notes achieved higher scores than manual notes in completeness (4.23 [95% CI, 4.17-4.28] vs 4.03 [95% CI, 3.96-4.09]), correctness (4.38 [95% CI, 4.33-4.42] vs 4.20 [95% CI, 4.14-4.26]), conciseness (4.23 [95% CI, 4.18-4.28] vs 4.11 [95% CI, 4.05-4.17]), and clinical utility (4.17 [95% CI, 4.11-4.23] vs 3.85 [95% CI, 3.78-3.91]) (all P < .001). When compared with LLM drafts, LLM-assisted notes excelled in conciseness (4.23 vs 3.98 [95% CI, 3.91-4.04]; P < .001) and maintained equivalent clinical utility (4.17 vs 4.16 [95% CI, 4.11-4.21]; P > .99), but scored lower in completeness (4.23 vs 4.34 [95% CI, 4.29-4.39]; P = .001) and correctness (4.38 vs 4.45 [95% CI, 4.41-4.49]; P < .001). The median documentation time per note dropped from 69.5 (95% CI, 65.5-78.0) seconds for manual notes to 32.0 (95% CI, 29.5-36.0) seconds for LLM-assisted notes ( P < .001). Conclusion In this comparative effectiveness study, use of an on-site LLM assistant was associated with reduced writing time for ED discharge notes compared with manual note-taking, without compromising documentation quality, representing a critical advancement in the use of artificial intelligence for clinical practice.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
刚刚
1秒前
1秒前
小马甲的应助被爱笑凤凰采纳,获得20
2秒前
2秒前
王涛发布了新的文献求助30
3秒前
3秒前
钰拉A梦发布了新的文献求助10
4秒前
5秒前
如意山晴完成签到 ,获得积分10
5秒前
Aurora完成签到 ,获得积分10
5秒前
5秒前
chenzhaoyang发布了新的文献求助10
5秒前
乔一完成签到,获得积分20
6秒前
哈哈发布了新的文献求助10
6秒前
8秒前
8秒前
8秒前
淡然冬灵发布了新的文献求助10
8秒前
9秒前
栗子完成签到 ,获得积分10
9秒前
驰驰发布了新的文献求助10
9秒前
11秒前
12秒前
12秒前
12秒前
12秒前
NexusExplorer的应助被淡然冬灵采纳,获得10
12秒前
陈奕迅发布了新的文献求助30
14秒前
我是666发布了新的文献求助10
14秒前
14秒前
七七发布了新的文献求助10
14秒前
黄卡卡发布了新的文献求助10
14秒前
jys完成签到,获得积分10
14秒前
打打的应助被无敌小宝贝采纳,获得10
15秒前
Polya完成签到 ,获得积分10
15秒前
16秒前
16秒前
单薄幻梦发布了新的文献求助10
16秒前
奈特奶糖发布了新的文献求助10
16秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
Grapes 1000
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
John McDowells Bildungstheorie 800
八旗制度の研究 600
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8178960
求助须知:如何正确求助?哪些是违规求助? 9569638
关于积分的说明 21805682
捐赠科研通 7774071
什么是DOI,文献DOI怎么找? 3432955
关于科研通互助平台的介绍 2556897
邀请新用户注册赠送积分活动 2478640