From Revisions to Insights: Converting Radiology Report Revisions into Actionable Educational Feedback Using Generative AI Models

生成语法 生成模型 计算机科学 数据科学 心理学 人工智能
作者
Shawn K. Lyo,Suyash Mohan,Alvand Hassankhani,Abass Noor,Farouk Dako,Tessa Sundaram Cook
出处
期刊:Journal of Digital Imaging [Springer Science+Business Media]
卷期号:38 (2): 1265-1279 被引量:23
标识
DOI:10.1007/s10278-024-01233-4
摘要

Expert feedback on trainees' preliminary reports is crucial for radiologic training, but real-time feedback can be challenging due to non-contemporaneous, remote reading and increasing imaging volumes. Trainee report revisions contain valuable educational feedback, but synthesizing data from raw revisions is challenging. Generative AI models can potentially analyze these revisions and provide structured, actionable feedback. This study used the OpenAI GPT-4 Turbo API to analyze paired synthesized and open-source analogs of preliminary and finalized reports, identify discrepancies, categorize their severity and type, and suggest review topics. Expert radiologists reviewed the output by grading discrepancies, evaluating the severity and category accuracy, and suggested review topic relevance. The reproducibility of discrepancy detection and maximal discrepancy severity was also examined. The model exhibited high sensitivity, detecting significantly more discrepancies than radiologists (W = 19.0, p < 0.001) with a strong positive correlation (r = 0.778, p < 0.001). Interrater reliability for severity and type were fair (Fleiss' kappa = 0.346 and 0.340, respectively; weighted kappa = 0.622 for severity). The LLM achieved a weighted F1 score of 0.66 for severity and 0.64 for type. Generated teaching points were considered relevant in ~ 85% of cases, and relevance correlated with the maximal discrepancy severity (Spearman ρ = 0.76, p < 0.001). The reproducibility was moderate to good (ICC (2,1) = 0.690) for the number of discrepancies and substantial for maximal discrepancy severity (Fleiss' kappa = 0.718; weighted kappa = 0.94). Generative AI models can effectively identify discrepancies in report revisions and generate relevant educational feedback, offering promise for enhancing radiology training.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
梦寐寤寐发布了新的文献求助30
1秒前
小虾米完成签到 ,获得积分10
2秒前
2秒前
乐乐的应助被科研通管家采纳,获得10
3秒前
3秒前
领导范儿的应助被科研通管家采纳,获得10
3秒前
完美世界的应助被科研通管家采纳,获得10
3秒前
bkagyin的应助被科研通管家采纳,获得10
3秒前
共享精神的应助被科研通管家采纳,获得10
3秒前
xfy发布了新的文献求助200
3秒前
Ava的应助被科研通管家采纳,获得10
3秒前
唐圜完成签到 ,获得积分10
3秒前
充电宝的应助被科研通管家采纳,获得10
3秒前
无极微光的应助被科研通管家采纳,获得20
3秒前
ddg发布了新的文献求助10
4秒前
Maestro_S的应助被科研通管家采纳,获得10
4秒前
www的应助被科研通管家采纳,获得10
4秒前
深情安青的应助被科研通管家采纳,获得10
4秒前
香蕉觅云的应助被科研通管家采纳,获得10
4秒前
8R60d8的应助被科研通管家采纳,获得10
4秒前
初景发布了新的文献求助10
4秒前
星辰大海的应助被科研通管家采纳,获得10
4秒前
4秒前
5秒前
Hello的应助被科研通管家采纳,获得10
5秒前
5秒前
Ava的应助被萧小五采纳,获得10
5秒前
5秒前
研友_5Zl4VZ发布了新的文献求助10
5秒前
6秒前
7秒前
上山打老虎完成签到,获得积分10
7秒前
CipherSage的应助被天霸采纳,获得10
7秒前
7秒前
YD完成签到 ,获得积分10
7秒前
快乐的寄容完成签到 ,获得积分10
8秒前
8秒前
cmwxh完成签到,获得积分20
9秒前
在水一方的应助被可靠红米采纳,获得10
9秒前
10秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 2000
Handbook of Sport Coaching Research 1000
Orthognathic Surgery - 2 Volume Set 500
高分子基功能界面水蒸发材料与应用研究 500
外场增强的水汽发电研究 500
基于结构调控的功能化水诱导发电材料与器件研究 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8193361
求助须知:如何正确求助?哪些是违规求助? 9579602
关于积分的说明 21866201
捐赠科研通 7792983
什么是DOI,文献DOI怎么找? 3437263
关于科研通互助平台的介绍 2560718
邀请新用户注册赠送积分活动 2484082