Diagnostic agreement between ChatGPT ‐based interpretation of laboratory‐generated flow cytometry graphical outputs and hematologist consensus in suspected acute leukemia

医学 急性白血病 血液学家 免疫分型 金标准(测试) 白血病 流式细胞术 医学诊断 回顾性队列研究 观察研究 病理 放射科 诊断准确性 内科学 骨髓 试验预测值 诊断试验 肿瘤科 急性淋巴细胞白血病 细胞仪 血液肿瘤 微小残留病
作者
Mesut Göçer,Kerem Kaan Aktaş,Batuhan Çayır,Erdal Kurtoğlu
出处
期刊:Cytometry Part B-clinical Cytometry [Wiley]
标识
DOI:10.1002/cyto.b.70097
摘要

Accurate, rapid, and standardized interpretation of multiparametric flow cytometry findings is essential for clinical decision-making in patients evaluated for suspected acute leukemia. This study aimed to evaluate the diagnostic performance of ChatGPT, a general-purpose large language model, in interpreting de-identified, laboratory-generated flow cytometry graphical outputs from patients with suspected acute leukemia and to assess its agreement with the consensus interpretation of two hematologists in terms of diagnostic classification, blast percentage estimation, and hematogone detection. This retrospective observational validation study included 560 patients who underwent bone marrow aspiration and flow cytometric immunophenotyping during their initial diagnostic evaluation for suspected acute leukemia. All included patients were undergoing initial diagnostic evaluation and had neither a previous diagnosis of leukemia nor prior leukemia-directed treatment. The consensus diagnosis established by two hematologists was considered the reference standard. Between May 4 and 15, 2026, de-identified, laboratory-generated PDF images containing flow cytometry dot plots from a three-tube acute leukemia panel comprising 28 antibody-fluorochrome combinations were uploaded directly through the ChatGPT Plus web interface and interpreted using GPT-5.5 (OpenAI). Raw FCS files were not provided. Using the same standardized prompt for each case, the model was asked to estimate the blast percentage, select a single most likely diagnosis from five predefined categories (no pathology, MDS, AML, B-ALL, or T-ALL), and determine the presence or absence of hematogones. The initial response for each case was archived and directly encoded without adjudication. Diagnosis-specific performance was evaluated using one-versus-rest sensitivity, specificity, positive predictive value, negative predictive value, accuracy, and F1-score. Overall agreement between ChatGPT-generated classifications and hematologist consensus was assessed using Cohen's kappa. Pearson's correlation coefficient was used to evaluate the association between blast percentage estimates, whereas Bland-Altman analysis was used to quantify agreement, systematic bias, and 95% limits of agreement. Hematogone detection was evaluated as a binary classification task using sensitivity, specificity, and accuracy. ChatGPT achieved an overall diagnostic accuracy of 78.8% (95% CI, 75.2%-81.9%), with substantial agreement with hematologist consensus (Cohen's κ = 0.712; 95% CI, 0.664-0.757). Diagnosis-specific sensitivity ranged from 69.2% to 87.3%, and PPV ranged from 60.0% to 93.5%. The highest sensitivity was observed for MDS, whereas the highest PPV was observed for no pathology. McNemar's test identified significant systematic differences between ChatGPT and hematologist classifications for no pathology (p = 0.041), AML (p = 0.008), and T-ALL (p = 0.023). Blast percentage estimates were strongly correlated (Pearson's r = 0.818; 95% CI, 0.789-0.844; p< 0.001); however, Bland-Altman analysis demonstrated a mean positive bias of 3.92 percentage points, indicating systematic overestimation by ChatGPT. For hematogone detection, ChatGPT achieved an accuracy of 89.5%, sensitivity of 70.3%, and specificity of 92.4%. ChatGPT-based flow cytometry interpretation showed promise for preliminary diagnostic classification and quality assurance applications. However, expert hematologist validation remains essential, particularly in scenarios associated with high diagnostic consequences, including AML and T-ALL classification, blast percentage estimation, and accurate discrimination of hematogones.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
wmm发布了新的文献求助10
刚刚
1秒前
cyf完成签到 ,获得积分10
1秒前
yon发布了新的文献求助10
2秒前
科研通AI6.4的应助被早早采纳,获得10
2秒前
赘婿的应助被12采纳,获得10
5秒前
天天快乐的应助被18756828852采纳,获得10
7秒前
干昕慈完成签到,获得积分10
7秒前
7秒前
科研通AI6.2的应助被可爱玫瑰采纳,获得10
9秒前
12完成签到,获得积分10
9秒前
小白完成签到,获得积分10
9秒前
9秒前
10秒前
zztzxhxhh完成签到,获得积分10
11秒前
彭于晏的应助被polymer1Ma采纳,获得10
12秒前
12秒前
脑洞疼的应助被笔尖划痕采纳,获得10
12秒前
Junsir发布了新的文献求助10
12秒前
清脆的冰枫完成签到 ,获得积分10
13秒前
时倾完成签到,获得积分10
14秒前
隐形曼青的应助被Maggie采纳,获得10
14秒前
石头完成签到 ,获得积分10
14秒前
怕黑的井完成签到,获得积分10
14秒前
忧伤的坤完成签到 ,获得积分10
15秒前
赘婿的应助被Dean采纳,获得30
15秒前
赘婿的应助被YM采纳,获得10
16秒前
16秒前
蓦然回首完成签到,获得积分10
16秒前
吃米线的应助被机智冰凡采纳,获得10
17秒前
Jasper的应助被ClaraEvans894采纳,获得10
18秒前
爱吃芝士完成签到,获得积分10
18秒前
20秒前
xmy完成签到 ,获得积分10
20秒前
20秒前
21秒前
风吹麦浪发布了新的文献求助10
21秒前
Avvei完成签到,获得积分10
22秒前
kqier发布了新的文献求助10
22秒前
mikel完成签到 ,获得积分10
23秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 2000
Handbook of Sport Coaching Research 1000
Orthognathic Surgery - 2 Volume Set 500
高分子基功能界面水蒸发材料与应用研究 500
外场增强的水汽发电研究 500
基于结构调控的功能化水诱导发电材料与器件研究 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8192871
求助须知:如何正确求助?哪些是违规求助? 9579281
关于积分的说明 21864358
捐赠科研通 7792445
什么是DOI,文献DOI怎么找? 3437059
关于科研通互助平台的介绍 2560639
邀请新用户注册赠送积分活动 2483928