Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women With Breast Cancer

医学 淋巴结 H&E染色 接收机工作特性 放射科 乳腺癌 深度学习 算法 淋巴 癌症 试验装置 病理 人工智能 内科学 机器学习 染色 计算机科学
作者
Babak Ehteshami Bejnordi,Mitko Veta,Paul Johannes van Diest,Bram van Ginneken,Nico Karssemeijer,Geert Litjens,Jeroen van der Laak,Meyke Hermsen,Quirine F. Manson,Maschenka Balkenhol,Oscar Geessink,Nikolas Stathonikos,Marcory CRF van Dijk,Peter Bult,Francisco Beça,Andrew H. Beck,Dayong Wang,Aditya Khosla,Rishab Gargeya,Humayun Irshad
出处
期刊:JAMA [American Medical Association]
卷期号:318 (22): 2199-2199 被引量:3393
标识
DOI:10.1001/jama.2017.14585
摘要

Importance: Application of deep learning algorithms to whole-slide pathology images can potentially improve diagnostic accuracy and efficiency. Objective: Assess the performance of automated deep learning algorithms at detecting metastases in hematoxylin and eosin-stained tissue sections of lymph nodes of women with breast cancer and compare it with pathologists' diagnoses in a diagnostic setting. Design, Setting, and Participants: Researcher challenge competition (CAMELYON16) to develop automated solutions for detecting lymph node metastases (November 2015-November 2016). A training data set of whole-slide images from 2 centers in the Netherlands with (n = 110) and without (n = 160) nodal metastases verified by immunohistochemical staining were provided to challenge participants to build algorithms. Algorithm performance was evaluated in an independent test set of 129 whole-slide images (49 with and 80 without metastases). The same test set of corresponding glass slides was also evaluated by a panel of 11 pathologists with time constraint (WTC) from the Netherlands to ascertain likelihood of nodal metastases for each slide in a flexible 2-hour session, simulating routine pathology workflow, and by 1 pathologist without time constraint (WOTC). Exposures: Deep learning algorithms submitted as part of a challenge competition or pathologist interpretation. Main Outcomes and Measures: The presence of specific metastatic foci and the absence vs presence of lymph node metastasis in a slide or image using receiver operating characteristic curve analysis. The 11 pathologists participating in the simulation exercise rated their diagnostic confidence as definitely normal, probably normal, equivocal, probably tumor, or definitely tumor. Results: The area under the receiver operating characteristic curve (AUC) for the algorithms ranged from 0.556 to 0.994. The top-performing algorithm achieved a lesion-level, true-positive fraction comparable with that of the pathologist WOTC (72.4% [95% CI, 64.3%-80.4%]) at a mean of 0.0125 false-positives per normal whole-slide image. For the whole-slide image classification task, the best algorithm (AUC, 0.994 [95% CI, 0.983-0.999]) performed significantly better than the pathologists WTC in a diagnostic simulation (mean AUC, 0.810 [range, 0.738-0.884]; P < .001). The top 5 algorithms had a mean AUC that was comparable with the pathologist interpreting the slides in the absence of time constraints (mean AUC, 0.960 [range, 0.923-0.994] for the top 5 algorithms vs 0.966 [95% CI, 0.927-0.998] for the pathologist WOTC). Conclusions and Relevance: In the setting of a challenge competition, some deep learning algorithms achieved better diagnostic performance than a panel of 11 pathologists participating in a simulation exercise designed to mimic routine pathology workflow; algorithm performance was comparable with an expert pathologist interpreting whole-slide images without time constraints. Whether this approach has clinical utility will require evaluation in a clinical setting.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
刘扣扣UU的应助被机灵语山采纳,获得10
1秒前
丘比特的应助被kiluto采纳,获得10
2秒前
3秒前
3秒前
bszh完成签到,获得积分10
3秒前
4秒前
anfang发布了新的文献求助10
6秒前
准好好完成签到,获得积分10
6秒前
科研通AI6.2的应助被Mortal采纳,获得10
6秒前
鱼湘完成签到,获得积分10
7秒前
eight完成签到,获得积分10
7秒前
7秒前
joysa完成签到,获得积分10
7秒前
orixero的应助被Lora采纳,获得10
8秒前
感动代芙完成签到,获得积分10
8秒前
9秒前
春风暮雪发布了新的文献求助10
9秒前
9秒前
MAK完成签到,获得积分10
9秒前
准好好发布了新的文献求助10
9秒前
小铭发布了新的文献求助10
9秒前
桐桐的应助被caojie采纳,获得10
9秒前
10秒前
Z_butterfly完成签到,获得积分10
11秒前
zcx给zcx的求助进行了留言
11秒前
liberty发布了新的文献求助10
12秒前
12秒前
喝口可乐完成签到 ,获得积分10
13秒前
土豆完成签到,获得积分10
13秒前
烽火戏诸侯完成签到,获得积分10
13秒前
13秒前
bgt完成签到 ,获得积分10
13秒前
豆豆完成签到 ,获得积分10
14秒前
14秒前
钰小憨发布了新的文献求助10
14秒前
王誉霖完成签到,获得积分10
15秒前
16秒前
16秒前
111发布了新的文献求助10
16秒前
bobo完成签到,获得积分10
16秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 2000
Agyptische Geschichte der 21.30. Dynastie 510
高分子基功能界面水蒸发材料与应用研究 500
外场增强的水汽发电研究 500
基于结构调控的功能化水诱导发电材料与器件研究 500
基于界面调控的高效湿气发电材料与器件研究 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8192723
求助须知:如何正确求助?哪些是违规求助? 9579144
关于积分的说明 21863903
捐赠科研通 7792268
什么是DOI,文献DOI怎么找? 3437013
关于科研通互助平台的介绍 2560633
邀请新用户注册赠送积分活动 2483864