亲爱的研友该休息了!由于当前在线用户较少,发布求助请尽量完整地填写文献信息,科研通机器人24小时在线,伴您度过漫漫科研夜!身体可是革命的本钱,早点休息,好梦!

1291 Multi-modal deep learning integrating radiology and pathology images to predict cancer immunotherapy response: a retrospective multi-cohort study

作者
Yuming Jiang,Zhe Li,Ruijiang Li
出处
期刊: 卷期号:: A1434-A1434 被引量:2
标识
DOI:10.1136/jitc-2023-sitc2023.1291
摘要

Background There is a critical unmet need for predictive biomarkers of cancer immunotherapy. The tumor microenvironment (TME) plays an important role in determining immunotherapy response and outcomes. Here, we aimed to develop and validate a multi-modal deep learning model that integrates routine histopathology and radiology images to predict TME status and immunotherapy response in gastric cancer patients. Methods In this retrospective multi-cohort study, we developed a multitask deep learning model for the simultaneous prediction of TME status and disease-free survival using CT images and whole slide haematoxylin and eosin (H&E)-stained images. Four classes of TME were defined according to five immune biomarkers assessed by immunohistochemistry. We trained a deep convolutional neural network model using the training cohort of 320 patients and tested the model in the internal and external validation cohorts. To fuse CT and H&E images, we first concatenate the density map of different types as the global feature of the whole-slide image and the CT, resulting in a multi-channel image. Then we feed this multi-channel image into the classification network for training and testing. We compared model performance with other deep learning models (single modal models, and single task models). Further, we evaluated the model’s association with prognosis and ability to predict immunotherapy response. Multivariable analysis was performed using a logistic regression method to see how different parameters (gender, age, smoking status, image model) affected immunotherapy response. Results The deep-learning model achieved a high accuracy for assessing TME status in both internal and external validation cohorts (AUC 0.81–0.85). The performance of multi-modal multi-task models was superior to single modal models and single task models in the validation cohorts. The deep-learning model was significantly associated with disease-free survival and overall survival in all cohorts (p<0.0001). The model remained an independent prognostic factor adjusting for clinicopathological variables including tumor size, stage, differentiation, and Lauren histology. Moreover, the deep-learning model achieved a higher accuracy (AUC 0.78) for prediction of immunotherapy response than programmed death-ligand 1 combined positive score (CPS), and their combination further improved the response prediction accuracy. Conclusions The multi-modal multi-task deep-learning model could allow for accurate evaluation of TME status from CT and H&E images. Furthermore, the deep-learning model predicted immunotherapy response and outcomes in gastric cancer. Exploration of TME in multi-modal data may be a promising avenue for precision immunotherapy. Ethics Approval Ethical approval was obtained from the institutional review boards of the participating centers, and patient consent was waived for this retrospective analysis. Consent Ethical approval was obtained from the institutional review boards of the participating centers, and patient consent was waived for this retrospective analysis.

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
贪玩千儿完成签到,获得积分10
1秒前
7秒前
魔幻的松思完成签到,获得积分10
12秒前
冷艳千柳完成签到,获得积分10
26秒前
35秒前
感性的念之完成签到,获得积分10
54秒前
1分钟前
1分钟前
坚定百褶裙完成签到,获得积分10
1分钟前
1分钟前
漂亮的幻枫完成签到,获得积分10
1分钟前
Crisp完成签到 ,获得积分0
1分钟前
枕月完成签到,获得积分10
1分钟前
精明凝海发布了新的文献求助10
1分钟前
悲凉的丝完成签到,获得积分10
2分钟前
2分钟前
饱满飞绿完成签到,获得积分10
2分钟前
ajing发布了新的文献求助10
2分钟前
朴实水云完成签到,获得积分10
2分钟前
2分钟前
2分钟前
枕月发布了新的文献求助10
2分钟前
生动的依白完成签到,获得积分10
3分钟前
AnYX完成签到 ,获得积分10
3分钟前
震动的醉蓝完成签到,获得积分10
3分钟前
3分钟前
Prof.Z发布了新的文献求助80
3分钟前
3分钟前
忧心的棒球完成签到,获得积分10
3分钟前
3分钟前
万霖完成签到,获得积分10
3分钟前
3分钟前
曾经凌萱发布了新的文献求助10
4分钟前
愉快的书桃完成签到,获得积分10
4分钟前
4分钟前
4分钟前
4分钟前
香蕉觅云的应助被曾经凌萱采纳,获得10
4分钟前
慢读文献完成签到,获得积分10
4分钟前
yuxia完成签到 ,获得积分10
4分钟前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
John McDowells Bildungstheorie 800
Social Psychology in the Real World 600
八旗制度の研究 600
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8179896
求助须知:如何正确求助?哪些是违规求助? 9570103
关于积分的说明 21808343
捐赠科研通 7775692
什么是DOI,文献DOI怎么找? 3433193
关于科研通互助平台的介绍 2557334
邀请新用户注册赠送积分活动 2478881