模态(人机交互)
人工智能
模式
肺癌
模式治疗法
计算机科学
医学
缺少数据
生存分析
代表(政治)
特征(语言学)
判别式
总体生存率
组织病理学
特征提取
疾病
阶段(地层学)
模式识别(心理学)
机器学习
比例危险模型
深度学习
治疗方式
危险分层
传感器融合
融合
协变量
肿瘤科
放射科
存活率
癌症
作者
Filippo Ruffini,Camillo Maria Caruso,Claudia Tacconi,Lorenzo Nibid,Francesca Miccolis,Marta Lovino,Carlo Greco,Edy Ippolito,Michele Fiore,Alessio Cortellini,Bruno Beomonte Zobel,Giuseppe Perrone,Bruno Vincenzi,Claudio Marrocco,Alessandro Bria,Elisa Ficarra,Sara Ramella,Valerio Guarrasi,Paolo Soda
标识
DOI:10.1038/s41746-026-02783-3
摘要
Accurate survival prediction in non-small cell lung cancer (NSCLC) requires integrating clinical, radiological, and histopathological data. Multimodal deep learning (MDL) can improve precision prognosis, but small cohorts and missing modalities limit its clinical applicability, as conventional approaches enforce complete-case filtering or imputation. We present a missing-aware multimodal survival framework that combines computed tomography (CT), whole-slide histopathology images (WSI), and structured clinical variables for overall survival modeling in unresectable stage II-III NSCLC. The framework uses foundation models (FMs) for modality-specific feature extraction and a missing-aware encoding strategy that enables intermediate multimodal fusion under naturally incomplete modality profiles. By design, the architecture processes all available data without dropping patients during training or inference. Intermediate fusion outperforms unimodal baselines and both early and late fusion strategies, with the trimodal configuration reaching a C-index of 74.42. Modality-importance analyses show that the fusion model adapts its reliance on each data stream according to representation informativeness, shaped by the alignment between FM pretraining objectives and the survival task. The learned risk scores produce clinically meaningful stratification of disease progression and metastatic risk, with statistically significant log-rank tests across all modality combinations, supporting the translational relevance of the proposed framework.
科研通智能强力驱动
Strongly Powered by AbleSci AI