计算机科学
提取器
语义学(计算机科学)
特征(语言学)
人工智能
钥匙(锁)
缺少数据
特征提取
分解
乳腺癌
数据挖掘
知识抽取
基线(sea)
模式识别(心理学)
机器学习
情报检索
纵向数据
元数据
知识库
自然语言处理
特征选择
癌症
栏(排版)
乳腺摄影术
作者
Chunyao Lu,Tianyu Zhang,Xinglong Liang,Yuan Gao,Luyi Han,Xin Wang,Nika Rasoolzadeh,Tao Tan,Ritse M. Mann
标识
DOI:10.1609/aaai.v40i9.37693
摘要
Accurate prediction of breast cancer recurrence after treatment is essential for improving long-term outcomes. However, existing models are limited by three key challenges: (1) they typically rely on single-modal data, missing cross-modal interactions; (2) they analyze static snapshots, failing to capture disease progression over time; and (3) they often perform coarse feature fusion, lacking semantic disentanglement and interpretability. To address these issues, we propose LUMIN (Longitudinal Multi-modal Knowledge Decomposition Network), a novel framework that integrates longitudinal mammograms and electronic health records (EHRs) for recurrence prediction. LUMIN leverages a vision-language contrastive pretraining backbone to align multi-modal representations and introduces two knowledge extraction modules: (1) a Cross-Modal Disentangled Knowledge Extractor (CM-DKE) that separates shared, complementary, and modality-specific information across imaging and text; and (2) a Temporal Evolution Disentangled Knowledge Extractor (TE-DKE) that captures time-invariant, time-varying, and time-specific features to model disease dynamics. Experiments on a large-scale dataset of 3,924 patients and 19,684 exams show that LUMIN significantly outperforms state-of-the-art baselines, demonstrating its effectiveness in capturing both multi-modal semantics and temporal heterogeneity for recurrence prediction.
科研通智能强力驱动
Strongly Powered by AbleSci AI