计算机科学
人工智能
图形
糖尿病性黄斑水肿
医学
糖尿病性视网膜病变
模式识别(心理学)
图论
自然语言处理
机器学习
计算机视觉
黄斑水肿
医学影像学
文本挖掘
作者
Shijing Wu,Yifan Zheng,Tianyu Chen,Gang Wu,Qinkun Zhi,Ailing Sui,Haixia Bai,Junhui Shen,Li Zhang,Yao Wang,Jian Ma,Xiaoyun Fang,Yanming Zhu,Feiwei Qin,Zhiqing Chen
标识
DOI:10.1109/jbhi.2026.3670360
摘要
Accurately predicting individual responses to Anti-Vascular Endothelial Growth Factor (Anti-VEGF) efficacy in diabetic macular edema (DME) remains a critical challenge in personalized ophthalmic care. Existing methods often rely on unimodal data or suffer from ineffective multimodal feature extraction and fusion, leading to modality redundancy and performance degradation. To address these limitations, we propose MVTT-GMamba, a novel multimodal learning framework that integrates optical coherence tomography (OCT) images and structured clinical indicators for early and accurate Anti-VEGF efficacy prediction. At the core of MVTT-GMamba is a feature-wise heterogeneous graph reasoning paradigm that explicitly models inter-patient and inter-feature relations, together with an adaptive, graph-guided prediction head that progressively anneals structural priors into the classifier. Building on this core, we adopt domain-tailored MambaVision and TabTransformer encoders and an early cross-attention fusion module to realize fine-grained multimodal representation learning. Extensive experiments on both a private clinical dataset (DMETHERA-ECSAHZU) and the public APTOS2021 benchmark demonstrate that MVTT-GMamba consistently outperforms state-of-the-art methods across all evaluation metrics. In addition, Grad-CAM visualizations reveal that the model attends to clinically relevant retinal regions, providing enhanced interpretability.
科研通智能强力驱动
Strongly Powered by AbleSci AI