计算机科学
人工智能
编码器
心肌梗塞
模态(人机交互)
模式识别(心理学)
心电图
波形
特征提取
机器学习
融合
可扩展性
变压器
心肌梗死诊断
传感器融合
图像融合
QRS波群
医学影像学
解码方法
烧蚀
信号(编程语言)
数据挖掘
深度学习
计算机视觉
数据建模
作者
Xiantong Xiang,Longxiao Gao,Yuansheng Liu,Ningji Gong,Yongshun Gong
标识
DOI:10.1109/jbhi.2026.3669222
摘要
Accurate and timely diagnosis of cardiovascular diseases, particularly myocardial infarction (MI), remains a critical clinical challenge. Existing electrocardiogram (ECG) analysis methods often rely solely on asingle data modality, such as raw signals or waveform images, which limits their ability to capture thebroader physiological context. To address this limitation, we propose GFM-MIP, a Graph-informed and FiLM-enhanced Multimodal Fusion framework for myocardial infarction prediction. GFM-MIP integrates 12-lead ECG time-series signals, ECG images, and laboratory test results through a unified architecture. Specifically, it employs a Graphormer encoder to model inter-lead dependencies in ECG signals and a Vision Transformer to extract morphological patterns from ECG images, both modulated by patient-specific laboratory features using Feature-wise Linear Modulation (FiLM). A Transformer-based fusion module captures cross-modal interactions, while a contrastive learning objective encourages alignment between signal and image modalities. Experimental results on a real-world clinical dataset and three public benchmarks demonstrate that GFM-MIP consistently outperforms state-of-the-art baselines across multiple evaluation metrics. Ablation studies further validate the contribution of each modality and architectural component. The proposed framework offers a clinically meaningful and scalable solution for robust, multimodal cardiovascular diagnosis.
科研通智能强力驱动
Strongly Powered by AbleSci AI