Information-Guided Fusion of Multimodal Vibrational Spectroscopy for Disease Diagnosis Based on Symbiotic Attention Decoupled Contrastive Learning

人工智能 可解释性 传感器融合 模式识别(心理学) 融合 机器学习 计算机科学 化学 卷积神经网络 医学诊断 模态(人机交互) 解耦(概率) 光谱学 感知器 人工神经网络 深度学习 干扰(通信) 拉曼光谱 补语(音乐) 联营 二维红外光谱 特征选择 先验与后验
作者
Xuguang Zhou,Wenjie Fan,Chen Chen,Xi Chen,Xi Chen,Yining Yang,Lijun Wu,Jin Gu,Lei Yan,Jing Tao,Xiaoyi Lv,Xiaoyi Lv,Cheng Chen,Cheng Chen
出处
期刊:Analytical Chemistry [American Chemical Society]
卷期号:98 (6): 4638-4652
标识
DOI:10.1021/acs.analchem.5c06086
摘要

Vibrational spectroscopy has gained significant attention in medical diagnosis due to its high sensitivity and nondestructive nature. Raman spectroscopy and infrared spectroscopy complement each other in their selection rules, vibration responses, and wavenumber coverage. Combining these two techniques can overcome the limitations of individual spectra, enhancing the accuracy of molecular structure identification. However, existing deep learning fusion methods often overlook the diagnostic advantages of different modalities, leading to overreliance on strong modalities or interference from weak modality noise, resulting in unstable fusion and imbalanced information flow. We propose a Symbiotic Attention Fusion Decoupled Network (SAFDN) to effectively model the information guidance mechanism. In the prefusion stage, we combine multilayer perceptrons and convolutional neural networks for intramodal encoding, laying the foundation for cross-modal fusion. Then, we design Symbiotic Attention Fusion (SAF) and Parasitic Attention Fusion (PAF) mechanisms to simulate biological symbiosis and parasitism, achieving a differentiated information enhancement. Finally, a supervised multimodal contrastive learning decoupling network is introduced to balance cross-modal consistency and intramodal cohesion, improving feature decoupling and semantic fusion. Experiments on cancer, autoimmune diseases, and cardiovascular disease data sets show that SAFDN outperforms existing methods, achieving accuracy and AUC values of 90.49%/0.9649, 95.48%/0.9866, and 96.67%/0.9934, respectively. SAFDN validates the advantages of the symbiotic effect in vibrational spectroscopy disease classification tasks through an in-depth comparison and analysis of fusion and loss mode ratios. This model provides an efficient solution for rapid, noninvasive precision medical diagnosis, improving the accuracy and interpretability of disease classification.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
阿里完成签到,获得积分10
刚刚
Kretschmann完成签到,获得积分0
1秒前
1秒前
鱼鱼完成签到,获得积分10
2秒前
yy完成签到 ,获得积分10
2秒前
孤风发布了新的文献求助10
2秒前
有魅力夜天完成签到 ,获得积分10
3秒前
闾丘晓蓝完成签到 ,获得积分10
5秒前
zz完成签到,获得积分10
5秒前
桃花岛岛主完成签到,获得积分10
5秒前
geopotter完成签到,获得积分10
5秒前
callmecjh完成签到 ,获得积分10
6秒前
顾守完成签到,获得积分10
7秒前
阿里发布了新的文献求助30
7秒前
Lucas应助lily采纳,获得10
9秒前
10秒前
11秒前
QI完成签到 ,获得积分10
12秒前
MI完成签到,获得积分10
12秒前
十年完成签到 ,获得积分10
13秒前
growl发布了新的文献求助10
16秒前
郭磊完成签到 ,获得积分10
16秒前
16秒前
孤风发布了新的文献求助10
17秒前
17秒前
Copyright应助钮卿采纳,获得10
18秒前
李健的粉丝团团长应助qf采纳,获得10
18秒前
自觉从云完成签到,获得积分10
18秒前
帝青坤灵发布了新的文献求助10
22秒前
lily发布了新的文献求助10
22秒前
雪白玲完成签到,获得积分10
23秒前
领导范儿应助凝安采纳,获得10
27秒前
28秒前
曾经的问夏完成签到 ,获得积分10
28秒前
nove999完成签到 ,获得积分0
31秒前
houmi发布了新的文献求助10
32秒前
32秒前
AllRightReserved完成签到 ,获得积分10
32秒前
科目三应助李言新采纳,获得10
34秒前
34秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
Nondestructive Testing Handbook: Vol. 4, Thermal and Infrared Testing (IR), 4th ed 800
Understanding Acculturation: The Process of Cultural Adjustment as Applied to International Migration 700
作者名:Kristopher P. Plain,悉尼大学的,目前只能查到其四篇论文,想找到其博士论文 590
Évora na Idade Média 555
Soil mites of the family Rhagidiidae (Actinedida: Eupodoidea). Morphology, Systematics, Ecology 520
Matrix Methods in Data Mining and Pattern Recognition Second Edition 510
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 工程类 有机化学 化学工程 生物化学 计算机科学 内科学 物理 复合材料 催化作用 细胞生物学 无机化学 光电子学 物理化学 电极 基因
热门帖子
关注 科研通微信公众号,转发送积分 7370934
求助须知:如何正确求助?哪些是违规求助? 8978519
关于积分的说明 19087621
捐赠科研通 7012975
什么是DOI,文献DOI怎么找? 3224993
关于科研通互助平台的介绍 2388627
邀请新用户注册赠送积分活动 2205666