Information-Guided Fusion of Multimodal Vibrational Spectroscopy for Disease Diagnosis Based on Symbiotic Attention Decoupled Contrastive Learning

人工智能 可解释性 传感器融合 模式识别(心理学) 融合 机器学习 计算机科学 化学 卷积神经网络 医学诊断 模态(人机交互) 解耦(概率) 光谱学 感知器 人工神经网络 深度学习 干扰(通信) 拉曼光谱 补语(音乐) 联营 二维红外光谱 特征选择 先验与后验
作者
Xuguang Zhou,Wenjie Fan,Chen Chen,Xi Chen,Xi Chen,Yining Yang,Lijun Wu,Jin Gu,Lei Yan,Jing Tao,Xiaoyi Lv,Xiaoyi Lv,Cheng Chen,Cheng Chen
出处
期刊:Analytical Chemistry [American Chemical Society]
卷期号:98 (6): 4638-4652
标识
DOI:10.1021/acs.analchem.5c06086
摘要

Vibrational spectroscopy has gained significant attention in medical diagnosis due to its high sensitivity and nondestructive nature. Raman spectroscopy and infrared spectroscopy complement each other in their selection rules, vibration responses, and wavenumber coverage. Combining these two techniques can overcome the limitations of individual spectra, enhancing the accuracy of molecular structure identification. However, existing deep learning fusion methods often overlook the diagnostic advantages of different modalities, leading to overreliance on strong modalities or interference from weak modality noise, resulting in unstable fusion and imbalanced information flow. We propose a Symbiotic Attention Fusion Decoupled Network (SAFDN) to effectively model the information guidance mechanism. In the prefusion stage, we combine multilayer perceptrons and convolutional neural networks for intramodal encoding, laying the foundation for cross-modal fusion. Then, we design Symbiotic Attention Fusion (SAF) and Parasitic Attention Fusion (PAF) mechanisms to simulate biological symbiosis and parasitism, achieving a differentiated information enhancement. Finally, a supervised multimodal contrastive learning decoupling network is introduced to balance cross-modal consistency and intramodal cohesion, improving feature decoupling and semantic fusion. Experiments on cancer, autoimmune diseases, and cardiovascular disease data sets show that SAFDN outperforms existing methods, achieving accuracy and AUC values of 90.49%/0.9649, 95.48%/0.9866, and 96.67%/0.9934, respectively. SAFDN validates the advantages of the symbiotic effect in vibrational spectroscopy disease classification tasks through an in-depth comparison and analysis of fusion and loss mode ratios. This model provides an efficient solution for rapid, noninvasive precision medical diagnosis, improving the accuracy and interpretability of disease classification.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
平常丝应助yuxing采纳,获得50
1秒前
心中的太阳完成签到,获得积分10
2秒前
amelie发布了新的文献求助30
2秒前
2秒前
颜凡桃发布了新的文献求助10
2秒前
sisp发布了新的文献求助10
3秒前
3秒前
悄悄完成签到,获得积分10
3秒前
上官若男应助勤劳黑猫采纳,获得10
3秒前
慕青应助王一二采纳,获得10
4秒前
4秒前
cm发布了新的文献求助10
4秒前
natureking发布了新的文献求助10
4秒前
Lyan完成签到,获得积分10
4秒前
6秒前
6秒前
小二郎应助科研白采纳,获得30
6秒前
sanqiuguizi发布了新的文献求助10
6秒前
111发布了新的文献求助10
6秒前
彩色傲菡发布了新的文献求助30
6秒前
王嘉尔发布了新的文献求助30
7秒前
慕青应助科研小白人采纳,获得10
7秒前
汉堡包应助小魏采纳,获得10
7秒前
7秒前
8秒前
雀鸠四起完成签到,获得积分10
8秒前
ok俺是你的魂完成签到,获得积分10
8秒前
充电宝应助zzzzz采纳,获得10
8秒前
甜美的若完成签到,获得积分10
8秒前
8秒前
8秒前
大海风完成签到,获得积分10
9秒前
composite66完成签到,获得积分10
9秒前
天天快乐应助sklz采纳,获得10
9秒前
研究牛王完成签到,获得积分10
9秒前
jiushi17发布了新的文献求助20
10秒前
10秒前
Hou发布了新的文献求助10
10秒前
内向绿凝完成签到,获得积分10
10秒前
11秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
Navigating Normative Orders. Interdisciplinary Perspectives 800
Organizational Behavior 510
Management and the Arts 510
Matrix Methods in Data Mining and Pattern Recognition Second Edition 510
CLSI VET01S-2024 Performance Standards for Antimicrobial Disk and Dilution Susceptibility Tests for Bacteria Isolated From Animals (7th Ed) 500
A Case Study on Hotels as Noncongregate Emergency Living Accommodations for Returning Citizens 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 工程类 有机化学 化学工程 生物化学 计算机科学 内科学 物理 复合材料 催化作用 细胞生物学 无机化学 光电子学 物理化学 电极 基因
热门帖子
关注 科研通微信公众号,转发送积分 7756688
求助须知:如何正确求助?哪些是违规求助? 9303110
关于积分的说明 20272743
捐赠科研通 7340049
什么是DOI,文献DOI怎么找? 3311584
关于科研通互助平台的介绍 2462454
邀请新用户注册赠送积分活动 2325178