线性子空间
判别式
计算机科学
成对比较
人工智能
子空间拓扑
模式
机器学习
钥匙(锁)
冗余(工程)
光学(聚焦)
情绪分析
自然语言处理
正规化(语言学)
不可见的
模式识别(心理学)
传感器融合
数据挖掘
深度学习
模态(人机交互)
分类器(UML)
可识别性
生物识别
可视化
自编码
作者
Chunlei Meng,Jiabin Luo,Zhenglin Yan,Zhenyu Yu,Rong Fu,Zhongxue Gan,Chun Ouyang
标识
DOI:10.48550/arxiv.2602.19585
摘要
Multimodal Sentiment Analysis (MSA) integrates language, visual, and acoustic modalities to infer human sentiment. Most existing methods either focus on globally shared representations or modality-specific features, while overlooking signals that are shared only by certain modality pairs. This limits the expressiveness and discriminative power of multimodal representations. To address this limitation, we propose a Tri-Subspace Disentanglement (TSD) framework that explicitly factorizes features into three complementary subspaces: a common subspace capturing global consistency, submodally-shared subspaces modeling pairwise cross-modal synergies, and private subspaces preserving modality-specific cues. To keep these subspaces pure and independent, we introduce a decoupling supervisor together with structured regularization losses. We further design a Subspace-Aware Cross-Attention (SACA) fusion module that adaptively models and integrates information from the three subspaces to obtain richer and more robust representations. Experiments on CMU-MOSI and CMU-MOSEI demonstrate that TSD achieves state-of-the-art performance across all key metrics, reaching 0.691 MAE on CMU-MOSI and 54.9% ACC-7 on CMU-MOSEI, and also transfers well to multimodal intent recognition tasks. Ablation studies confirm that tri-subspace disentanglement and SACA jointly enhance the modeling of multi-granular cross-modal sentiment cues.
科研通智能强力驱动
Strongly Powered by AbleSci AI