Internalizing reasoning via chain-of-thought and retrieval augmentation for multimodal sentiment analysis

计算机科学 情绪分析 人工智能 自然语言处理 机器学习 多模态 模式识别(心理学) 情报检索 深度学习 语音识别
作者
Yang Sun,Fengling Li,Tianshi Wang,Guoli Yang,Lei Zhu
出处
期刊:Information Fusion [Elsevier BV]
卷期号:135: 104491-104491
标识
DOI:10.1016/j.inffus.2026.104491
摘要

• We propose a unified framework adapting large models for precise sentiment tasks. • Hybrid tuning strategy merges explicit reasoning with intuitive discrimination. • Label-balanced retrieval selects diverse paradigms to mitigate context bias. • Contextual anchors enable internalized reasoning without verbose generation. • Extensive experiments demonstrate superior performance with high efficiency. Multimodal Sentiment Analysis (MSA) is critical for interpreting user-generated content, yet it remains challenging because textual and visual evidence is often inconsistent, only weakly grounded to fine-grained targets, and easily affected by noisy contextual cues. While Large Vision-Language Models (LVLMs) offer promising generalization capabilities, they often lack the granularity required for specific sentiment tasks and may suffer from hallucinations and unstable reasoning when multimodal cues are ambiguous or conflicting. To address these limitations, we propose a unified framework termed Internalized Reasoning via Chain-of-Thought and Retrieval Augmentation (IR-CTRA). Specifically, we introduce a dual-stream hybrid tuning strategy that integrates explicit chain-of-thought rationales with implicit in-context learning predictions within a shared parameter space. This approach bridges the gap between logical deduction and intuitive discrimination. Furthermore, to mitigate context-induced polarity bias, we design a label-balanced retrieval mechanism that dynamically selects diverse demonstration paradigms from a self-constructed repository. These paradigms serve as contextual anchors during inference, enabling the model to internalize reasoning processes without relying on verbose generation. Extensive experiments on benchmark datasets demonstrate that IR-CTRA achieves state-of-the-art performance across both sentence-level and aspect-level tasks, exhibiting superior parameter efficiency compared to larger-scale baselines, and achieving an accuracy improvement of up to 16.78% on the Twitter-2015 dataset over comparably sized models. The code and models are available at https://github.com/DandelionWow/IR-CTRA .
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
cdgbdfbsfdvsd发布了新的文献求助10
刚刚
xixi发布了新的文献求助10
刚刚
暗中讨饭完成签到,获得积分10
刚刚
刚刚
刚刚
细腻驳发布了新的文献求助10
1秒前
Island完成签到 ,获得积分10
1秒前
dong的应助被郝扬扬采纳,获得10
1秒前
1秒前
1秒前
DMF完成签到,获得积分10
1秒前
NIKO完成签到 ,获得积分10
1秒前
Dr.han完成签到,获得积分10
1秒前
1秒前
1秒前
研友_8KX15L完成签到,获得积分10
2秒前
麻辣火锅完成签到 ,获得积分10
2秒前
qyc完成签到,获得积分10
2秒前
2秒前
田様的应助被完工采纳,获得10
2秒前
YJ完成签到,获得积分10
3秒前
丘比特的应助被bingbing采纳,获得10
3秒前
tian发布了新的文献求助10
3秒前
3秒前
birch完成签到,获得积分10
3秒前
江城闲鹤完成签到,获得积分10
4秒前
zzzz完成签到,获得积分10
4秒前
在水一方的应助被茶米采纳,获得10
4秒前
耳机分你一只诺完成签到,获得积分10
4秒前
万物皆流完成签到,获得积分10
4秒前
4秒前
赫连人杰完成签到,获得积分10
4秒前
Hello的应助被宋小姐冲鸭采纳,获得10
4秒前
way完成签到,获得积分10
4秒前
喵喵苗发布了新的文献求助10
4秒前
wendy完成签到,获得积分10
5秒前
复杂蛋挞发布了新的文献求助10
5秒前
sunnyqqz完成签到,获得积分0
5秒前
5秒前
抹茶不迷糊完成签到,获得积分10
5秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
Energie-Contracting 1500
Klimaschutzrecht durch den Energiesektor im Mehrebenensystem – Ein Rechtsvergleich 1000
Oncology Clinical Trials: Successful Design, Conduct, and Analysis, Second Edition 800
Sustainable Engineered Micro/Nanofibers and Hybrid Nanocomposites for Environmental Remediation 400
Ecotourism 400
Liquidus diagram and viscosity estimation in pseudo-binary system Li2B6O10–LiF 300
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8076652
求助须知:如何正确求助?哪些是违规求助? 9494616
关于积分的说明 21382290
捐赠科研通 7644690
什么是DOI,文献DOI怎么找? 3400174
关于科研通互助平台的介绍 2529895
邀请新用户注册赠送积分活动 2438810