多模态
计算机科学
个性化
情绪分析
试验台
投资(军事)
XBRL
JSON文件
投资策略
投资回报率
转化式学习
启发式
金融市场
操作化
一套
经济
人工智能
水准点(测量)
模式(遗传算法)
财务
多式联运
山寨
数据科学
业务
稳健性(进化)
反事实思维
元数据
工作(物理)
搜索引擎索引
交易策略
作者
Su Tan,Chi Chiu So,Yueyue Sun,Jun‐Min Wang,Anthony Wai-keung Loh,Siu Pang Yung
出处
期刊:
[Association for Computing Machinery]
日期:2025-11-14
卷期号:: 960-968
被引量:1
标识
DOI:10.1145/3768292.3770368
摘要
In the rapidly evolving financial landscape, sentiment analysis has emerged as a critical tool for decoding market dynamics, yet traditional approaches remain confined to textual data, overlooking the rich multimodal cues embedded in audio and video. This paper unveils a pioneering zero-shot framework that harnesses Multimodal Large Language Models (MLLMs) to revolutionize sentiment-driven investment by integrating text, audio, and video modalities. We introduce a comprehensive suite of metrics to extract nuanced emotional signals, a self-consistent signal verification mechanism to enhance market prediction reliability, and a JSON schema for seamless automation. To validate this innovation, we curate the White House Press Briefing (WHPB) Video Benchmark Database, a novel dataset of 30 press briefings from January to July 2025, offering a robust testbed for multimodal analysis. Our extensive experiments demonstrate that the full-multimodal approach, leveraging text, audio, and video, outperforms text-only and text-audio baselines, achieving superior returns across diverse assets, including a remarkable 2,843.9% annualized return on the VIX. This work not only redefines financial sentiment analysis but also sets a transformative foundation for AI-driven investment strategies, empowering investors with unprecedented insights into market sentiment. Our WHPH database is available at https://github.com/sutan244/White-House-Press-Briefing-Video-Benchmark-Dataset-WHPB.
科研通智能强力驱动
Strongly Powered by AbleSci AI