计算机科学
知识图
图形
人工智能
链接(几何体)
数据挖掘
数据建模
图论
基于知识的系统
情报检索
机器学习
链路分析
噪声数据
知识抽取
模式识别(心理学)
作者
Yifan Xue,Yingyao Ma,Wanqiang Cai,Rubing Duan,Jiasong Wu,Lotfi Senhadji,Huazhong Shu
标识
DOI:10.1109/tkde.2026.3698924
摘要
Knowledge graphs (KGs) play a central role in enabling structured reasoning for AI applications. Recent research has advanced two prominent extensions of KGs: multimodal KGs, which integrate diverse data sources such as text, images, audio, and video; and temporal KGs, which capture the dynamic evolution of knowledge over time. However, these two paradigms remain largely disjoint—multimodal KGs typically ignore temporal dynamics, while temporal KGs overlook rich multimodal context. To bridge this gap, we introduceFocusKG, the first discrete-time multimodal knowledge graph that unifies four modalities (text, image, audio, and video) with temporal annotations. Built from the Focus news program, FocusKG captures real-world events as temporally grounded multimodal facts, offering new expressiveness for time-sensitive tasks. We further propose aDiscrete-TimeMultimodal Knowledge GraphEmbedding (DTME) method, a novel framework tailored for learning representations over temporal multimodal KGs. DTME is composed of three key modules: (1) Multimodal Preprocessing, which encodes raw inputs from each modality into vector representations using modality-specific encoders; (2) Cross-Modal Graph Enhancer, which captures semantic interplay between entity and relation modalities through role-aware subgraph construction and a modality interaction network; and (3) Multi-Branch Time Aggregation, which injects temporal signals by modeling interactions between time and modality-aware features. Extensive experiments demonstrate FocusKG's value and DTME's efficacy. On link prediction, DTME outperforms state-of-the-art multimodal KG models and temporal KG models. We release FocusKG as a benchmark to foster research in multimodal temporal reasoning.
科研通智能强力驱动
Strongly Powered by AbleSci AI