计算机科学
语义学(计算机科学)
一致性(知识库)
推论
情态动词
认知
人工智能
情报检索
模式
光学(聚焦)
信息抽取
自然语言处理
心理学
社会科学
化学
物理
神经科学
社会学
高分子化学
光学
程序设计语言
作者
Lianwei Wu,Pusheng Liu,Yongqiang Zhao,Peng Wang,Yangning Zhang
标识
DOI:10.1109/tkde.2023.3280555
摘要
The existing models for multi-modal fake news detection focus mainly on capturing common similar semantics between different modalities to improve detection performance. However, they ignore the extraction of inconsistent features between these modalities. The intuitive cognition way people identify a piece of fake news is generally to discover if there are inconsistent semantics among news content itself and its comments, which could be abstracted as “comparing news image-text consistency - finding valuable comments - reasoning in-/consistency between news and comments”. Inspired by the cognitive process, we propose Human Cognition-based Consistency Inference Networks (HCCIN) to comprehensively explore consistent and inconsistent semantics for multi-modal fake news detection. Specifically, we first design cross-modal alignment layer to learn consistent semantics between textual and visual information within the multi-modal news, and then the comment clue discovery layer is devoted to ascertaining the most-concerned semantics by audiences between comments. Finally, we develop collaborative inference layer to drive news consistent semantics and the most-concerned semantics to reason and discover consistent and inconsistent information between them. Experiments on three public datasets, including Weibo, Twitter, and PHEME, reveal the superiority of our HCCIN.
科研通智能强力驱动
Strongly Powered by AbleSci AI