计算机科学
推论
嵌入
一般化
人工智能
人体骨骼
对象(语法)
图形
骨架(计算机编程)
特征(语言学)
模式识别(心理学)
计算机视觉
弹道
机器学习
理论计算机科学
数学
物理
天文
数学分析
哲学
语言学
程序设计语言
作者
Qiyue Li,Xiaodong Xie,Chen Zhang,Jin Zhang,Guangming Shi
标识
DOI:10.1016/j.neucom.2022.08.008
摘要
This article focuses on the task of detecting human-object interactions (HOI) in videos, with the goal of identifying objects interacting with humans and predicting human-object interaction classes. Two frameworks are proposed which detect human-object interactions in videos by modeling the trajectory of objects and human skeleton. The first framework (knowledge-based spatial-temporal HOI) treats the entire scene to be a HOI graph made up of the human skeleton and objects. It has fewer parameters and a higher possibility for knowledge embedding. The second framework (hierarchical spatial-temporal HOI) constructs a HOI graph after obtaining the feature of the human skeleton and objects. It outperforms the competition in terms of performance and generalization. Experimental results in CAD-120 dataset and SYSU-HOI dataset show that the proposed frameworks are more advanced than the state-of-the-art methods, with smaller parameters and shorter inference time. Such results confirm that the proposed frameworks effectively reduce parameters and inference time while maintaining detection accuracy in HOI videos.
科研通智能强力驱动
Strongly Powered by AbleSci AI