MIUIC: A Human-Computer Collaborative Multimodal Intention-Understanding Algorithm Incorporating Comfort Analysis

AbstractThe naturalness and safety of human-computer interaction have always been primary research focuses in the field of human-computer interaction. This paper proposes a multimodal intention understanding algorithm (MIUIC), which incorporates comfort analysis, as a solution to address the issues of low intention understanding rate, weak interaction, and weak collaboration that are often observed in most massage systems. The algorithm efficiently fuses multimodal data based on objective implicit information to address the challenge of low intention understanding rates caused by non-standard expression of natural behavior. Moreover, this algorithm incorporates comfort reasoning to detect and address intentions related to security threats while providing the ability for robots to make behavioral decisions through inverse active interaction, leading to more equitable human-robot interactions. To test the validity and safety of the MIUIC algorithm, we embedded the algorithm into a mechanical arm massage system. Subsequently, 45 elderly volunteers were invited to participate in experimental tests. Finally, to verify the validity and safety of the MIUIC algorithm, we assessed the algorithm in terms of four aspects, including multimodal intention recognition rate, the ability to reduce data dispersion, the intention enhancement rate under reverse human-machine interaction, and the rate of avoiding dangerous intentions. In conclusion, the MIUIC algorithm enhances the intention understanding rate and promotes.Keywords: Human-computer collaborationnature human-computer interactionintention understandingmultimodal fusion Disclosure statementNo potential conflict of interest was reported by the author(s).Additional informationFundingThis paper is supported by the Independent Innovation Team Project of Jinan City [No. 2019GXRC013].Notes on contributorsLiran ZhouLiran Zhou is a graduate student at the Department of Computer Science and Technology, University of Jinan. Her research interests lie in human-computer interaction and collaboration in elderly care.Zhiquan FengZhiquan Feng is a professor of Computer Science and Technology at University of Jinan. His work explores human-machine interaction and collaboration issues in topics such as smart education, elderly robots, and robotic arms.Hongyue WangHongyue Wang is a graduate student at the Department of Computer Science and Technology, University of Jinan. His research interests lie in human-computer interaction, virtual reality and artificial intelligence research in smart education.Qingbei GuoQingbei Guo is an associate professor of Computer Science and Technology at University of Jinan. His research at intersection of pat tern recognition and computer vision focuses especially on human computer collaboration.