脑电图
听力学
心理学
触觉技术
感觉刺激疗法
阿杜伊诺
感觉系统
频道(广播)
脑电波
刺激
计算机科学
认知心理学
神经科学
医学
模拟
计算机网络
操作系统
作者
Álvaro García López,Víctor Cerdán Martínez,Pablo Revuelta-Sanz,José Manuel Sánchez‐Pena,Tomás Ortiz Alonso,Ricardo Vergaz
出处
期刊:IEEE Access
[Institute of Electrical and Electronics Engineers]
日期:2023-01-01
卷期号:11: 111302-111314
标识
DOI:10.1109/access.2023.3322357
摘要
Audiovisual media are an essential source of information and leisure in our lives, but people with hearing disabilities lose the emotional content that is intended to be transmitted through this channel. Some previous studies have tried to find alternative ways to elicit these emotions using other sensory channels, and some attempts have been made with haptic systems synchronized with rhythms of music and action in movies, but they fail in studying deeply the provoked neural response. In this article, we propose the tactile channel as the alternative to the auditory channel to convey the emotions generated by audiovisual events, measuring the effect of a proprietary system in the emotions by monitoring neural response. We have developed a low-cost system consisting of an Arduino Uno, a pair of gloves with micromotors and a driver. Using EEG, we have measured brain activity generated during audiovisual stimulation of a short film with clearly negative emotional content, with and without synchronized tactile stimuli, in two groups of people, one without hearing impairment and the other with hearing impairment. We have used the Hotelling’s T2 test as a multivariate statistical analysis of EEG measurements. Comparing the difference in brain activation generated in the conditions with and without vibration in both groups, we have found that multimodal stimulation by touch and associated with audiovisual stimuli enhances in a 30% the emotional, attentional, and auditory circuits activation, due to brain reorganization around frontal and parietal structures (all related to emotional responses) in the hearing-impaired group.
科研通智能强力驱动
Strongly Powered by AbleSci AI