...
首页> 外文期刊>Multimedia Tools and Applications >Emotion recognition in response to traditional and tactile enhanced multimedia using electroencephalography
【24h】

Emotion recognition in response to traditional and tactile enhanced multimedia using electroencephalography

机译:使用脑电图对传统和触觉增强型多媒体做出响应的情绪识别

获取原文
获取原文并翻译 | 示例
           

摘要

The goal of this study is to enhance the emotional experience of a viewer by using enriched multimedia content, which entices tactile sensation in addition to vision and auditory senses. A user-independent method of emotion recognition using electroencephalography (EEG) in response to tactile enhanced multimedia (TEM) is presented with an aim of enriching the human experience of viewing digital content. The selected traditional multimedia clips are converted into TEM clips by synchronizing them with an electric fan and a heater to add cold and hot air effect. This would give realistic feel to a viewer by engaging three human senses including vision, auditory, and tactile. The EEG data is recorded from 21 participants in response to traditional multimedia clips and their TEM versions. Self assessment manikin (SAM) scale is used to collect valence and arousal score in response to each clip to validate the evoked emotions. A t-test is applied on the valence and arousal values to measure any significant difference between multimedia and TEM clips. The resulting p-values show that traditional multimedia and TEM content are significantly different in terms of valence and arousal scores, which shows TEM clips have enhanced evoked emotions. For emotion recognition, twelve time domain features are extracted from the preprocessed EEG signal and a support vector machine is applied to classify four human emotions i.e., happy, angry, sad, and relaxed. An accuracy of 43.90% and 63.41% against traditional multimedia and TEM clips is achieved respectively, which shows that EEG based emotion recognition performs better by engaging tactile sense.
机译:这项研究的目的是通过使用丰富的多媒体内容来增强观众的情感体验,该多媒体内容除了视觉和听觉之外还具有触觉感。提出了一种响应于触觉增强型多媒体(TEM)的使用脑电图(EEG)的用户独立的情感识别方法,目的是丰富人类观看数字内容的体验。通过将所选的传统多媒体剪辑与电风扇和加热器同步,可以将它们转换为TEM剪辑,从而增加冷热空气效果。通过结合视觉,听觉和触觉这三种人类感官,可以给观看者带来逼真的感觉。根据传统的多媒体剪辑及其TEM版本,记录了21位参与者的EEG数据。自我评估人体模型(SAM)量表用于收集每个剪辑的效价和唤醒分数,以验证诱发的情绪。对化合价和唤醒值进行t检验,以测量多媒体和TEM片段之间的任何显着差异。所得的p值表明,传统的多媒体和TEM内容在化合价和唤醒分数方面存在显着差异,这表明TEM片段增强了诱发的情绪。为了进行情感识别,从预处理的脑电信号中提取十二个时域特征,并使用支持向量机对四种人类情感进行分类,即快乐,生气,悲伤和放松。相对于传统的多媒体和TEM剪辑,其准确度分别达到43.90%和63.41%,这表明基于EEG的情感识别通过结合触觉而表现更好。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号