...
首页> 外文期刊>Computational Intelligence and AI in Games, IEEE Transactions on >Thinking Penguin: Multimodal Brain–Computer Interface Control of a VR Game
【24h】

Thinking Penguin: Multimodal Brain–Computer Interface Control of a VR Game

机译:企鹅企鹅:VR游戏的多模式脑机接口控制

获取原文
获取原文并翻译 | 示例
           

摘要

In this paper, we describe a multimodal brain–computer interface (BCI) experiment, situated in a highly immersive CAVE. A subject sitting in the virtual environment controls the main character of a virtual reality game: a penguin that slides down a snowy mountain slope. While the subject can trigger a jump action via the BCI, additional steering with a game controller as a secondary task was tested. Our experiment profits from the game as an attractive task where the subject is motivated to get a higher score with a better BCI performance. A BCI based on the so-called brain switch was applied, which allows discrete asynchronous actions. Fourteen subjects participated, of which 50% achieved the required performance to test the penguin game. Comparing the BCI performance during the training and the game showed that a transfer of skills is possible, in spite of the changes in visual complexity and task demand. Finally and most importantly, our results showed that the use of a secondary motor task, in our case the joystick control, did not deteriorate the BCI performance during the game. Through these findings, we conclude that our chosen approach is a suitable multimodal or hybrid BCI implementation, in which the user can even perform other tasks in parallel.
机译:在本文中,我们描述了位于高度沉浸式CAVE中的多模式脑机接口(BCI)实验。坐在虚拟环境中的对象控制着虚拟现实游戏的主要角色:从雪山坡上滑下来的企鹅。尽管受试者可以通过BCI触发跳跃动作,但还测试了游戏控制器的辅助操纵作为次要任务。我们的实验从游戏中获利,这是一项诱人的任务,受试对象被激励获得更高的分数并获得更好的BCI性能。应用了基于所谓的大脑开关的BCI,它允许离散的异步动作。共有14名受试者参加,其中50%达到了测试企鹅游戏所需的成绩。在训练和比赛中比较BCI的表现表明,尽管视觉复杂性和任务要求有所变化,但仍可以转移技能。最终也是最重要的是,我们的结果表明,在游戏过程中,使用次级运动任务(在我们的情况下为操纵杆控制)不会降低BCI性能。通过这些发现,我们得出结论,我们选择的方法是合适的多模式或混合BCI实现,用户甚至可以并行执行其他任务。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号