首页> 外文OA文献 >BRAIN-COMPUTER MUSIC INTERFACING: DESIGNING PRACTICAL SYSTEMS FOR CREATIVE APPLICATIONS
【2h】

BRAIN-COMPUTER MUSIC INTERFACING: DESIGNING PRACTICAL SYSTEMS FOR CREATIVE APPLICATIONS

机译:脑机音乐接口:为实用应用程序设计实用系统

摘要

Brain-computer music interfacing (BCMI) presents a novel approach to music making, as it requires only the brainwaves of a user to control musical parameters. This presents immediate benefits for users with motor disabilities that may otherwise prevent them from engaging in traditional musical activities such as composition, performance or collaboration with other musicians. BCMI systems with active control, where a user can make cognitive choices that are detected within brain signals, provide a platform for developing new approaches towards accomplishing these activities. BCMI systems that use passive control present an interesting alternate to active control, where control over music is accomplished by harnessing brainwave patterns that are associated with subconscious mental states. Recent developments in brainwave measuring technologies, in particular electroencephalography (EEG), have made brainwave interaction with computer systems more affordable and accessible and the time is ripe for research into the potential such technologies can offer for creative applications for users of all abilities.This thesis presents an account of BCMI development that investigates methods of active, passive and hybrid (multiple control methods) control that include control over electronic music, acoustic instrumental music, multi-brain systems and combining methods of brainwave control. In practice there are many obstacles associated with detecting useful brainwave signals, in particular when scaling systems otherwise designed for medical studies for use outside of laboratory settings. Two key areas are addressed throughout this thesis. Firstly, improving the accuracy of meaningful brain signal detection in BCMI, and secondly, exploring the creativity available in user control through ways in which brainwaves can be mapped to musical features. Six BCMIs are presented in this thesis, each with the objective of exploring a unique aspect of user control. Four of these systems are designed for live BCMI concert performance, one evaluates a proof-of-concept through end-user testing and one is designed as a musical composition tool. The thesis begins by exploring the field of brainwave detection and control and identifies the steady-state visually evoked potential (SSVEP) method of eliciting brainwave control as a suitable technique for use in BCMI. In an attempt to improve signal accuracy of the SSVEP technique a new modular hardware unit is presented that provides accurate SSVEP stimuli, suitable for live music performance. Experimental data confirms the performance of the unit in tests across three different EEG hardware platforms. Results across 11 users indicate that a mean accuracy of 96% and an average response time of 3.88 seconds are attainable with the system. These results contribute to the development of the BCMI for Activating Memory, a multi-user system. Once a stable SSVEP platform is developed, control is extended through the integration of two more brainwave control techniques: affective (emotional) state detection and motor imagery response. In order to ascertain the suitability of the former an experiment confirms the accuracy of EEG when measuring affective states in response to music in a pilot study. This thesis demonstrates how a range of brainwave detection methods can be used for creative control in musical applications. Video and audio excerpts of BCMI pieces are also included in the Appendices.
机译:脑机音乐接口(BCMI)提出了一种新颖的音乐制作方法,因为它只需要用户的脑波即可控制音乐参数。这为行动不便的使用者带来了直接的好处,否则可能会阻止他们从事传统的音乐活动,例如作曲,表演或与其他音乐家的合作。带有主动控制功能的BCMI系统(用户可以在大脑信号内进行检测的认知选择)为开发完成这些活动的新方法提供了平台。使用被动控制的BCMI系统提供了一种有趣的替代主动控制的方法,其中通过利用与潜意识状态相关的脑电波模式来完成对音乐的控制。脑电波测量技术(特别是脑电图(EEG))的最新发展使脑电波与计算机系统的交互作用更加可负担和可访问,并且研究这种技术可以为各种能力的用户提供创造性应用的潜力的时机已经成熟。介绍了BCMI的发展情况,该研究调查了主动,被动和混合(多种控制方法)控制方法,包括对电子音乐,声学乐器音乐,多脑系统的控制以及脑电波控制的组合方法。在实践中,与检测有用的脑电波信号相关联的障碍很多,特别是在缩放比例系统被设计用于医学研究以在实验室环境之外使用时。本论文通篇讨论了两个关键领域。首先,提高BCMI中有意义的大脑信号检测的准确性,其次,通过将脑电波映射到音乐特征的方式来探索用户控制中的创造力。本文提出了六个BCMI,目的是探索用户控制的独特方面。这些系统中有四个是为现场BCMI演唱会设计的,一个是通过最终用户测试评估概念验证的,另一个是作为音乐创作工具而设计的。本文从探索脑电波检测和控制领域入手,确定了诱发脑电波控制的稳态视觉诱发电位(SSVEP)方法是一种适用于BCMI的技术。为了提高SSVEP技术的信号精度,提出了一种新的模块化硬件单元,该单元可提供准确的SSVEP刺激,适合现场音乐表演。实验数据证实了该设备在三种不同的EEG硬件平台上进行测试的性能。 11位用户的结果表明,该系统的平均准确度为96%,平均响应时间为3.88秒。这些结果有助于开发用于多用户系统“ Activate Memory”的BCMI。一旦开发出稳定的SSVEP平台,就可以通过集成另外两种脑电波控制技术来扩展控制范围:情感(情感)状态检测和运动图像响应。为了确定前者的适用性,在一项初步研究中,一项实验确认了在测量针对音乐的情感状态时脑电图的准确性。本文证明了如何将一系列脑电波检测方法用于音乐应用中的创造性控制。附录中还包含BCMI片段的视频和音频摘录。

著录项

  • 作者

    Eaton Joel;

  • 作者单位
  • 年度 2016
  • 总页数
  • 原文格式 PDF
  • 正文语种 en
  • 中图分类

相似文献

  • 外文文献
  • 中文文献
  • 专利

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号