首页> 外文会议>International Conference on Games and Virtual Worlds for Serious Applications >Immersive Orchestras: Audio Processing for Orchestral Music VR Content
【24h】

Immersive Orchestras: Audio Processing for Orchestral Music VR Content

机译:沉浸式乐团:管弦乐VR内容的音频处理

获取原文

摘要

This paper combines Audio Signal Processing and Virtual Reality (VR) content to create novel immersive experiences for orchestral music audiences. In VR, the auralization of sound sources of recorded live content remains still a rather unexplored topic. We aim to build a multimodal experience, where visual and audio cues bring a sonic augmentation of the real scene. In the particular scenario of orchestral music content, our goal is to acoustically zoom on a particular instrument when the VR user stares at it. This work aims to improve the learning aspects of music listening, either for education or for personal enrichment. We use audio signal processing to separate different sound sources (instruments) in a acoustic scene (orchestral music recording). Given the signals captured by multiple microphones and the musical score of the piece, our system is able to isolate the different instruments. From the processed separated tracks, we use a binaural rendering technique to emphasize a give instrument. For these experiments we used original content from top European orchestras.
机译:本文将音频信号处理和虚拟现实(VR)内容结合在一起,为管弦乐听众创造新颖的身临其境的体验。在VR中,录制的现场内容的声音源的听觉化仍然是一个尚未探索的话题。我们旨在建立一种多模式的体验,其中视觉和音频提示带来真实场景的声音增强。在管弦乐音乐内容的特定场景中,我们的目标是当VR用户凝视特定乐器时,以声学方式放大特定乐器。这项工作旨在改善音乐聆听的学习方面,无论是用于教育还是用于个人充实。我们使用音频信号处理来分离声学场景(管弦乐唱片)中的不同声源(乐器)。给定多个麦克风捕获的信号和乐曲的乐谱,我们的系统能够隔离不同的乐器。从处理过的分离轨道中,我们使用双耳渲染技术来强调给定乐器。对于这些实验,我们使用了来自欧洲顶级乐团的原创内容。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号