首页> 外文期刊>Affective Computing, IEEE Transactions on >Dynamic Time Warping for Music Retrieval Using Time Series Modeling of Musical Emotions
【24h】

Dynamic Time Warping for Music Retrieval Using Time Series Modeling of Musical Emotions

机译:使用音乐情感的时间序列建模进行音乐检索的动态时间规整

获取原文
获取原文并翻译 | 示例
           

摘要

Musical signals have rich temporal information not only at the physical level but at the emotion level. The listeners may wish to find music excerpts that have similar sequence patterns of musical emotions with given excerpts. Most state-of-the-art systems for emotion-based music retrieval concentrate on static analysis of musical emotions, and ignore dynamic analysis and modeling of musical emotions over time. This paper presents a novel approach to perform music retrieval based on time-varying musical emotion dynamics. A three-dimensional musical emotion model—Resonance-Arousal-Valence (RAV)—is used, and emotions of a piece of music are represented by musical emotion dynamics in a time series. A multiple dynamic textures (MDT) model is proposed to model music and emotion dynamics over time, and expectation maximization (EM) algorithm along with Kalman filtering and smoothing is used to estimate model parameters. Two smoothing methods—Rauch-Tung-Striebel (RTS) and minimum-variance smoothing (MVS)—to robust model are investigated and compared to find an optimal solution to enhance prediction. To find similar sequence patterns of musical emotions, subsequence dynamic time warping (DTW) for emotion dynamics matching is presented. Experimental results demonstrate the benefits of MDT to predict time-varying musical emotions, and our proposed method for music retrieval based on emotion dynamics outperforms retrieval methods based on acoustic features.
机译:音乐信号不仅在身体层面而且在情感层面都具有丰富的时间信息。听众可能希望找到具有与给定摘录相似的音乐情感顺序模式的音乐摘录。大多数基于情感的音乐检索的最新系统都专注于音乐情感的静态分析,而忽略了随着时间的推移对音乐情感进行动态分析和建模。本文提出了一种基于时变音乐情感动态进行音乐检索的新颖方法。使用三维音乐情感模型-共鸣-配音(RAV),并且音乐的情感由音乐情感动力学按时间序列表示。提出了一种多重动态纹理(MDT)模型来对音乐和情感的动态变化进行建模,并使用期望最大化(EM)算法以及卡尔曼滤波和平滑来估计模型参数。研究了两种对鲁棒模型进行平滑的方法-Rauch-Tung-Striebel(RTS)和最小方差平滑(MVS),以找到增强预测的最佳解决方案。为了找到相似的音乐情感序列模式,提出了用于情感动态匹配的子序列动态时间规整(DTW)。实验结果证明了MDT可以预测时变的音乐情感,并且我们提出的基于情感动态的音乐检索方法优于基于声学特征的音乐检索方法。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号