首页> 外国专利> SYSTEMS AND METHODS FOR AUTHORING IMMERSIVE HAPTIC EXPERIENCE USING SPECTRAL CENTRIOD

SYSTEMS AND METHODS FOR AUTHORING IMMERSIVE HAPTIC EXPERIENCE USING SPECTRAL CENTRIOD

机译:使用频谱质心来编写沉浸式触觉体验的系统和方法

摘要

Disclosed is a method and system of authoring an audio signal to produce an immersive haptic experience. The method and system preprocesses the audio signal in a preprocessor, which is passed to an audio analysis module. The audio analysis module processes the audio signal for a to produce (a) an array of time amplitude values, and (b) an array of spectral centroid values. In another implementation, the audio analysis module transforms the audio signal using Fourier transformation to produce an array of time amplitude frequency values and an array of spectral centroid values. The array of time amplitude values and the array of spectral centroid values are passed to an authoring tool. A user can modify the array of time amplitude values, the array of timer frequency values and the array of spectral centroid values to adjust the audio signal. The authored audio signal is provided to a transformation module, which transforms the audio signal into a transformed audio signal for producing a computer-readable file. The computer readable file can be stored and passed to a resynthesis module for producing immersive haptic experience. In one variation, the transformed audio signal can be directly synthesized using the resynthesis module. In an alternate embodiment, the authoring tool may be bypassed and the array of time amplitude values and the array of spectral centroid values are automatically edited using deep learning algorithms or artificial intelligence algorithms to generate haptic output in real time for producing haptic effect using one or more actuators.
机译:公开了一种用于产生沉浸式触觉体验的音频信号的方法和系统。该方法和系统预处理预处理器中的音频信号,其传递给音频分析模块。音频分析模块处理用于A的音频信号以产生(a)时间幅度值的阵列,并且(b)频谱质心值阵列。在另一实施方式中,音频分析模块使用傅里叶变换来改变音频信号以产生时间幅度频率值和频谱质心值阵列。时间幅度值和频谱质心值阵列传递给创作工具。用户可以修改时间幅度值的阵列,定时器频率值的阵列和频谱质心值阵列以调整音频信号。作者的音频信号被提供给变换模块,该变换模块将音频信号转换为变换的音频信号,用于产生计算机可读文件。计算机可读文件可以存储并传递给重新合成模块,以产生沉浸式触觉体验。在一个变型中,可以使用重新合成模块直接合成变换的音频信号。在替代实施例中,可以绕过创作工具,并且使用深度学习算法或人工智能算法自动编辑时间幅度值和频谱质心值阵列,以实时生成触觉输出,以使用一个或更多的执行器。

著录项

  • 公开/公告号WO2022013168A2

    专利类型

  • 公开/公告日2022-01-20

    原文格式PDF

  • 申请/专利权人 LOFELT GMBH;

    申请/专利号WO2021EP69371

  • 发明设计人 WEBER MAXIMILIAN;

    申请日2021-07-12

  • 分类号G06F3/01;G06F3/16;G11B27/031;

  • 国家 EP

  • 入库时间 2022-08-24 23:30:00

相似文献

  • 专利
  • 外文文献
  • 中文文献
获取专利

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号