...
首页> 外文期刊>Journal on multimodal user interfaces >An approach for exploring a video via multimodal feature extraction and user interactions
【24h】

An approach for exploring a video via multimodal feature extraction and user interactions

机译:一种通过多模式特征提取和用户交互来浏览视频的方法

获取原文
获取原文并翻译 | 示例
           

摘要

Exploring the content of a video is typically inefficient due to the linear streamed nature of its media and the lack of interactivity. Video may be seen as a combination of a set of features, the visual track, the audio track and transcription of the spoken words, etc. These features may be viewed as a set of temporally bounded parallel modalities. It is our contention that together these modalities and derived features have the potential to be presented individually or in discrete combination, to allow deeper and effective content exploration within different parts of a video in an interactive manner. A novel system for video exploration by offering video content as an alternative representation is proposed. The proposed system represents the extracted multimodal features as an automatically generated interactive multimedia webpage. This paper also presents a user study conducted to learn its (proposed system) usage patterns. The learned usage patterns may be utilized to build a template driven representation engine that uses the features to offer a multimodal synopsis of video that may lead to efficient exploration of video content.
机译:由于视频的线性流性质和缺乏交互性,因此探索视频的内容通常效率不高。视频可以看作是一组功能,视觉轨道,音频轨道和口语单词的转录等的组合。这些特征可以被视为一组时间有限的并行模态。我们认为,这些模式和派生功能一起有可能单独显示或以离散组合显示,从而允许以交互方式在视频的不同部分进行更深入有效的内容探索。通过提供视频内容作为替代表示,提出了一种用于视频探索的新颖系统。所提出的系统将提取的多峰特征表示为自动生成的交互式多媒体网页。本文还介绍了一项用户研究,以学习其(建议的系统)使用模式。所学习的使用模式可以用于构建模板驱动的表示引擎,该引擎使用这些功能来提供视频的多模式概要,从而可以有效地探索视频内容。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号