首页> 外文期刊>International Journal of Multimedia Information Retrieval >Mining exoticism from visual content with fusion-based deep neural networks
【24h】

Mining exoticism from visual content with fusion-based deep neural networks

机译:从基于融合的深神经网络的视觉内容挖掘异国情调

获取原文
获取原文并翻译 | 示例
           

摘要

Exoticism is the charm of the unfamiliar or something remote. It has received significant interest in different kinds of arts, but although visual concept classification in images and videos for semantic multimedia retrieval has been researched for years, the visual concept of exoticism has not been investigated yet from a computational perspective. In this paper, we present the first approach to automatically classify images as exotic or non-exotic. We have gathered two large datasets that cover exoticism in a general as well as a concept-specific way. The datasets have been annotated in a crowdsourcing approach. To circumvent cultural differences in the annotation, only North American crowdworkers are employed for this task. Two deep learning architectures to learn the concept of exoticism are evaluated. Besides deep learning features, we also investigate the usefulness of hand-crafted features, which are combined with deep features in our proposed fusion-based approach. Different machine learning models are compared with the fusion-based approach, which is the best performing one, reaching an accuracy over 83% and 91% on two different datasets. Comprehensive experimental results provide insights into which features contribute at most to recognizing exoticism. The estimation of image exoticism could be applied in fields like advertising and travel suggestions, as well as to increase serendipity and diversity of recommendations and search results.
机译:异国情调是陌生的魅力或遥远的东西。它对不同类型的艺术产生了重大兴趣,但是多年来研究了图像和视频的视频和视频中的视觉概念分类,但尚未从计算的角度来调查异国情调的视觉概念。在本文中,我们介绍了自动将图像自动分类为异国情调或非异国情调的方法。我们聚集了两个大型数据集,这些数据集在一般的情况下覆盖了异国情调以及特定于概念的方式。数据集已以众群方法注释。为了规避诠释的文化差异,只有北美人群工作者就业为这项任务。评估了两个深入学习架构,以了解异国情调的概念。除了深度学习功能外,还研究了手工制作功能的有用性,这些功能与我们所提出的基于融合方法的深度特征相结合。将不同的机器学习模型与基于融合的方法进行比较,这是最好的表现,在两个不同的数据集中达到超过83%和91%的准确性。全面的实验结果提供了最多能够识别异国情调的洞察力的洞察力。图像异乎寻常的估计可以应用于广告和旅行建议等领域,以及增加建议和搜索结果的素质和多样性。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号