...
【24h】

Personalized Saliency and Its Prediction

机译:个性化显着性及其预测

获取原文
获取原文并翻译 | 示例
           

摘要

Nearly all existing visual saliency models by far have focused on predicting a universal saliency map across all observers. Yet psychology studies suggest that visual attention of different observers can vary significantly under specific circumstances, especially a scene is composed of multiple salient objects. To study such heterogenous visual attention pattern across observers, we first construct a personalized saliency dataset and explore correlations between visual attention, personal preferences, and image contents. Specifically, we propose to decompose a personalized saliency map (referred to as PSM) into a universal saliency map (referred to as USM) predictable by existing saliency detection models and a new discrepancy map across users that characterizes personalized saliency. We then present two solutions towards predicting such discrepancy maps, i.e., a multi-task convolutional neural network (CNN) framework and an extended CNN with Person-specific Information Encoded Filters (CNN-PIEF). Extensive experimental results demonstrate the effectiveness of our models for PSM prediction as well their generalization capability for unseen observers.
机译:到目前为止,几乎所有现有的视觉显着性模型都集中于预测所有观察者的通用显着性图。然而心理学研究表明,在特定情况下,不同观察者的视觉注意力会发生显着变化,特别是一个场景由多个显着物体组成。为了研究跨观察者的这种异类视觉注意力模式,我们首先构建一个个性化的显着性数据集,并探索视觉注意力,个人喜好和图像内容之间的相关性。具体而言,我们建议将个性化显着性图(称为PSM)分解为可通过现有显着性检测模型预测的通用显着性图(称为USM)和跨用户的,表征个性化显着性的新差异图。然后,我们提出了两种预测此类差异图的解决方案,即多任务卷积神经网络(CNN)框架和带有特定于人的信息编码过滤器的扩展CNN(CNN-PIEF)。大量的实验结果证明了我们的模型对PSM预测的有效性以及对看不见的观察者的泛化能力。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号