首页> 外文期刊>Neurocomputing >Weakly supervised object-aware convolutional neural networks for semantic feature matching
【24h】

Weakly supervised object-aware convolutional neural networks for semantic feature matching

机译:用于语义特征匹配的弱监督对象感知卷积神经网络

获取原文
获取原文并翻译 | 示例
       

摘要

We address the task of establishing visual correspondences between two images depicting main objects of the same semantic category. This task encounters various challenges such as background clutter, intraclass variation, and viewpoint variations. Existing works are dominated by end-to-end training methods that rely on redundant calculation or large amounts of manual annotations, and cannot generalize to unseen object categories. In this paper, we propose to construct a weakly supervised object-aware convolutional neural network architecture for semantic feature matching, while being trainable end-to-end without the requirement for manual annotations. The main component of this architecture is a similarity filter module containing a trainable neural nearest neighbors network. Since training data for semantic feature matching is rather limited, we introduce a simple and effective foreground selection strategy to produce the foreground masks. Using these masks as a form of weak supervision signal for correspondence task and tackle the background clutter. Extensive experiments illustrate that the proposed approach outperforms the state-of-the-art methods for semantic feature matching on multiple public standard benchmark datasets. (c) 2021 Elsevier B.V. All rights reserved.
机译:我们解决了在描绘相同语义类别的主要对象之间建立视觉对应的任务。这项任务遇到了各种挑战,例如背景杂波,脑内变化和视点变化。现有的作品是由端到端培训方法主导,依赖于冗余计算或大量的手动注释,并且无法概括为未经说明的对象类别。在本文中,我们建议构建用于语义特征匹配的弱监督的对象感知卷积神经网络架构,同时在没有手动注释要求的情况下是可训练的端到端。该架构的主要组成部分是包含可培训神经最近邻居网络的相似性滤波器模块。由于对语义特征匹配的培训数据相当有限,因此我们介绍了一个简单有效的前景选择策略来生产前景面具。使用这些掩模作为债务任务的弱监管信号的形式,并解决背景杂乱。广泛的实验说明了所提出的方法优于在多个公共标准基准数据集上的语义特征匹配的最先进方法。 (c)2021 elestvier b.v.保留所有权利。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号