...
首页> 外文期刊>IEEE Transactions on Pattern Analysis and Machine Intelligence >DASC: Robust Dense Descriptor for Multi-Modal and Multi-Spectral Correspondence Estimation
【24h】

DASC: Robust Dense Descriptor for Multi-Modal and Multi-Spectral Correspondence Estimation

机译:DASC:用于多模态和多光谱对应估计的鲁棒密集描述符

获取原文
获取原文并翻译 | 示例
           

摘要

Establishing dense correspondences between multiple images is a fundamental task in many applications. However, finding a reliable correspondence between multi-modal or multi-spectral images still remains unsolved due to their challenging photometric and geometric variations. In this paper, we propose a novel dense descriptor, called dense adaptive self-correlation (DASC), to estimate dense multi-modal and multi-spectral correspondences. Based on an observation that self-similarity existing within images is robust to imaging modality variations, we define the descriptor with a series of an adaptive self-correlation similarity measure between patches sampled by a randomized receptive field pooling, in which a sampling pattern is obtained using a discriminative learning. The computational redundancy of dense descriptors is dramatically reduced by applying fast edge-aware filtering. Furthermore, in order to address geometric variations including scale and rotation, we propose a geometry-invariant DASC (GI-DASC) descriptor that effectively leverages the DASC through a superpixel-based representation. For a quantitative evaluation of the GI-DASC, we build a novel multi-modal benchmark as varying photometric and geometric conditions. Experimental results demonstrate the outstanding performance of the DASC and GI-DASC in many cases of dense multi-modal and multi-spectral correspondences.
机译:在多个应用程序之间建立密集的对应关系是一项基本任务。然而,由于它们具有挑战性的光度和几何变化,在多模式或多光谱图像之间寻找可靠的对应关系仍然没有解决。在本文中,我们提出了一种新颖的密集描述符,称为密集自适应自相关(DASC),以估计密集的多模态和多光谱对应关系。基于观察到图像中存在的自相似性对成像模态变化具有鲁棒性,我们通过随机接受场池采样的斑块之间的一系列自适应自相关相似性度量来定义描述符,从而获得采样模式使用判别式学习。通过应用快速的边缘感知过滤,可以大大减少密集描述符的计算冗余。此外,为了解决包括比例和旋转在内的几何变化,我们提出了几何不变DASC(GI-DASC)描述符,该描述符通过基于超像素的表示有效地利用了DASC。为了对GI-DASC进行定量评估,我们建立了一个新颖的多峰基准,作为变化的光度和几何条件。实验结果证明了DASC和GI-DASC在许多密集的多模态和多光谱对应情况下的出色表现。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号