...
首页> 外文期刊>Microprocessors and microsystems >Multimodal registration of visible, SWIR and LWIR images in a distributed smart camera system
【24h】

Multimodal registration of visible, SWIR and LWIR images in a distributed smart camera system

机译:在分布式智能相机系统中对可见,SWIR和LWIR图像进行多模式配准

获取原文
获取原文并翻译 | 示例
           

摘要

We present a multimodal registration algorithm between images in the visible, short-wave infrared and long-wave infrared spectra. The algorithm works with two reference-objective image pairs and operates in two stages: (1) A calibration phase between static frames to estimate the transformation parameters using histogram of oriented gradients and the Chi-square distance; (2) a frame-by-frame mapping with these parameters using a projective transformation and a bilinear interpolation to map the objective video stream to the coordinate system of the reference video stream. We present a distributed heterogeneous architecture that combines a programmable processor core and a custom hardware accelerator for each node. The software performs the calibration phase, whereas the hardware computes the frame-by-frame mapping. We implemented our design using a Xilinx Zynq XC7Z020 system-on-a-chip for each node. The prototype uses 2.38W of power, 25% of the logic resources and 65% of the available on-chip memory per node. Running at 100MHz, the core can register 640 x 512-pixel frames in 4ms after initial calibration, which allows our module to operate at up to 250 frames per second. (C) 2019 Elsevier B.V. All rights reserved.
机译:我们提出了在可见光,短波红外和长波红外光谱中的图像之间的多峰配准算法。该算法与两个参考目标图像对一起工作,并分两个阶段进行:(1)静态帧之间的校准阶段,使用定向梯度的直方图和卡方距离估计变换参数; (2)使用投影变换和双线性插值将这些参数逐帧映射,以将目标视频流映射到参考视频流的坐标系。我们提出了一种分布式异构体系结构,该体系结构将可编程处理器内核和每个节点的自定义硬件加速器结合在一起。软件执行校准阶段,而硬件则计算逐帧映射。我们针对每个节点使用Xilinx Zynq XC7Z020片上系统来实现我们的设计。该原型每个节点使用2.38W的功率,25%的逻辑资源和65%的可用片上存储器。内核以100MHz运行时,在初始校准后的4ms内可以记录640 x 512像素帧,这使我们的模块可以每秒高达250帧的速度运行。 (C)2019 Elsevier B.V.保留所有权利。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号