• 主题
高级搜索  >
历史搜索 清空历史
首页> 外文期刊>Selected Topics in Signal Processing, IEEE Journal of >Multiple Description Coding and Recovery of Free Viewpoint Video for Wireless Multi-Path Streaming
【24h】

Multiple Description Coding and Recovery of Free Viewpoint Video for Wireless Multi-Path Streaming

机译：用于无线多路径流的免费视频视点的多描述编码和恢复

获取原文
获取原文并翻译 | 示例
           
页面导航
  • 摘要
  • 著录项
  • 相似文献
  • 相关主题

摘要

By transmitting texture and depth videos captured from two nearby camera viewpoints, a client can synthesize via depth-image-based rendering (DIBR) any freely chosen intermediate virtual view of the 3D scene, enhancing the user's perception of depth. During wireless network transmission, burst packet losses can corrupt the transmitted texture and depth videos and degrade the synthesized view quality at the client. In this paper, we propose a multiple description coding system for multi-path transmission of free-viewpoint video, with joint interview and temporal description recovery capability. In particular, we encode separately the even frames of the left view and the odd frames of the right view, and transmit them as one description on one path. The second description comprises the remaining frames in the two views and is transmitted over a second path. If the receiver receives only one description due to burst loss in the other path, the missing frames in the other description are partially reconstructed using our frame recovery procedure. First, we construct two recovery candidates for each lost pixel in a frame. The first candidate is generated via temporal super-resolution from its predecessor and successor frames in the same view. The second candidate is generated via DIBR from the received frame of the same time instance in the other view. Next, we select the best pixel candidates one patch at a time, where an image patch corresponds to a neighborhood of pixels with similar depth values in the 3D scene. Near-optimal source and channel coding rates for each description are selected using a branch-and-bound method, for given transmission bandwidth on each path. Experimental results show that our system can outperform a traditional single-description/single-path transmission scheme by up to 5.5 dB in Peak Signal-to-Noise Ratio (PSNR) of the synthesized intermediate view at the client.
机译：通过传输从附近两个摄像机视点捕获的纹理和深度视频，客户端可以通过基于深度图像的渲染（DIBR）合成任意自由选择的3D场景中间虚拟视图，从而增强用户对深度的感知。在无线网络传输期间，突发数据包丢失会破坏传输的纹理和深度视频，并降低客户端的综合视图质量。在本文中，我们提出了一种用于自由视点视频多路径传输的多描述编码系统，该系统具有联合采访和时间描述恢复能力。特别是，我们分别对左视图的偶数帧和右视图的奇数帧进行编码，并将它们作为一种描述在一条路径上传输。第二描述包括两个视图中的其余帧，并通过第二路径传输。如果接收机由于另一条路径中的突发丢失而仅收到一个描述，则使用我们的帧恢复过程来部分重建另一个描述中的丢失帧。首先，我们为帧中的每个丢失像素构造两个恢复候选对象。通过时间超分辨率从同一视图中的前任帧和后继帧生成第一个候选对象。在另一个视图中，通过DIBR从接收到的同一时间实例的帧中生成第二个候选对象。接下来，我们一次选择一个像素的最佳候选像素，其中图像像素对应于3D场景中具有相似深度值的像素邻域。对于每个路径上的给定传输带宽，使用分支定界方法为每个描述选择接近最佳的源和信道编码速率。实验结果表明，我们的系统在客户端的合成中间视图的峰值信噪比（PSNR）上比传统的单描述/单路径传输方案高出5.5 dB。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱：kefu@zhangqiaokeyan.com

京公网安备：11010802029741号 ICP备案号：京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有

  • 客服微信

  • 服务号