可伸缩3DTV视频编解码器研究.docVIP

  可伸缩 3DTV 视频编解码器研究 白雪，张家谋** （北京邮电大学信息与通信工程学院，北京 100876） 5 10 15 20 25 30 摘要：为了使用现有的 2DTV 基础设施实现 2DTV 向 3DTV 的平滑过渡，一种 3D 视频的帧兼容 (frame-compatible) 技术被提出。基于这种帧兼容技术，利用 2DTV 系统在相对小的系统升 级下可实现 3DTV 的服务。这种方案中 3D 视频的恢复是将解码后的兼容帧分为半分辨率 （half-resolution）的左右眼子帧后分别内插而实现的。未来的 3DTV 市场将会有越来越多 的设备可以支持全分辨率的 3D 视频和半分辨率的 3D 视频的并存。本文提出一种基于 SVC 的可伸缩 3D 视频编解码器。编码端以 3D 视频 side-by-side 格式的兼容帧为输入，解码端 输出可伸缩码流。从可伸缩码流中解码基本层后，用几种经典内插方法对左右眼半分辨率子 帧分别进行内插可恢复 3D 视频。把整个可伸缩码流解码后得到基本层和增强层后，用反交 错编码恢复出全分辨率的 3D 视频。实验结果证明了该方案的可行性。 关键词：3DTV；帧兼容(frame-compatible)；可伸缩视频编码(SVC) 中图分类号：TN919.8 Research on Scalable 3DTV Video Codec BAI Xue, ZHANG Jiamou (School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing 100876) Abstract: In order to support the 3DTV service through the existing 2DTV infrastructure, a 3D video frame-compatible solution is proposed. In this solution, the left and right views are down sampled and multiplexed by a side-by-side/top-bottom manner. However, this solution reduces the resolution of the original content. The decoded compatible frame should be separate to left view subframe and right view subframe as half-resolution frames and then the letf view subframe and the right view subframe are interpolated respectively to recover the 3D video. The future 3DTV market is also interested in a scalable solution that would provide the output compatibility of 3D half resolution and 3D full resolution images. In this paper, an SVC based 3D scalable video codec is proposed. It takes advantage of the side-by-side compatible frames as the input of the SVC codec. If only the base layer is decoded from the scalable codestream, several classical interpolation methods are used to recover the 3D video. If the entier codestream is decoded, re-interleaving is used to recover the full resolution 3D video. Experimental results show the feasibility of this scheme. Keywords: 3DTV; Frame-compatible; Scalable video coding (SVC) 35 0 引言 随着诸如 3D 电影，3D 游戏，