| 研究生: |
呂志宏 Chih-Hung Lu |
|---|---|
| 論文名稱: |
以高品質合成視角為導向之快速深度視訊編碼模式決策 View Synthesis Oriented Fast Mode Decision for Depth Video Coding |
| 指導教授: |
唐之瑋
Chih-Wei Tang |
| 口試委員: | |
| 學位類別: |
碩士 Master |
| 系所名稱: |
資訊電機學院 - 通訊工程學系 Department of Communication Engineering |
| 畢業學年度: | 100 |
| 語文別: | 中文 |
| 論文頁數: | 85 |
| 中文關鍵詞: | 深度視訊編碼 、合成視角 、快速模式決策 |
| 外文關鍵詞: | depth video coding, fast mode decision, view synthesis |
| 相關次數: | 點閱:11 下載:0 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
利用多視角深度視訊壓縮技術可將3D視訊進行有效率的壓縮,但運算複雜度高,因此,如何達成高品質合成視角,同時有效降低編碼計算複雜度為一個重要的議題。由於色彩視訊與其深度視訊編碼具關聯性,本論文提出以高品質合成視角為導向之快速深度視訊編碼模式決策演算法,共包含二個部分,第一部分為快速模式決策方案,由於深度視訊之物件與色彩視訊之物件的運動行為十分相似,而深度視訊又具有大量平滑區域,因此本論文參考色彩視訊中同位置的最佳編碼模式,以及深度視訊畫面內上方已編碼區塊的最佳編碼模式,深度畫面之複雜度,決定候選編碼模式。由於深度視訊須使用於產生虛擬合成視角視訊,因此,本論文之第二部分決定以達成高品質合成視角視訊為目標,參考色彩影像中同位置區塊之水平方向的灰階變化,判斷是否為易造成合成視角影像失真的區域,再決定合適的RD代價函式,以選擇最佳編碼模式,提高合成視角的品質。由修改JMVC 6.0.3編碼軟體之實驗結果顯示,本論文所提出之快速演算法,平均可節省約53.08%,BDBR平均上升約1.12%,且合成視角之BDPSNR幾乎無改變。
3D video data can be compressed efficiency by using multi-view video plus depth (MVD) coding technology, but the computational complexity is pretty high. In order to accelerate the encoding process, the correlation between a texture video and its depth video should be explored. Moreover, how to achieve the good synthesized viewing quality is an important issue. In this thesis, we propose a view synthesis oriented fast mode decision for depth video coding. The algorithm is composed of two parts. The first part is a fast mode decision algorithm for depth video coding, which considers that object motion in texture video and depth video is similar, and depth videos has many smooth regions. We refer to the optimal mode of the co-located MB in the texture video, and the upper encoded MB in the depth video, and the complexity of the current MB in depth video. Finally, the candidates for mode decision are derived for fast depth video coding. In the second part, to achieve high synthesized viewing quality, we check the variation of intensity along the horizontal direction in the texture video. Then, an appropriate RD cost function is selected. Our experimental results show that the proposed scheme reduces up to 53.08% of encoding time with 1.12 dB BDBR increment and almost no BDPSNR loss in virtual views compared with the original JMVC 6.0.3.
[1] T. Wiegand, G. Sullivan, G. Bjøntegaard, and A. Luthra, “Overview of the H.264/AVC video coding standard,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 13, no. 7, pp. 560-576, July 2003.
[2] Y.-S. Ho and K.-J. Oh, “Overview of multi-view video coding,” in Proceedings of IEEE International Workshop on Systems, Signals and Image Processing, pp. 5-12, June 2007.
[3] ISO/IEC MPEG & ITU-T VCEG, “Multi-view Video plus Depth (MVD) Format for Advanced 3D Video System,” Doc. JVT-W-100, Apr. 2007.
[4] L. Onural, A. Smolic, and T. Sikora, “An overview of a new European consortium: integrated three-dimensional television—capture, transmission and display (3DTV),” in Proceedings of European Workshop on the Integration of Knowledge, Semantic and Digital Media Technologies, pp. 25-26, November 2004.
[5] A. Smolic, K. Müller, P. Merkle, C. Fehn, P. Kauff, P. Eisert, and T. Wiegand, “3D video and free viewpoint video—technologies, applications and MPEG standards,” in Proceedings of IEEE International Conference on Multimedia and Exposition, pp. 2161-2164, July 2006.
[6] T. Wiegand, H. Schwtarz, A. Joch, F. Kossentini, and G. J. Sullivan, “Rate-constrained coder control and comparison of video coding standards,” IEEE Transactions on Circuits and Systems for Video Technology ,Vol. 13, No. 7, pp. 688-703, July 2003.
[7] ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, “Joint multiview video model (JMVM) 1.0,” JVT-T209, Klagenfurt, Austria, July 2006.
[8] ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, “JMVC 1.0 software,” JVT-AA212, Geneva, April 2008.
[9] H. Schwarz, D. Marpe, and T. Wiegand, “Analysis of hierarchical B pictures and MCTF,” in Proceedings of IEEE International Conference on Multimedia and Expo, pp. 1929-1932, July 2006.
[10] P. Merkle, A. Smolic, K. M‥uller, and T. Wiegand, “Efficient prediction structures for multiview video coding,” IEEE Transactions on Circuits and Systems for Video Technology, Vol. 17, No. 11, pp. 1461-1473, November 2007.
[11] ISO/IEC JTC1/SC29/WG11, “Overview of 3D video coding,” Doc. N9784, May 2008.
[12] ISO/IEC JTC1/SC29/WG11, “Test model under consideration for AVC-based 3D video coding (3DV-ATM),” Doc. N12349, Dec. 2011.
[13] ISO/IEC JTC1/SC29/WG11, “Test model under consideration for HEVC based 3D video coding,” Doc. M12350, Nov. 2011.
[14] ISO/IEC JTC1/SC29/WG11, “Applications and requirements on 3D video coding, “ Doc. N12035, March 2011.
[15]K. Müller, P. Merkle, G. Tech, and T. Wiegand, “3D video formats and coding methods,” in Proceedings of IEEE International Conference on Image Processing, pp.2389-2392, Sept. 2010.
[16] ISO/IEC JTC1/SC29/WG11, “Report on experimental framework for 3D video coding,” Doc. N11631, Oct. 2010.
[17] D. V. S. X. De Silva, W. A. C. Fernando, and S. L. P. Yasakethu, “Object based coding of the depth maps for 3D video coding,” IEEE Transactions on Consumer Electronics, Vol. 55, No. 3 pp.1699-1706, Sept. 2009.
[18] P. Lai, A. Ortega, C. Dorea, P. Yin, and C. Gomila, “Improving view rendering quality and coding efficiency by suppressing compression artifacts in depth-image coding,” in Proceedings of Visual Communications and Image Processing, Jan. 2009.
[19] M. Wang, C. Liu, T. Zhang, X. Jin, and S. Goto, “Region of interest oriented fast mode decision for depth map coding in DIBR,” in Proceedings of IEEE International Colloquium on Signal Processing and its Applications, March 2011.
[20] Z. Peng, M. Yu, G. Jiang, Y. Si and F. Chen, “Virtual view synthesis oriented fast depth video encoding algorithm,” in Proceedings of IEEE International Conference on Industrial and Information System, Sept. 2010.
[21] D.-H. Yoon and Y.-S. Ho, “Fast mode decision algorithm for depth coding in 3D video systems using H.264/AVC,” Lecture Notes in Computer Science, Vol. 7088, pp. 25-35, Nov. 2011.
[22] Y. H. Lin and J. L. Wu, “A depth information based fast mode decision algorithm for color plus depth-map 3D videos,” IEEE Transactions on Broadcasting, Vol. 57, No. 7, pp. 542-550, June. 2011.
[23] Q. Zhang, P. An, Y. Zhang, L. Shen, and Z. Zhang, “Low complexity multiview video plus depth coding,” IEEE Transactions on Consumer Electronics, Vol. 57, No. 7, pp. 1857-1865, Nov. 2011.
[24] H. Oh and Y.-S. Ho, “H.264-based depth map sequence coding using motion information of corresponding texture video,” Lecture Notes in Computer Science, Vol. 4319, pp. 898-907, Dev. 2006.
[25] M. Naccari, F. Jaureguizar, J. Cabrera, E. Pereira, and N. Garcia, “A new fast motion estimation and mode decision algorithm for h.264 depth maps encoding in free viewpoint TV,” in Proceedings of IEEE International Conference on Image Processing, pp.1013-1016, Sept. 2011.
[26] B. Zhu, G. Jiang, Y. Zhang, Z. Peng, and M. Yu, “View synthesis oriented depth map coding algorithm,“ in Proceedings of IEEE Asia-Pacific Conference on Information Processing, July 2009.
[27] W.-S. Kim, A. Ortega, P. Lai, T. Dong, and C. Gomila, “Depth map distortion analysis for view rendering and depth coding,” in Proceedings of IEEE International Conference on Image Processing, pp.721-724, Nov. 2009.
[28] B. T. Oh, J. Lee, and D.-S. Park, “Depth map coding based on synthesized view distortion function,” IEEE Journal of Selected Topics in Signal Processing, Vol. 5, No. 7, pp. 1344-1352, Nov. 2011.
[29] H. Yuan, Y. Chang, J. Huo, F. Yang, and Z. Lu, “Model-based joint bit allocation between texture videos and depth maps for 3-D video coding,” IEEE Transactions on Circuits and Systems for Video Technology, Vol. 21, No. 7, pp. 485-497, April. 2011.
[30] ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, “Common test conditions for multiview video coding,” JVT-T207, Klagenfurt, Austria, July 2006.
[31] ISO/IEC JTC1/SC29/WG11, “View synthesis algorithm in view synthesis reference software 2.0(VSRS2.0),” Doc. M16090, Feb. 2009.
[32] G. Bjontegaard, “Calculation of average PSNR difference between RD-curves,” ITU-T Q6/SG16, Doc. VCEG-M33, April 2001.
[33] F. Pereira and T. Ebrahimi, The MPEG-4 Book. Upper Saddle River, NJ: Prentice-Hall, 2002, pp. 669-675.