移動補償畫面內插法，主要應用於畫面更新率的提升和降低所需傳送的影像資料以達到符合傳送的頻寬。針對降低所需傳送的影像資料，我們常在編碼端先將影像做畫面跳張後，再進行編碼，最後在解碼端利用移動補償畫面內插法將畫面插值回來。因為在解碼端並無原始欲作畫面跳張的畫面資訊，所以重建畫面的畫面品質並沒有很好。有鑑於此，本篇論文提出了『先進移動補償畫面內插法』，簡稱AMCFI。我們將原本在解碼端為了解決插值畫面所發生的視覺效應而做的處理，像是移動向量的重新安排和權重式移動補償，移至編碼端，並藉著參考這些欲作畫面跳張的原始畫面資訊，使重建畫面的畫面品質為最佳的。又因為使用先進移動補償畫面內插法可節省原本的編碼時間，所以在本篇論文的最後，我們將針對編碼時間提出了兩個先進影像編碼技術來做探討。

Motion compensated frame interpolation (MCFI), it mainly used in frame rate up-conversion and video compression. In order to transmit a huge amount of video data over the bandwidth-limited channels, we often do frame skipping in the encoder and use MCFI to interpolate the frame in the decoder. But the quality of interpolated frame is not good, because we don’t have the original skipped frame information in the decoder. So we propose the advanced motion compensated frame interpolation (AMCFI) to improve the problem. In the encoder, we improve the quality of interpolated frame by using the original skipped frame information to do some processes such as motion vector refinement and weighted motion compensation which are used to solve the interpolated frame’s visual effect in the decoder. We also can find that AMCFI reduce coding time in the encoder, so we will propose two advanced video coding technics to reduce coding time.

[1] A. M. Huang and T. Nguyen, “Correlation-based motion vector processing with adaptive interpolation scheme for motion-compensated frame interpolation,” IEEE Trans. Image Process, vol. 18, no. 4, pp. 740-752, Apr. 2009.
[2] B. D. Choi, J. W. Han, C. S. Kim and S. J. Ko, “Motion-compensated frame interpolation using bilateral motion estimation and adaptive overlapped block motion compensation,” IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 4, pp. 407-416, Apr. 2007.
[3] A. M. Huang and T. Nguyen, “A multistage motion vector processing method for motion-compensated frame interpolation,” IEEE Trans. Image Process, vol. 17, no. 5, pp. 694-708, May 2008.
[4] Y. Ling, J. Wang, Y. Liu and W. Zhang, “Spatial and temporal correlation based frame rate up-conversion,” in Proc. ICIP, Oct. 2008, pp. 909-912.
[5] K. C. Yang, A. M. Huang, T. Nguyen, C. C. Guest and P. K. Das, “A new objective quality metric for frame interpolation used in video compression,” IEEE Trans. Broadcasting, vol. 54, no. 3, pp. 680-690, Sep. 2008.
[6] A. M. Huang and T. Nguyen, “Motion vector processing using bidirectional frame difference in motion compensated frame interpolation,” IEEE WoWMoM, Jun. 2008, pp. 1-6.
[7] A. M. Huang and T. Nguyen, “A novel multi-stage motion vector processing method for motion-compensated frame interpolation,” in Proc. ICIP, Sept. 2007, pp. 389-392.
[8] J. Zhai, K. Yu, J. Li and S. Li, “A low complexity motion compensated frame interpolation method,” in Proc. ISCAS, Sept. 2005, vol. 2, pp. 4927-4930.
[9] A. M. Huang and T. Nguyen, “Correlation-based motion vector processing for motion-compensated frame interpolation,” in Proc. ICIP, Oct. 2005, pp. 1244-1247.
[10] H. Sasai, S. Kondo and S. Kadono, “Frame-rate up-conversion using reliable analysis of transmitted motion information,” in Proc. ICASSP, May 2004, vol. 5, pp. 257-260.
[11] J. Zhang, L. Sun, S. Yang and Y. Zhong, “Position prediction motion-compensated interpolation for frame rate up-conversion using temporal modeling,” in Proc. ICIP, Sept. 2005, vol. 1, pp. 53-59.
[12] A. M. Huang and T. Nguyen, “Motion vector processing based on residual energy information for motion compensated frame interpolation,” in Proc. ICIP, Sept. 2006, vol. 4, pp. 353-356.
[13] C. Dane and T. Q. Nguyen, “Motion vector processing for frame rate up conversion,” in Proc. ICASSP, May 2004, vol. 3, pp. 309-312.
[14] B. T. Choi, S. H. Lee and S. J. Ko, “New frame rate up-conversion using bi-directional motion estimation.” IEEE Trans. Consum. Electron., vol. 46, pp. 603-609, Aug. 2000.
[15] S. H. Lee, O. Kwon and R. H. Park, “Weighted-adaptive motion-compensated frame rate up-conversion,” IEEE Trans. Consum. Electron., vol. 49, no. 3, pp. 485-492, Aug. 2003.
[16] G. de Haan, P. W. Biezen, H. Huijgen and O. A. Ojo, “True-motion estimation with 3-D recursive search block matching,” IEEE Trans. Circuits Syst. Video Technol., vol. 3, no. 5, pp. 368-379, Oct. 1993.
[17] T. Chen, “Adaptive temporal interpolation using bidirectional motion estimation and compensation,” in Proc. ICIP, Sept. 2002, vol. 2, pp. 313-317.
[18] Joint Video Team software JM12.2
http://iphome.hhi.de/suehring/tml/download/
[19] “Draft ITU-T recommendation and final draft international standard of Joint Video Specification (ITU-T Rec. H.264 | ISO/IEC 144496-10 AVC),” Joint Video Team of ISO/IEC and ITU-T, Nov. 2007.
[20] I. Richardson, H.264 and MPEG-4 video compression, Wiley Press, Dec. 2003.