隨著網路的蓬勃發展以及行動裝置的進步，使用者隨手可得影音資訊，這些多媒體資訊不斷地朝向高品質、高解析度發展，使得影音資料量成指數型成長，因此如何管理龐大的資料庫，並根據使用者的需求取得所需之影像便是一個重要的課題。基於影像內容之檢索技術，雖然發展歷史悠久且被廣泛的討論與研究，但多數的研究皆在原始像素域擷取特徵，必須將影像完全解壓縮後再進行處理，會增加許多計算複雜度以及儲存特徵空間。
本論文針對最新一代視訊壓縮標準HEVC，提出HEVC壓縮域之影像檢索技術，利用HEVC解碼器部分解碼所得之畫面內編碼資訊進行影像檢索。相較於直接使用解碼資訊作直方圖來比對，我們研究HEVC畫面內編碼之特性，將預測模式(intra prediction mode)作濾波處理，並將原本五種不同尺寸的預測單位(Prediction Unit, PU)分為兩組，再搭配其殘餘值(residual)能量之分布，萃取出有效的影像特徵以利檢索。實驗結果顯示，所提出之方法可大幅減少影像特徵的儲存空間，加速系統處理效率，而檢索效能平均準確率(Mean Average Precision, MAP)值為0.247。

With the rapid development of Internet and mobile devices, how to efficiently retrieve multimedia information from huge databases becomes an important issue. In the past decade, numerous algorithms were extensively studied for content based image retrieval. However, most existing works retrieve features in the pixel domain, which requires fully decoding images. It is time consuming and memory wasting to retrieve features in the pixel domain.
This thesis focuses on the content-based image retrieval in compression domain for the new standard, high efficiency video coding (HEVC). The features are extracted from partially decoded intra frames. Instead of directly taking histogram from the decoded information, the directions of intra mode are filtered and the sizes of prediction unit are grouped into two types. And the histogram of residual power is also adopted as a feature. The retrieval efficiency can greatly benefit by the proposed features.
The experimental results show that the proposed method can reduce the resource consumption and achieve a good retrieval performance, i.e. Mean Average Precision (MAP) 0.247 in Oxford 5K dataset.

[1] Y. Mistry, and D. T. Ingole, “Survey on Content Based Image Retrieval Systems.”
[2] G. Schaefer, “Pixel Domain and Compressed Domain Image Retrieval Features,” 2013 Eighth International Conference on Digital Information Management (ICDIM), pp.1-3, 10-12 Sept. 2013.
[3] M. J. Swain, and D. H. Ballard, “Color Indexing,” International Journal of Computer Vision, pp. 11-32, 1991.
[4] T. Ojala, M. Pietikainen, and D. Harwood, “A Comparative Study of Texture Measures with Classification Based on Feature Distributions,” Pattern Recognition, 29(1):51-59, 1996.
[5] N. P. Doshi, and G. Schaefer, “A Comprehensive Benchmark of Local Binary Pattern Algorithms for Texture Retrieval,” 2012 21st International Conference on Pattern Recognition (ICPR), pp.2760-2763, 11-15 Nov. 2012.
[6] B. H. Shekar, and, B. Pilar, “Shape Representation and Classification through Pattern Spectrum and Local Binary Pattern -- A Decision Level Fusion Approach,” 2014 Fifth International Conference on Signal and Image Processing (ICSIP), pp.218,224, 8-10 Jan. 2014.
[7] Fazal-e-Malik, and B. Baharudim, “Effective Content-Based Image Retrieval: Combination of Quantized Histogram Texture Features in the DCT Domain,” 2012 International Conference on Computer & Information Science (ICCIS), pp.425,430, 12-14 June 2012.
[8] A. Mohamed, F. Khellfi, Y. Weng, and J. Jiang, “An Efficient Image Retrieval through DCT Histogram Quantization,” International Conference on CyberWorlds, 2009. CW '09. pp.237, 240, 7-11 Sept. 2009.
[9] D. Edmundson, and G. Schaefer, “Fast JPEG Image Retrieval Using Optimised Huffman Tables,” 2012 21st International Conference on Pattern Recognition (ICPR), pp.3188,3191, 11-15 Nov. 2012.
[10] V. R. Khapli, and A. S. Bhalchandra, “Compressed Domain Image Retrieval Using Thumbnails of Images,” 2009. CICSYN '09. First International Conference on Computational Intelligence, Communication Systems and Networks, pp.392-396, 23-25 July 2009.
[11] F. Zargari, M. Mehrabi, and M. Ghanbari, “Compressed Domain Texture Based Visual Information Retrieval Method for I-frame Coded Pictures,” IEEE Transactions on Consumer Electronics, vol.56, no.2, pp.728-736, May 2010.
[12] R. J. Wang, Y. T. Yang, and P. C. Chang, “Content-Based Image Retrieval Using H.264 Intra Coding Features,” Journal of Visual Communication and Image Representation, vol. 25, no. 5, pp. 963-969, July 2014.
[13] G. J. Sullivan, J. Ohm, Han Woo-Jinm, and T. Wiegand, “Overview of the High Efficiency Video Coding (HEVC) Standard,” IEEE Transactions on Circuits and Systems for Video Technology, vol.22, no.12, pp.1649,1668, Dec. 2012.
[14] J. Lainema, F. Bossen, Woo-Jin Han, Junghye Min, and K. Ugur,
“Intra Coding of the HEVC Standard,” IEEE Transactions on Circuits and Systems for Video Technology, vol.22, no.12, pp.1792,1801, Dec. 2012.
[15] M. Viitanen, J. Vanne, T.D Hamalainen, M. Gabbouj, and J. Lainema, “Complexity Analysis of Next-generation HEVC Decoder,” 2012 IEEE International Symposium on Circuits and Systems (ISCAS), pp.882-885, 20-23 May 2012.
[16] L. Zhao, L. Zhang, S. Ma, and D. Zhao, “Fast Mode Decision Algorithm for Intra Prediction in HEVC,” Visual Communications and Image Processing Conference, 2011, pp. 1-4.
[17] Oxford 5k dataset, http://www.robots.ox.ac.uk/~vgg/data/oxbuildings/
[18] B. S. Manjunath, J.-R Ohm, V. V. Vasudevan, and A. Yamada, “Color and Texture Descriptors,” IEEE Transactions on Circuits and Systems for Video Technology, vol.11, no.6, pp.703,715, Jun 2001.
[19] F. Pescador, M. Chavarrias, M. Garrido, E. Juarez, and C. Sanz, “Complexity Analysis of an HEVC Decoder based on a Digital Signal Processor,” IEEE Transactions on Consumer Electronics, vol.59, no.2, pp.391-399, May 2013.
[20] J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman, “Object Retrieval with large Vocabularies and Fast Spatial Matching,” IEEE Conference on Computer Vision and Pattern Recognition, 2007. CVPR '07. pp.1,8, 17-22, June 2007.