跳到主要內容

簡易檢索 / 詳目顯示

研究生: 向子豪
Tzu-hao Hsiang
論文名稱: SCAN:一個多運算子的影像畫面調整機制
SCAN:A Multi-Operator Image Retargeting Scheme
指導教授: 蘇柏齊
Po-chyi Su
口試委員:
學位類別: 碩士
Master
系所名稱: 資訊電機學院 - 資訊工程學系
Department of Computer Science & Information Engineering
論文出版年: 2014
畢業學年度: 102
語文別: 英文
論文頁數: 68
中文關鍵詞: 影像重新定位圖縫裁減邊緣裁切視覺顯著特徵多運算子
外文關鍵詞: retargeting, seam carving, cropping, scaling, saliency
相關次數: 點閱:12下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 本研究提出一個多運算子的影像調整機制,其中包含了圖縫裁減(Seam carving)、邊緣裁切(Cropping)、圖縫增加(Adding seam)以及正規化(Normalization)或影像直接縮放,故此機制又稱為SCAN。首先我們根據畫面內容物紀錄兩側最多能夠裁切的位置,並進行第一次邊緣裁切,移除影像兩側不重要的部分,並且使得兩邊裁切的數目相同。接著,我們考慮局部能量以及全域能量實作一個新的圖縫裁減方法以去移除影像中間較不重要的圖縫,此演算法可有效率地移除大量圖縫。當影像背景不複雜時,類似圖縫裁減方法可以被應用於圖縫增加之上,使得畫面更接近目標長寬比例。若影像尺寸仍未達目標,可進行第二次的影像邊緣裁切。最後在施予畫面直接縮放。實驗結果顯示所提出的方法之可行性與優勢。


    This research presents a multi-operator retargeting mechanism termed “SCAN”, in which seam carving, cropping, adding seams and normalization (scaling) are applied on images in an automatic manner. The content-based cropping will first be used to remove insignificant portions on sides. Then a new seam carving algorithm based on both the global saliency and local saliency is proposed to rid of the pixels in the middle of the image. Efficiency is the major advantage of this seam carving algorithm. When the background is not complex, some seams may be inserted in a similar way as the proposed seam carving procedures to make the aspect ratio closer to the target one. Finally, the image is scaled or normalized directly. Experimental results will demonstrate the feasibility and advantages of the proposed method.

    論文摘要 ii Abstract ii 誌謝 iii 目錄 iv 圖目錄 vi Chapter 1 Introduction 1 1.1 Motivation 1 1.2 Contribution 2 1.3 Thesis Organization 3 Chapter 2 Related work 4 2.1 The Methods of Cropping 4 2.2 The Methods of Scaling 5 2.3 The Methods of Seam Carving 6 2.4 The Methods of Multi-operator 7 Chapter 3 The Proposed Scheme 9 3.1 Overview of the Proposed Scheme 9 3.2 Saliency Image 10 3.3 Cropping 15 3.3.1 Foreground Extraction 16 3.3.2 Analysis of Cropping 17 3.4 Seam Carving 20 3.4.1 The Conditions of Removing Seams 21 3.4.2 Seam Carving 26 3.5 Adding Seams 30 3.6 Scaling 31 3.7 Processing Order 31 Chapter 4 Experimental Results 36 4.1 Experimental Results of Cropping 36 4.2 Experimental Results of Seam Carving 39 4.3 Experimental Results of Adding Seams 43 4.4 Comparison with Other Methods 45 Chapter 5 Conclusion and Future Work 53 Reference 54

    [1]S. Montabone, and A. Soto. "Human detection using a mobile platform and novel features derived from a visual saliency mechanism," Image and Vision Computing, vol. 28, no. 3, pp. 391-402, 2010.
    [2]A. Santella , M. Agrawala, D. DeCarlo, D. Salesin, and M. Cohen, "Gaze-based interaction for semi-automatic photo cropping," Proceedings of the SIGCHI conference on Human Factors in computing systems. pp. 771-780, ACM, 2006.
    [3]S. Avidan, and A. Shamir. "Seam carving for content-aware image resizing," ACM Transactions on graphics (TOG). vol. 26. no. 3. Aug 2007.
    [4]M. Rubinstein, A. Shamir, and S. Avidan, "Improved seam carving for video retargeting," ACM Transactions on Graphics (TOG). vol. 27. no. 3. p. 16, 2008.
    [5]F. Stentiford, "Attention based auto image cropping," The 5th International Conference on Computer Vision Systems, Bielefeld, 2007.
    [6]I. S. Amrutha, S. S. Shylaja, S. Natarajan, and K. N. Murthy, "A smart automatic thumbnail cropping based on attention driven regions of interest extraction," Proceedings of the 2nd International Conference on Interaction Sciences: Information Technology, Culture and Human. ACM, pp. 957-962, 2009.
    [7]M. Nishiyama, T. Okabe, Y. Sato, and I. Sato, "Sensation-based photo cropping," Proceedings of the 17th ACM international conference on Multimedia, pp. 669-672, 2009.
    [8]P. Cheatle, "Automatic image cropping for republishing," IS&T/SPIE Electronic Imaging. International Society for Optics and Photonics, pp. 75400O-75400O-9, 2010.
    [9]M. Zhang, and L. Zhang, "Auto cropping for digital photographs, " IEEE International Conference on Multimedia and Expo. p. 4-pp, 2005.
    [10]L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Transactions on Pattern Analysis and Machine Intelligence,vol. 20, no. 11, pp. 1254-1259, 1998.
    [11]R. Gal, O. Sorkine, and D. Cohen-Or, "Feature-aware texturing," Proceedings of the 17th Eurographics conference on Rendering Techniques. Eurographics Association, June 2006.
    [12]L. Wolf, M. Guttmann, and D. Cohen-Or, "Non-homogeneous content-driven video-retargeting," IEEE 11th International Conference on Computer Vision, 2007. ICCV 2007, 2007.
    [13]Y. S. Wang, C. L. Tai, O. Sorkine, and T. Y. Lee, "Optimized scale-and-stretch for image resizing," ACM Transactions on Graphics (TOG), vol. 27, no. 5, 2008.
    [14]M. Grundmann, V. Kwatra, M. Han, and I. Essa, "Discontinuous seam-carving for video retargeting," IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, June 2010.
    [15]D. Domingues, A. Alahi, and P. Vandergheynst, "Stream carving: an adaptive seam carving algorithm," 17th IEEE International Conference on Image Processing (ICIP), pp. 901-904, 2010.
    [16]S. Hua, G. Chen, H. Wei , and Q. Jiang, "Similarity measure for image resizing using SIFT feature," EURASIP Journal on Image and Video Processing , pp. 1-11, Jan 2012.
    [17]M. Rubinstein, A. Shamir, and S. Avidan, "Multi-operator media retargeting," ACM Transactions on Graphics (TOG), vol. 28, no. 3, 2009.
    [18]W. Dong, N. Zhou, J. C. Paul, and X. Zhang, "Optimized image resizing using seam carving and scaling," ACM Transactions on Graphics (TOG) , vol. 28, no. 5, p125, 2009.
    [19]S. Luo, J. Zhang, Q. Zhang, and X. Yuan, "Multi-operator image retargeting with automatic integration of direct and indirect seam carving," Image and Vision Computing, 2012.
    [20]W. M. Dong, G. B. Bao, X. P. Zhang, and J. C. Paul, "Fast Multi-Operator Image Resizing and Evaluation," Journal of Computer Science and Technology , vol. 27, no. 1, pp. 121-134, 2012.
    [21]D. Vaquero, M. Turka, K. Pullib, M. Ticob, and N. Gelfandb, "A survey of image retargeting techniques," Proceedings of SPIE the International Society for Optical Engineering, vol. 7798, p. 779814, 2010.
    [22]H. Liu, X. Xie, W. Y. Ma, and H. J. Zhang, "Automatic browsing of large pictures on mobile devices," Proceedings of the eleventh ACM international conference on Multimedia. pp. 148-155, 2003.
    [23]B. Suh, H. Ling, B. B. Bederson, and D. W. Jacobjs, "Automatic thumbnail cropping and its effectiveness," Proceedings of the 16th annual ACM symposium on User interface software and technology, 2003.
    [24]G. Ciocca, C. Cusano, F. Gasparini, and R. Schettini, "Self-adaptive image cropping for small displays," IEEE Transactions on Consumer Electronics, vol. 53, no. 4, pp. 1622-1627, 2007.
    [25]Y. S. Wang, H. C. Lin, O. Sorkine, and T. Y. Lee, "Motion-based video retargeting with optimized crop-and-warp," ACM Transactions on Graphics (TOG) , vol. 29, no. 4, p.90, 2010.
    [26]M. Rubinstein, D. Gutierrez, and O. Sorkine, "A comparative study of image retargeting," ACM Transactions on Graphics (TOG), vol. 29, no. 6, p. 160, 2010.
    [27]H. Samet and M. Tamminen, “Efficient component labeling of image of arbitrary dimension represented by linear bintrees,” IEEE Transaction on Pattern Analysis and Machine Intelligence, vol. 10, issue. 4, 1988.

    QR CODE
    :::