| 研究生: |
陳品學 Ping-Shen Chen |
|---|---|
| 論文名稱: |
影像修補技術於牆面紋理影像遮蔽去除之應用 OCCLUSION REMOVAL OF FA?ADE TEXTURE WITH CONSTRAINED IMAGE INPAINTING |
| 指導教授: |
蔡富安
Fuan Tsai |
| 口試委員: | |
| 學位類別: |
碩士 Master |
| 系所名稱: |
工學院 - 土木工程學系 Department of Civil Engineering |
| 畢業學年度: | 98 |
| 語文別: | 中文 |
| 論文頁數: | 112 |
| 中文關鍵詞: | 遮蔽移除 、影像修復 、牆面紋理 、影像修補 、等照度面 |
| 外文關鍵詞: | Isophote, Inpainting, fa?ade texture, image restoration, occlusion removal |
| 相關次數: | 點閱:17 下載:0 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
在三維數碼城市中,為了更為符合真實世界,通常都會敷貼牆面紋理影像在模型上,然而在近景拍攝的過程中經常會受到一些樹木、車子、及其他物體的遮蔽影響。因此,有效地去除及修補遭遮蔽的牆面紋理圖像是一個值得研究的課題。數位影像修復是一種移除遮蔽並填補數位影像的有效方法,然而將現有的影像修補技術直接應用於牆面紋理,對於遮蔽的處理並不理想。因此本研究研發一個改良的影像修補技術以處理受遮蔽的牆面紋理,目的是將選擇的遮蔽物移除並藉由此技術找出可靠的紋理回填受損的區域。本研究所研發的影像修補結合了等照度面、法向量、可靠度計算等,計算影像填補的優先順序,並合理地修復受遮蔽的紋理影像。
與現有的影像修補相比,本研究提出的修補技術是基於房屋牆面紋理上的明顯結構,如樑、柱、窗子等以更合理的修復遮蔽。一些重要的參數如搜尋視窗、搜尋範圍也經深入探討以測試影像修補的成果;此外由於牆面紋理有沿著特定方向的特性,因此限定影像修補沿著特定的方向測試其成效。本研究所研發的改良式影像修補技術以真實牆面紋理影像進行測試,並確立影像修補參數的設定。最後,以均方根誤差和結構相似度等指標,進行牆面紋理影像遮蔽修補成果之量化評估。本研究測試不同類型之房屋牆面紋理修復,並以多視角呈現建物群體影像修復,實作成果顯示本研究所提出以房屋牆面紋理上明顯結構特徵為基本單元之方式,可有效修復受遮蔽的牆面紋理影像。
In three dimension digital city modeling, photographic fa?ade texture images are commonly attached to building faces in order to generate more realistic building models and scenes. However, there are usually occlusions from trees, cars and other foreign objects in close-ranged fa?ade photographs. Therefore, it is worthwhile to develop effective methods for efficiently correcting the occlusions in fa?ade texture images. Image inpainting is an effective approach to remove unwanted objects and fill holes in digital images. However, directly applying existing, general-purpose digital inpainting algorithms to the correction of fa?ade texture images with occlusions may not produce satisfactory results. This research developed a constrained image inpainting algorithm specifically designed for the correction of occluded fa?ade texture images. The objective is to remove selected occlusions of fa?ade texture images and restore the damaged texture blocks with reasonable textures identified with the developed constrained inpainting algorithm. The developed inpainting algorithm combines isophote, normal vector and confidence terms to calculate the best fill order of inpainting.
In comparison with existing inpainting approaches, it can restore the occluded texture blocks more reasonably based on fa?ade structures such as pillars, girders and window frames. A few parameters, such as window size and search area of inpainting were also investigated to better understand their effects on the inpainting results. Special constrains on the direction of inpainting order, such as top-down and bottom-up were also tested to understand their effects because the features of texture fa?ade were presumed to be along a particular direction. The developed constrained inpainting algorithms were applied to real building fa?ade images to valid their performance and to identify appropriate inpainting parameters for correcting fa?ade texture occlusions. Finally, the most widely used full-reference quality metric mean square error (MSE) and structural similarity index (SSIM) were employed to quantitatively evaluate the inpainting results.
Several complex building models are used to test the constrained image inpainting algorithms. Experimental results demonstrate that the proposed method based on fa?ade structures is effective in restoring occlusion of building fa?ade texture images. In addition, the experimental results of building fa?ade texture images with special structures are also validated, proving that the proposed approach can restore more reasonable visualization results.
林育樂,2004,「應用紋理合成技術於Web3D場景貼圖設計」,碩士論文,國立成功大學工業設計研究所。
林后駿,2005,「三維房屋模型實景紋理影像製作與敷貼之研究」,碩士論文,國立中央大學土木工程學系。
李唐宇,2007,「結合多元資料重建三維房屋模型」,碩士論文,國立中央大學土木工程學系。
陳正軒,2006,「以視訊影像進行三維房屋模型實景紋理敷貼之研究」,碩士論文,國立中央大學土木工程學系。
Baillard, C., and A. Zisserman, 2000. A plane sweep strategy for the 3D reconstruction of buildings from multiple images, International Archives of Photogrammetry and Remote Sensing, Vol. 33, Part B2, Amsterdam, Netherlands, pp. 56-62.
Bertalmio, M., Sapiro, G., Caselles, V., and Ballester, C., 2000. Image Inpainting, International Conference on Computer Graphics and Interactive Techniques Proceedings of the 27th annual conference on Computer graphics and interactive techniques, Pages 417-424.
Canny, John F., 1986. A Computational Approach to Edge Detection, IEEE Transactions on Pattern Analysis and Machine Intelligence vol. 8:679-698.
Chen, L. -C., C.-Y. Kuo and J.-Y. Rau, 2004. Fusion of LIDAR Data and Large-scale Vector Maps for Building Reconstruction, Proc. 2004 Asian Conference on Remote Sensing, Thailand , No. B-2.6.
Criminisi, A., Perez, P., and Toyama, K.,2004, Region Filling and Object Removal by Exemplar-Based Image Inpainting, IEEE Transactions On Image Processing, Vol. 13, No. 9.
Danahy, J., 1999. Visualization data needs in urban environmental planning and design, Proceedings of the Photogrammetric Week, Karlsruhe, pp.351-365.
Debevec, P. E., 1996. Modeling and Rendering Architecture from Photographs, Ph.D. Dissertation, University of California at Berkeley, CA USA.
Efros, A., and T. Leung, 1999. Texture synthesis by non-parametric sampling, in Proc. Int. Conf. Computer Vision, Kerkyra, Greece, pp. 1033-1038.
Heeger, D., and J. Bergen., 1995. Pyramid based texture analysis/synthesis. Computer Graphics, pp. 229-238, SIGGRAPH 95.
Hough, P.V.C., 1962, Method and means for recognizing complex patterns, U.S.Patent3069654.
Keim, D. A., C. Panse, J. Schneidewind, and M. Sips, 2004. Geo-spatial data viewer: From familiar land-covering to arbitrary distorted geo-spatial quadtree maps, The 12-th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision, 2 - 6 February, University of West Bohemia, Campus Bory, Plzen, Czech Republic.
Lee, D.S., Shan, J., and Bethel, J.S., 2003. Class-guided building extraction from IKONOS imagery, Photogrammetric Engineering and Remote Sensing, Vol. 69, No. 2, pp. 143-150.
Liang, L., C. Liu, Y. Q. Xu, B. Guo, and H.Y. Shum, 2001. Real-time texture synthesis by patch-based sampling, in ACM Trans. on Graphics, vol. 20, pp. 127-150.
Oliveira, M., M., Bowen, B., McKenna, R., Chang, Y., S., 2001. Fast Digital Image Inpainting, Appeared in the Proceedings of the International Conference on Visualization, Imaging and Image Processing (VIIP 2001), Marbella, Spain.September 3-5.
Portilla, J., and E.P. Simoncelli, 2000. A parametric texture model based on joint statistics of complex wavelet coefficients, Int''1J. Computer Vision, vol. 40, No. 1, pp. 49-71.
Rau, J.Y., and L.C. Chen, 2003. Robust reconstruction of building models from three-dimensional line segments, Photogrammetry Engineering and Remote Sensing, Vol. 69, No. 2, pp. 181-188.
Volz, S., and D. Klinec, 1999. Nexus: The development of a platform for location aware application, Proceedings of the third Turkish-German Joint Geodetic Days, Istanbul, Turkey, Vol. 2, pp.599-608.
Wei, L.Y., and M. Levoy, 2000. Fast texture synthesis using tree-structured vector quantization, in Proc. ACM Conf. Computer Graphics, pp. 479-488.
Wang, Z., Bovik, A. C., Sheikh, H. R., and Simoncelli, E. P., 2004. Image Quality Assessment: From Error Visibility to Structural Similarity, IEEE Transactions On Image Processing, Vol. 13, No. 4, pp. 600-612.
Yu, Y., 1999. Efficient visibility processing for projective texture mapping, COMPUTERS & GRAPHICS, 23, pp.245-253