本研究從資訊融合角度出發，結合光達資料及數位化彩色空照影像進行三維建物模型之重建。本研究分成兩個部分，第一部份是房屋區塊偵測，第二部份是房屋模型重建。
房屋區塊偵測部分，依原始光達資料之高度資訊，判別出地上物區域。利用空照影像之色彩分析，將地上物區域之樹木部分去除。殘餘之區塊設定一面積門檻，將面積過小之區塊濾除。之後進行區塊形狀以及表面分析，去除不合理之區塊，房屋區塊即建立完成。
房屋模型重建部分，首先進行光達資料前處理，預估出概略屋緣位置，同時萃取出位於屋頂平面之光達點。將預估之概略屋緣位置投影至空照影像上，設定工作區域，在此區域內進行精確之直線偵測。所得之直線線段組合成房屋之候選屋頂面，搭配前處理中萃取出之光達點進行屋頂面之判別與高度計算後，投影回物空間獲得三維之屋頂面，最終結合SMS方法建立房屋模型。研究中使用新竹科學園區之光達資料及大比例尺數位空照影像進行測試。

From the viewpoint of data fusion, we integrate LIDAR data and digital aerial image to perform 3D building modeling in this study. The proposed scheme comprises two major parts: (1) building block detection and (2) building model reconstruction.
In the first step, height differences from LIDAR data are analyzed to detect the above ground areas. Color analysis is then performed for the exclusion of tree areas. Remaining regions are restricted by area threshold. After the refinement by shape and texture analysis, building blocks are established.
In the second step, we analyze the height information of LIDAR raw data to estimate the approximate roof-edges and extract the LIDAR points located on the rooftop. Based on the approximate roof-edges, accurate 2D edges are calculated in aerial image and then transformed into candidate roof-planes. Combined with the extracted LIDAR points, the correct roof-planes are selected and projected back to object space as 3D roof-planes. At last, a patented method SMS (Split-Merge-Shape) is employed to generate building models using the 3D roof-planes. LIDAR data and large scale aerial image in Hsin-Chu Science-based Industrial Park of north Taiwan were used in the test.

王冠華，「多重疊航照立體對半自動房屋模型重建」，國立中央大學土木工程研究所碩士論文，中壢，2003。
邵怡誠、陳良健，「利用光達資料於DTM生產及房屋偵測」，第二十二屆測量學術及應用研討會論文集，第87-94頁，2003。
陳衍豪，「立體航測影像直線偵測與圓弧輪廓建物半自動之三維模型重建」，國立中央大學土木工程研究所碩士論文，中壢，2001。
饒見有、陳良健，「局部最大值追蹤法於邊緣影像細化及向量化之研究」，八十六年電子計算機於土木水利工程應用論文研討會論文集，第471-476頁，1997。
Ackermann, F.,1999, “Airborne Laser Scanning – present status and future expectations”, ISPRS Journal of Photogrammetry & Remote Sensing, Vol. 54, pp. 64-67.
Alharthy, A., & Bethel, J., 2002, “Heuristic filtering and 3D feature extraction from LIDAR data”, IAPRS, vol. XXXIII, pp. 29-35, Graz, Austria.
Briese, C., Pfeifer, N., & Dorninger, P., 2002, “Application of the Robust Interpolation for DTM Determination”, IAPRS, vol. XXXIII, pp.55-61, Graz, Austria.
Chen, L. C., & Rau, J. Y., 2002, “Geometrical Building Modeling and Its Application to the Ortho-Rectification for Aerial Images”, Ph. D. National Central University, Taiwan.
Chen, L. C., & Rau, J. Y., 2003, “Robust Reconstruction of Building Models from Three-Dimensional Line Segments”, Photogrammetry Engineering & Remote Sensing, Vol. 69, No .2, pp. 181-188
Danahy, J., 1999, “Visualization Data Needs in Urban Environmental Planning and Design”, Proceedings of the Photogrammetric Week, Karlsrnhe, pp. 351-365.
Elberink, S. O., & Mass, H. G., 2000, “The Use of Anisotropic Height Texture Measures for the Segmentation of Airborne Laser Scanner Data”, IAPRS, vol. XXXIII. Part B3. pp. 678-684, Amsterdam.
Gruen, A., & Dan, H., 1997, “TOBAGO – a topology builder for the automated generation of building models”, Automatic Extraction of Man-Made Objects from Aerial and Space Images (II) Monte Vertia, pp. 149-160.
Gulch, E., & Muller, H., and Labe, T., 1999, “Integration of Automatic Processes Into Semi-Automatic Building Extraction”, In: Proceedings of ISPRS Conference “Automatic Extraction of GIS Object from Digital Imagery”, September 8-10, 1999
Halla, N., & Brenner, C., 1998, “Interpretation of Urban Surface Models Using 2D Building Information”, Computer Vision and Image Understanding, Vol. 72, No.2, pp.204-214.
Harwood, D., Subbarao, M., Hakalahti, H., and Davis, L. S., 1987, “A new class of edge-preserving smoothing filters”, Pattern Recog. Lett., vol. 6, pp. 155-162, August 1987.
Henricsson, O., & Bignone, F., Willuhn, W., Aef, F., Kuebler, O., Baltsavias, E., Mason, S., and Greun, A., 1996, “PROJECT AMBOE: Strategies, Current Status and Future Work”, ISPRS Congrees, Commission III, Vol. 31, Part B3, pp.321-330.
Masaharu, H., & Hasegawa, H., 2000, “Three-Dimensional City Modeling from LASER Scanner Data by Extracting Building Polygons Using Region Segmentation Method”, IAPRS, vol. XXXIII. Part B3. pp. 556-562 Amsterdam.
Parker, J. R., 1997, “Algorithms for Image Processing and Computer Vision”, John Wiley & Sons, Inc, U.S. pp16-19.
Hough, P.V.C., 1962, “Methodsand Means for Recognising Complex Patterns”, U.S. patent No.306954
Petzold, B., & Reiss, P., and Stössel, W.,1999, “Laser scanning – surveying and mapping agencies are using a new technique for the derivation of digital terrain models ”, ISPRS Journal of Photogrammetry & Remote Sensing, Vol. 54, pp. 95-104.
Richards, J. A., 1986, “Remote sensing digital image analysis”, Springer-Verlag, Berlin, 281 pages.
Rottensteiner, F., & Briese, Ch., 2002. “A New Method For Extraction In Urban Areas From High-Resolution LIDAR Data”, ISPRS, vol. XXXIII, pp. 295-301, Graz, Austria.
Schenk, T., & Csathó, B., 2002, “Fusion of LIDAR Data and Aerial Imagery for a More Complete Surface Description”, IAPRS, vol. XXXIII, pp. 310-317, Graz, Austria.
Shepard, D., 1968, “A two-dimensional interpolation function for irregularly-spaced data”, Proc. 23rd National Conference ACM, ACM, 517-524.
Siebe, E., & Buning, U., 1997, “Application of Digital Photogrammetric Products for Cellnlar Radio Network Planning”, Proceedings of the Photogrammetric Week, Karlsruhe, pp. 159-164.
Skrlatos, D., 1999. “Orthophotograph Production in Urban Areas”, Photogrammtric Record, Vol. 16 No. 94 , pp. 643-650.
Tseng, Y. H., & Wang, S., 2003, “Semiautomatic Building Extraction Based on CSG Model-Image Fitting”, Photogrammetric Engineering & Remote Sensing, Vol.69, No.2, February 2003, pp.171-179
Vögtle, T., & Steinle, E., 2000, “3D Modeling of Building Using Laser Scanning and Spectral Information”, IAPRS, vol. XXXIII. Part B3. pp. 927-934, Amsterdam.
Volz, S., & Klinec, D., 1999, “Nexus: the Development of a Platform for Location Aware Application”, Proceedings of the third Turkish-German Joint Geodetic Days, Vol. 2, Istanbul, pp. 599-608.
Vosselman, G., & Maas, H. G., 1999, “Two Algorism for Extracting Building Models from Raw Laser Altimetry Data”, ISPRS Journal of Photogrammetry & Remote Sensing, Vol. 54, pp. 153-163.
Wang, Z., & Schenk, T., 2000, “Building Extraction and Reconstruction from LIDAR Data”, IAPRS, vol. XXXIII. Part B3. pp. 958-964, Amsterdam.
Wehr, A., & Lohr, U.,1999, “Airborne Laser Scanning – An Introduction and Overview”, ISPRS Journal of Photogrammetry & Remote Sensing, Vol. 54, pp. 68-82.