跳到主要內容

簡易檢索 / 詳目顯示

研究生: 江哲毅
Che-yi Chiang
論文名稱: 可調整影像接合與亮度的全周俯瞰監視系統
Adjustable image registration and brightness for surrounding top-view monitoring system
指導教授: 曾定章
Din-chang Tseng
口試委員:
學位類別: 碩士
Master
系所名稱: 資訊電機學院 - 資訊工程學系
Department of Computer Science & Information Engineering
論文出版年: 2014
畢業學年度: 102
語文別: 中文
論文頁數: 82
中文關鍵詞: 全周俯瞰監視影像暗角補償亮度一致化影像對位
外文關鍵詞: top-view monitoring, bird's-eye-view monitoring, brightness-consistent
相關次數: 點閱:12下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 慢速行車時的主要交通事故在於車體結構與後照鏡角度造成的盲點區域,導致駕駛無法判斷與車輛周圍障礙物的距離所造成車體與人員的碰撞。為了讓駕駛能以俯瞰的方式看清車輛周遭情況,避免因為盲點區域所造成的交通事故,提高在停車、狹路行車、或低速會車時的安全性,本研究提出一套可調整影像接合與亮度的全周俯瞰監視系統。整個系統包含兩大部分:一是全周俯瞰監視用於輔助駕駛觀察車輛周遭的狀況;二是人工影像接合調整提高全周俯瞰畫面的正確性。
    全周俯瞰監視系統共分為二個程序分別是離線程序和線上程序。在離線程序中我們在車輛四周架設四台廣角相機,計算每部相機的內部參數,校正扭曲現象,補償暗角現象。並在車輛四周拍攝大型校正板,透過特徵點的對應關係求得四周俯瞰影像的對位關係,將四相機影像透過平面投影轉換轉為俯瞰影像後融合成一張全周俯瞰影像。線上程序則是根據上述校正好的關係,即時內插出全周俯瞰影像,並根據計算出的亮度參考分佈調整整張影像的亮度均勻性。
    全周俯瞰畫面的對位如果不夠正確,四相機影像的結合處會有明顯的落差。目前市面上有些廠商的全周俯瞰系統有提供人工影像接合調整的功能,但是只提供2D影像的上下左右位移和一個維度的旋轉,在調整影像接合的限制較多。我們提出一個人工影像接合系統提供視覺化的界面,可以讓使用者調整相機外部參數三軸方向的3D旋轉、位移,相機內部參數的焦距、影像中心點,及扭曲參數等調整選擇;讓使用者可根據畫面修改內外部參數及扭曲參數,最後根據更新過的參數修正原有的校正關係。
    我們全周俯瞰監視系統在經過人工拼接調整後可以產生對位準確影像重疊區無落差的全周俯瞰影像;可在影像的解析度為720×480的情況下,於Intel Core™2 Duo 2.83GHz及3.00GB RAM的個人電腦上執行達到每秒 20 張的展示速度。


    A lot of traffic accidents are caused by driver's couldn’t see the area around the vehicles. To reduce the accidents caused by collision with surrounding obstacles, we mount four wide-angle cameras at the front, rear, and both sides of the vehicle to capture consecutive images; then we present a real-time adjustable image registration and brightness for surrounding top-view monitoring system.
    In offline steps of surrounding top-view monitoring system, we first calibrate camera intrinsic parameters, distortion of lens, and vignetting effects of four wide-angle cameras. Then we calibrate the geometric relationships (extrinsic parameters) of four cameras using a proposed multi-camera calibration method. Third, we calculate the feathering weights of pixels on overlapped image areas to produce a seamless surrounding top-view image. At last, we build look-up tables for the mapping between the captured images and the surrounding synthesized image to speed up the processing. In online procedure, the proposed system interpolates and generates the surrounding synthesized image by those look-up tables directly, and adjust image brightness automatically.
    In image registration steps, we provide a graphical user interface for user, This interface can provide roration and shift of three-axis direction, and adjustment options for intrinsic parameters and distortion parameters. After user adjusted image registration, we will build new look-up tables ,use it in online prcdedure. In our experiment, the frame rate of real-time adjustable image registration and brightness for surrounding top-view monitoring system is 20 frames per second.

    摘要 i Abstract iii 致謝 iv 目錄 v 圖目錄 viii 表目錄 xii 第一章 緒論 1 1.1 動機 1 1.2 系統概述 2 1.3 論文架構 3 第二章 相關研究 5 2.1 車輛環場監視系統 5 2.2 暗角校正 16 2.3 扭曲校正 19 2.4影像調整系統 21 第三章 相機校正 22 3.1 相機參數校正 22 3.1.1 相機模型 22 3.1.2 相機參數校正方法 25 3.1.3 內部參數的條件限制式 26 3.1.4 求解內部與外部參數 27 3.1.5 估計最佳解 28 3.2 鏡頭扭曲校正 29 3.2.1 扭曲模型 30 3.2.2 估計扭曲參數 31 3.3 鏡頭暗角校正 33 3.3.1 暗角模型 33 3.3.2 估計暗角參數 34 3.3.3 消除暗角效應 35 第四章 俯瞰轉換與接合 36 4.1 俯瞰轉換 36 4.1.1 平面投影轉換 36 4.1.2 特徵點對應求解平面投影轉換 37 4.1.3 快速影像對位 40 4.2 內差與色彩融合建表 41 4.2.1 內插 41 4.2.2 色彩融合 43 4.2.3 建表 44 4.3 即時亮度調整 45 4.4.1 內部參數和扭曲參數修正 49 4.4.2 外部參數三軸方向位移 49 4.4.3 外部參數三軸方向旋轉 49 第五章 實驗 51 5.1 實驗環境 51 5.2 相機校正 52 5.3 暗角校正 54 5.4 全周俯瞰監視系統 55 5.5亮度調整的全周俯瞰監視影像 56 5.6 俯瞰影像的接合調整 58 第六章 結論與未來展望 60 參考文獻 62

    [1]BMW,Surround View Camera System, in
    http://www.bmw.com/com/en/newvehicles/5series/gran_turismo/2013/showroom/driving_assistance/camera.html#t=s
    [2]Brown, D. C., "Close-range camera calibration," Photogrammetric Engineering, vol.37, no.8, pp.855-866, 1971.
    [3]Deverney, F. and O. Faugeras, "Straight lines have to be straight," Machine Vision and Applications, vol.13, no.1, pp.14-24, 2001.
    [4]Ehlgen, T. and T. Pajdla, "Monitoring surrounding areas of truck-trailer combinations," in Proc. 5th Int. Conf. on Computer Vision Systems, Bielefeld, Germany, Mar.21-24, 2007, CD-ROM.
    [5]Ehlgen, T., M. Thorn, and M. Glaser, "Omnidirectional cameras as backing-up aid," in Proc. IEEE 11th Int. Conf. on Computer Vision, Rio de Janeiro, Brazil, Oct.14-20, 2007, pp.1-5.
    [6]Faig, W., "Calibration of close-range photogrammetry systems: Mathematical formulation," Photogrammetric Engineering and Remote Sensing, vol.41, no.12, pp.1479-1486, 1975.
    [7]Faugeras, O., T. Luong, and S. Maybank, "Camera self-calibration: Theory and experiments," in Proc. of 2nd European Conf. on Computer Vision, Santa Margherita Ligure, Italy, May.19-22, 1992, pp.321-334.
    [8]Fleck, M. M., Perspective Projection: The Wrong Imaging Model, Technical Report TR 95-01, Computer Science, University of Iowa, 1995.
    [9]Friel. M, C. Hughes, P. Denny, E. Jones, M. Glavin, "Automatic calibration of fish-eye cameras from automotive video sequences," IEEE Trans. Intelligent. Transportation. Systems, vol.4, no.2, pp.136-148, 2010.
    [10]Fujitsu, 360-Degree Wrap-around Video Imaging Technology, in http://www.fujitsu.com/us/news/pr/fma_20101019-02.html
    [11]Gennery, D., "Stereo-camera calibration," in Proc. of 10th Image Understanding Workshop, Los Angeles, CA, Nov.7-8, 1979, pp.101-108.
    [12]Geyer, C. and K. Daniilidis, "Catadioptric projective geometry," Int. Journal of Computer Vision, vol.45, no.3, pp.223-243, Jun. 2001.
    [13]Goldman, D. B., "Vignette and exposure calibration and compensation," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol.32, no.12, pp.2276-2288, Dec. 2010.
    [14]Hartley, R. and A. Zisserman, Multiple View Geometry in Computer Vision, 2nd Edition, Cambridge University Press, 2004.
    [15]Hitone, Around View Parking Supplementary Systems, in
    http://www.hitone.cn/cproducts/prodetail.php?protypeid=295
    [16]Honda, Multi-view Camera System, in http://world.honda.com/news/
    2008/4080918Multi-View-Camera-System/
    [17]Jung, H.-G., D.-S. Kim, P.-J. Yoon, and J. Kim, "Parking slot markings recognition for automatic parking assist system," in Proc. IEEE Intelligent Vehicles Symp, Tokyo, Japan, Jun.13-15, 2006, pp.106-113.
    [18]Kang, S. B. and R. S. Weiss, "Can we calibrate a camera using an image of a flat, textureless lambertian surface?," in Proc. 6th European Conf. on Computer Vision, Dublin, Ireland, Jun.26 - Jul.1, 2000, pp.640-653.
    [19]Li, S., "Monitoring around a vehicle by a spherical image sensor," IEEE Trans. Intelligent. Transportation. Systems, vol.7, no.1, pp. 541-550, 2006.
    [20]Liu, Y. C., K. Y. Lin, and Y. S. Chen, "Bird's-eye view vision system for vehicle surrounding monitoring," in Proc. of the 2nd Int. Conf. on Robot Vision, Berlin, Germany, Feb.20-22, 2008, pp.207-218.
    [21]Marquardt, D., "An algorithm for least-squares estimation of nonlinear parameters," SIAM Journal on Applied Mathematics, vol.11, pp.431-441, 1963.
    [22]Nissan, Around View Monitor, in
    http://www.nissan-global.com/EN/TECHNOLOGY/INTRODUCTION/DETAILS/AVM/
    [23]Slama, C. C., editor, Manual of Photogrammetry, 4th edition, American Society of Photogrammetry and Remote Sensing, Falls Church, Virginia, 1980.
    [24]SPTek, 3D Around View, in
    http://www.sptek.com.tw/product_detail.php?cid=15&id=12
    [25]Sung, K., J. Lee, J. An, and E. Chang, "Development of image synthesis algorithm with multi-camera," in Proc. of 75th IEEE Conf. on Vehicular Technology, Yokohama, Japan, May.6-9, 2012, pp.1-5.
    [26]Wei, G. and S. Ma, "A complete two-plane camera calibration method and experimental comparisons," in Proc. of 4th Int. Conf. on Computer Vision, Berlin, Germany, May.11-14, 1993, pp.439-446.
    [27]Weng, J., P. Cohen, and M. Herniou, "Camera calibration with distortion models and accuracy evaluation," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol.14, no.10, pp.965-980, 1992.
    [28]Xiao, X., G. Yang, and J. Bai, "Capture of vehicle surroundings using a pair of panoramic annular lens cameras," in 7th Proc. Int. Conf. on Telecommunications, Sophia Antipolis, France, Jun.6-8, 2007, pp.1178-1182.
    [29]Zhang, Z., "A flexible new technique for camera calibration," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol.22, no.11, pp.1330-1334, 2000.
    [30]Zheng, Y., S. Lin, C. Kambhamettu, J. Yu, and S. B. Kang, "Single-image vignetting correction," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol.31, pp.2243-2255, Dec. 2009.

    QR CODE
    :::