| 研究生: |
沈信良 Xin-Liang Shen |
|---|---|
| 論文名稱: |
先進安全車輛的道路線及前車視覺偵測技術 Vision Detection of Lanes and Vehicles for Advanced Safety Vehicles |
| 指導教授: |
曾定章
Din-Chang Tseng |
| 口試委員: | |
| 學位類別: |
碩士 Master |
| 系所名稱: |
資訊電機學院 - 資訊工程學系 Department of Computer Science & Information Engineering |
| 畢業學年度: | 95 |
| 語文別: | 中文 |
| 論文頁數: | 102 |
| 中文關鍵詞: | 相關性 、前車偵測 、道路線偵測 、道路線分類 、樣板 |
| 外文關鍵詞: | correlation, Lane detection, template, lane classification, Vehicle detection |
| 相關次數: | 點閱:7 下載:0 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
在台灣,每年有超過兩千人因為交通事故致死。有鑑於此,發展車
輛輔助安全駕駛系統,也就越顯得重要。在安全駕駛的研究上,我們架
設一部相機於車前,用來偵測及追蹤前車及道路線資訊,分析前車和已
車的行車狀況,以確保駕駛人於行車時的安全。
到目前為止我們的系統已有十二項偵測及分析功能 : 車道線偵
測、多車道估計、虛實道路線分類、黃白道路線分類、單雙道路線分類、
己車方向估計、己車左右位置估計、偏離車道警示、前車偵測、前車距
離估計、煞車燈偵測、及方向燈偵測。雨天的前車偵測與追蹤、黃白道
路線分類、單雙道路線分類、區分行駛於一般市區道路時遇到路口問題
和夜間駕駛時燈源發散現象是本論文所提供的。
在雨天前車的偵測中,我們以車子底部和輪胎顏色較深的特性,設
計樣板並且藉由樣板匹配來偵測前車的可能位置,去除樣板重疊的部份
來加快系統執行效率和增加執行效果。之後,再以一個小矩形框來代表
我們所找到的前車區塊。最後再利用車寬和車道寬的比例、對稱性、及
區塊色彩標準差來驗證是否真的是車輛。在道路線偵測方面,根據所得
到的道路線兩側位置,取出道路線中線的顏色資訊,藉此區分黃白及單
雙的道路線,再利用影像連續性的觀念,記錄每張影像中道路線的角度
及截距,並且計算其變化程度並修正,藉此判斷是否為相機震動或是遇
到路口。而利用道路線寬的觀念,來克服夜間駕駛時,因前車車燈或是
路燈產生的燈源發散現象。
我們以多種影像:晴天、陰天、多雲、雨天及夜晚在一般道路及高
速公路等影像,來測試我們的偵測效能。從實驗結果顯示,我們所提出
的系統可以在不同的天候及駕駛狀況下,即時且快速的偵測前車及道路
線。
Developing real-time automotive driver assistance systems to alert
drivers about driving environments and possible collision with other vehicles
has attracted much attention lately. In order to achieve such a system, we use
a camera mounted on a vehicle to capture road scenes for lane and preceding
vehicle detection.
The proposed system consists of twelve functions: lane detection,
multiple lane estimation, classification of solid/dashed lane marks,
classification of yellow/white lane marks, classification of single/double lane
marks, vehicle direction estimation, vehicle lateral offset estimation, lane
departure warning, preceding vehicles detection, distance estimation for
preceding vehicles, brake light detection, and turn signal detection.
In this thesis, the lane marks are detected by searching the best-fitted
parameters of a defined lane model on the image, and we verify the results by
the width of lane marks and the difference of the slopes and the intercepts in
consecutive image frames. Preceding vehicle detection is divided into two
independent parts based on daytime and bad weather conditions. In the
daytime condition, we utilize cast shadow, left/right borders of a vehicle to
detect preceding vehicles and use ratio of the road width and vehicle width,
symmetry, and variance to verify vehicle region. In bad weather condition
such as rainy day, we generate several templates based on the tires and the
bottom of vehicles. According to template matching, we can find out the
vehicle candidates and then use ratio of the road width and vehicle width,
symmetry, and variance to verify.
In the experiments, the proposed methods are evaluated on several
different weather conditions such as sunny day, misty day, dusky day, cloudy
day, rainy day, and night. The average vehicle detected rate is 94.5 % and
average processing time for executing all twelve functions is about 0.045
second run on a general PC with Intel® Pentium® D 3.0GHz CPU. From the
experimental results, we find that the proposed approaches can stably detect
or track the lanes and preceding vehicles in real time.
[1] Araki, S., T. Matsuoka, H. Takemura, and N. Yokoya, “Real-time
tracking of multiple moving objects in moving camera image sequences
using robust statistics,” in Proc. IEEE Int’l Conf. on Pattern
Recognition, Brisbane, Australia, Aug.16-20, 1998, pp.1433-1435.
[2] Bensrhair, A., A. Bertozzi, A. Broggi, A. Fascioli, S. Mousset, and G.
Toulminet, “Stereo vision-based feature extraction for vehicle
detection,” in Proc. IEEE Intelligent Vehicle Sym., Versailles, France,
June 7-21, 2002, pp.465-470.
[3] Bertozzi, M., A. Broggi, and S. Castelluccio, “A real-time oriented
system for vehicle detection,” Journal of Systems Architecture,
pp.317-325, Mar. 1997.
[4] Bertozzi, M. and A. Broggi, “GOLD: a parallel real-time stereo vision
system for generic obstacle and lane detection,” IEEE Trans. on Image
Processing, vol.7, no.1, pp.62-81, Jan. 1998.
[5] Bertozzi, M., A. Broggi, A. Fascioli, and S. Nichele, “Stereo
vision-based vehicle detection,” in Proc. IEEE Intelligent Vehicles
Sym., Dearborn, MI, Oct.3-5, 2000, pp.39-44.
[6] Betke, M., E. Haritaoglu, and L. S. Davis, “Real-time multiple vehicle
detection and tracking from a moving vehicle,” Machine Vision and
Applications, vol.12, pp.69-83, Sep. 2000.
[7] Broggi, A., M. Bertozzi, A. Fascioli, C. Guarino Lo Bianco, and A.
Piazzi, “Visual perception of obstacles and vehicles for platooning,”
IEEE Trans. Intelligent Transportation Systems, vol.1, pp.164-176, Sep.
2000.
[8] Bucher, T., C. Curio, J. Edelbrunner, C. Igel, D. Kastrup, I. Leefken, G.
Lorenz, A. Steinhage, and W. von Seelen, “Image processing and
- 76 -
behavior planning for intelligent vehicles,” IEEE Trans. Industrial
Electronics, vol.50, Issue.1, pp.62-75, Feb. 2003.
[9] Chen, K.-W., Monocular Computer Vision Technigues for Road and
Situation Detection, Master thesis, Computer Science and Information
Engineering Dept., National Central Univ., Chung-li, Taoyuan, Taiwan,
2005.
[10] Chen, Y.-L., Y.-H. Chen, C.-J. Chen, and B.-F. Wu, “Nighttime vehicle
detection for driver assistance and autonomous vehicles,” in Proc.
IEEE 18th Int’l Conf. on Pattern Recognition, Hong Kong, China,
Aug.20-24, 2006, pp.687-690.
[11] Chern, M.-Y. and B.-Y. Shyr, “Locating nearby vehicles on highway at
daytime based on the front vision of a moving car,” in Proc. IEEE Conf.
on Robotics and Automation, Taipei, Taiwan, Sep.14-19, 2003,
pp.2085-2090.
[12] Chern, M.-Y. and P.-C. Hou, “The lane recognition and vehicle
detection at night for a camera-assisted car on highway,” in Proc. IEEE
Conf. on Robotics and Automation, Taipei, Taiwan, Sep.14-19, 2003,
pp.2110-2115.
[13] Chern, M.-Y., “Development of a vehicle vision system for vehicle/lane
detection on highway,” in Proc. of the 18th IPPR Conf. on Computer
Vision, Graphics and Image Processing, Taipei, Taiwan, Aug.21-23,
2005, pp.803-810.
[14] Chu J., L. Ji, L. Guo, Libibing, and R. Wang, “Study on method of
detecting preceding vehicle based on monocular camera,” in Proc.
IEEE Intelligent Vehicles Sym., Parma, Italy, June 14-17, 2004,
pp.750-755.
[15] Clady, X., F. Collange, F. Jurie, and P. Martinet, “Cars detection and
- 77 -
tracking with a vision sensor,” in Proc. IEEE Intelligent Vehicles Sym.,
Columbus, Ohio, June 9-11, 2003, pp.593-598.
[16] Cucchiara, R. and M. Piccardi, “Vehicle detection under day and night
illumination,” in Proc. IEEE Int’l ICSC Sym. Intelligent Industrial
Automation, 1999.
[17] Dagan, E., O. Mano, G. P. Stein, and A. Shashua, “ Forward collision
warning with a single camera,” in Proc. IEEE Intelligent Vehicle Sym.,
Parma, Italy, June 14-17, 2004, pp.37-42.
[18] Du, Y. and N.P. Papanikolopoulos, “Real-time vehicle following
through a novel symmetry-based approach,” in Proc. IEEE Int’l Conf.
on Robotics and Automation, Albuquerque, NM, Apr.20-25, 1997,
pp.3160-3165.
[19] Heisele, B. and W. Ritter, “Obstacle detection based on color blob
flow,” in Proc. IEEE Intelligent Vehicles Sym., Detroit, MI, Sep.25-26,
1995, pp.282-286.
[20] Hoffmann, C., T. Dang, and C. Stiller, “Vehicle detection fusing 2D
visual features,” in Proc. IEEE Intelligent Vehicles Sym., Parma, Italy,
June 14-17, 2004, pp.280-285.
[21] Hu, Z. and K. Uchimura, “Tracking cycle: a new concept for
simultaneous tracking of multiple moving objects in a typical traffic
scene,” in Proc. IEEE Intelligent Vehicles Sym., Dearborn, MI, Oct.3-5,
2000, pp.233-239.
[22] Huang, S.-S., C.-J. Chen, P.-Y. Hsiao, and L.-C. Fu, “On-board vision
system for lane recognition and front-vehicle detection to enhance
driver’s awareness,” in Proc. IEEE Int’l Conf. on Robotics and
Automation, New Orleans LA, Apr.26 - May 1, 2004, pp.2456-2461.
[23] Huang, Y.-C. and D.-C. Tseng, “A vision-based vehicle to vehicle
- 78 -
detection and tracking system,” in Proc. of the 18th IPPR Conf. on
Computer Vision, Graphics and Image Processing, Taipei, Taiwan,
Aug.21-23, 2005.
[24] Jung, C. R. and Christian, R. K., “A lane departure warning system
using lateral offset with uncalibrated camera,” in Proc. IEEE Conf. on
Intelligent Transportation System, Vienna, Austria, Sep.13-16, 2005,
pp.348-353.
[25] Kate, T. K., M. B. van Leewen, S. E. Moro-Ellenberger, B. J. F.
Dressen, A. H. G. Versluis, and F. C. A. Groen, “Mid-range and distant
vehicle detection with a mobile camera,” in Proc. IEEE Conf. on
Intelligent Vehicles, Parma, Italy, June 14-17, 2004, pp.72-77.
[26] Lai, T.-C., A Real-Time Robust On-Vehicle Generic Obstacle and Lane
Detection System Based on Computer Vision Technique, Master thesis,
Electronic and Control Engineering Dept., National Chiao Tung Univ.,
Hsinchu, Taiwan, 2005.
[27] Leeuwen van and C. A. Groen, "Vehicle detection with a mobile
camera: spotting midrange, distant, and passing cars," Robotics and
Automation, vol.12, pp.37-43, 2005.
[28] Nagumo, S. H. Hasegawa, and N, Okamoto, "Extraction of forward
vehicles by front-mounted camera using brightness information," in
Proc. IEEE Conf. on Electrical and computer engineering, Montreal,
May.4-7, 2003, pp.1243-1246.
[29] Raboisson, S. and P. Schmouker, "Obstacle detection in highway
environment by color CCD camera and image processing prototype
installed in a vehicle," in Proc. IEEE Intelligent Vehicles Sym., Paris,
France, Oct.24-26, 1994, pp.44-49.
[30] Regensburger, U. and V. Graefe, "Visual recognition of obstacles on
- 79 -
roads," in Proc. IEEE Int’l Conf. on Intelligent Robots and
Systems, Munich, Germany, Sep.12-16, 1994, pp.980-987.
[31] Rojas, J. C., and J. D. Crisman, "Vehicle detection in color images," in
Proc. IEEE Conf. on Intelligent Transportation System, Boston, MA,
Nov.9-12, 1997, pp.403-408.
[32] Shih, H.-W. and D.-C. Tseng, "Visual detection of preceding vehicles
and their brake / turn lights," in Proc. of the 19th IPPR Conf. on
Computer Vision, Graphics and Image Processing, Taoyuan, Taiwan,
Aug.13-15, 2006.
[33] Shyr, B.-Y., Daytime Detection of Leading and Neighboring Vehicles
on Highway: A Major Capability for the Driver Assistant Vision System,
Master thesis, Elect. Eng. Dept., National Chung Cheng Univ., Chia-yi,
Taiwan, 2003.
[34] Srinivasa, N., "Vision-based vehicle detection and tracking method for
forward collision warning in automobiles," in Proc. IEEE Intelligent
Vehicle Sym., Jun.17-21, 2002, pp.626-631.
[35] Stein, G. P., O. Mano, and A. Shashua, " Vision-based ACC with a
single camera: bounds on range and range rate accuracy," in Proc.
IEEE Intelligent Vehicle Sym., Ohio, USA, June 9-11, 2003,
pp.120-125.
[36] Sukthankar, P., "RACCON: A real-time autonomous car chaser
operating optimally at night," in Proc. SICE Conf., July 25-27, 2001,
pp.38-41.
[37] Wang, C.-C.,, Driver Assistance System for Lane Departure Prevention
and Collision Avoidance with Night Vision, Master thesis, Computer
Science and Information Engineering Dept., National Taiwan Univ.,
Taipei, Taiwan, 2004.
- 80 -
[38] Wang, C.-C., C.-J. Chen, Y.-M. Chan, L.-C. Fu, and P.-Y. Hsiao, "Lane
detection and vehicle recognition for driver assistance system at
daytime and nighttime," in Image and Recognition Magazine, vol.12,
no.2, 2006, pp.4-17.
[39] Wu, B.-F., Y.-L. Chen, and C.-C. Chiu, " A discriminant analysis based
recursive automatic thresholding approach for image segmentation,"
IEICE Trans. Info. System, vol.E88-D, no.7, pp.1716-1723, 2005.
[40] Zehang, S., G. Bebis, and R. Miller, "On-road vehicle detection using
Gabor filters and support vector machines," in Proc. Int’l Conf. on
Digital Signal Processing, Greece, July 1-3, 2002, pp.1019-1022.
[41] Zehang, S., R. Miller, G. Bebis, and D. DiMeo, "A real-time precrash
vehicle detection system," in Proc. IEEE Conf. on Applications of
Computer Vision, Orlando, FL, Dec.3-4, 2002, pp.171-176.
[42] Zehang, S., G. Bebis, and R. Miller, "On-road vehicle detection using
optical sensors: A review," in IEEE Int’l Conf. on Intelligent
Transportation Systems, Washington DC, Oct.3-6, 2004, pp.585-590.
[43] Zehang, S., G. Bebis, and R. Miller, "On-Road Vehicle Detection: A
Review," IEEE Trans. on Pattern Analysis and Machine Intelligence,
vol.28, no.5, pp.694-711, 2006.
[44] Zhihong, Z. and M. Songde, "An efficient vision system for multiple
car tracking," in Proc. IEEE Int’l Conf. on Pattern Recognition, Quebec,
Canada, Aug.11-15, 2002, pp.609-612.
[45] Zielke, T., M. Brauckmann, and W. Von Seelen, "Intensity and
edge-based symmetry detection with an application to car-following,"
Image Understanding, vol.58, no.2, pp.177-190, 1993.