昏睡與疲勞會降低對外界的反應、注意力，與警覺度。為了保障駕駛人和行人的安全，我們提出了一個駕駛昏睡偵測和警示系統；我們架設一部紅外線相機於駕駛座前方擷取駕駛人的臉部影像，分析駕駛人是否昏睡並提出警示。
此系統包含了主動式取像設備、眼睛偵測、眼睛追蹤、眼睛閉合與視線偵測，及昏睡判定與警示。為了使系統能也夠在夜晚或是亮度不足的環境下運作，我們使用一組紅外線相機配合紅外線打光器來取得駕駛人的臉部影像。
針對亮度不均勻的影像，我們根據影像的邊強度將影像劃分為多個區域，再對影像各區域各別二值化，經由幾何限制條件擷取可能的眼睛區塊，再利用支援向量機 (Support Vector Machine, SVM) 辨識是否為眼睛，最後再進行雙眼的驗證。根據雙眼的位置估計臉部範圍。當連續三張影像偵測成功，進入追蹤模式。在追蹤模式，我們在預測的區域內做三階段的眼睛偵測。在眼睛閉合偵測部份，我們測試了兩種方法並比較其準確性。在視線方向偵測，我們根據瞳孔的位置來判斷視線的左右方向。在昏睡判定方面，我們根據單位時間內閉眼張數所佔的百分比來判斷駕駛人是否陷入昏睡。
我們在不同照度環境下測試我們的系統。實驗數據提示，眼睛偵測的偵測率為88.6%，誤判率為1.16%；眼睛閉合偵測的正確率為93.5%，誤判率為6.39%；平均偵測時間為0.057045秒，每秒約可處理18張影像。我們的方法能夠正確的偵測到駕駛人的眼睛和閉合狀態，並在偵測到駕駛昏睡的0.9秒內發出警示

To insure the safety of the driver and pedestrians on the road, we propose a vision based driver drowsiness detection and warning system. We use a camera mounted on the vehicle to capture the driver’s face images for eye detection and drowsiness discrimination.
The system consists of five parts: Image acquisition system, eye detection, eye tracking, eye open/close and gaze direction estimation, and drowsiness discrimination. In the image acquisition system, we use an IR camera with two illuminators to capture driver’s face images in poor illuminated conditions.
In order to deal with the uneven illumination, we propose a local thresholding method to divide the image into several partitions based on the strong edges then iteratively threshold each partition. We use connected-component and support vector machine (SVM) to verify eyes. If there are fixed numbers of frames succeeded in detection mode, we alternate the processing to tracking mode. In tracking mode, we detect eyes in the predicted region. We extract eye open/closed statuses and gaze directions information as our visual cues. In eye open/closed statues determination, we consider two criteria and compare their performance. In gaze direction estimation, we divide the eye region into three equal-sized subregions, then determine the pupil location in which subregion for the estimation. In drowsiness discrimination, we use PERCLOS measurement to judge whether the driver is drowsy.
We test our system on our experimental car in various illumination conditions such as sunny day, cloudy day, at night, uneven illuminated conditions, with/without glasses. From the experimental results, we find that the proposed approach can stably detect the eyes and give a warning if drowsiness is detected.

[1] Bergasa, L. M., J. Nuevo, M. A. Sotelo, R. Barea, and M. E. Lopez, “Real-time system for monitoring driver vigilance,” IEEE Trans. on Intelligent Transportation Systems, vol.7, issue 1, pp.63-77, Mar. 2006.
[2] Cortes, C. and V. Vapnik, “Support vector networks,” Machine Learning, vol.20, issue 3, pp.273-297, Sep. 1995.
[3] Delac, K., M. Grgic, and T. Kos, “Sub-image homomorphic filtering technique for improving facial identification under difficult illumination conditions,” in Proc. Int. Conf. Systems, Signals and Image Processing, Budapest, Hungary, Sep.21-23, 2006, pp.95-98.
[4] Dinges, D. and R. Grace, PERCLOS: A Valid Psychophysiological Measure of Alertness As Assessed by Psychomotor Vigilance, US Department of Transportation, Federal Highway Administration, TechBrief, FHWA-MCRT-98-006, 1998.
[5] D''Orazio, T., Leo, M. Cicirelli, G. Distante, and A. Distante, “An algorithm for real time eye detection in face images,” in Proc. 17th Int. Conf. on Pattern Recognition, Cambridge, UK, Aug.23-26, 2004, pp.278-281.
[6] Eriksson, M. and N. P. Papanikolopoulos, “Driver fatigue: a vision-based approach to automatic diagnosis,” Transportation Research Part C: Emerging Technologies, vol.9, issue 6, pp.399-413, Dec. 2001.
[7] Feng, G.-C. and P.-C. Yuen, “Variance projection function and its application to eye detection for human face recognition,” Pattern Recognition Letters, vol.19, issue 9, pp.899-906, July 1998.
[8] Feng, G.-C. and P.-C. Yuen, “Multi-cues eye detection on gray intensity image,” Pattern Recognition, vol.34, issue 5, pp.1033-1046, May 2001.
[9] Grace, R., V. E. Byrne, D. M. Bierman, J.-M. Legrand, D. Gricourt, B.K. Davis, J. J. Staszewski, and B. Carnahan, "A drowsy driver detection system for heavy vehicles," in Proc. 17th DASC Conf. Digital Avionics Systems, The AIAA/IEEE/SAE, vol.2, Bellevue, WA, Oct.31-Nov.7, 1998, pp.I36/1-I36/8.
[10] Grace, R., “Drowsy driver monitor and warning system,” in Proc. Int. Driving Symp. on Human Factors in Driver Assessment, Training and Vehicle Design, Aspen, Colorado, Aug.14-17, 2001.
[11] Guo, G., S.-Z. Li, and K.-L. Chan, “Support vector machines for face recognition,” Image and Vision Computing, vol.19, issue 9-10, pp.631-638, Aug. 2001.
[12] Haro, A., M. Flickner, and I. Essa, “Detecting and tracking eyes by using their physiological properties, dynamics, and appearance,” in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Hilton Head Island, SC, June 13-15, 2000, pp.163-168.
[13] Ji, Q. and X. Yang, “Real-time eye, gaze, and face pose tracking for monitoring driver vigilance,” Real-Time Image, vol.8, issue 5, pp.357-377, Oct. 2002.
[14] Ji, Q., Z. Zhu, and P. Lan, “Real-time nonintrusive monitoring and prediction of driver fatigue,” IEEE Trans. on Vehicular Technology, vol.53, no.4, pp.1052-1068, July 2004.
[15] Ji, Q. and Z. Zhu, “Robust real-time eye detection and tracking under variable lighting conditions,” Computer Vision and Image Understanding, vol.98, issue 1, pp.124-154, Apr. 2005.
[16] Kawato, S. and N. Tetsutani, "Circle frequency filter and its application," in Proc. Int. Workshop on Advanced Image Technology, Taejon, Korea, Feb.8-9, 2001, pp.217-222.
[17] Lin, C.-T., R.-C. Wu, T.-P. Jung, S.-F. Liang, and T.-Y. Huang, “Estimating driver performance based on EEG spectrum analysis,” EURASIP Journal on Applied Signal Processing, vol.2005, issue 1, pp.3165-3174, Jan. 2005.
[18] Lin, S.-M., A Real-Time Driver Drowsiness Detection and Alertness Monitor System, Master thesis, Computer Science and Information Engineering Dept., National Central Univ., Chungli, Taiwan, 2007.
[19] Nixon, M., “Eye spacing measurement for facial recognition,” in Proc. SPIE Applications of Digital Image Processing VIII, San Diego, CA, Aug. 20-22, 1985, pp.279-285.
[20] Park, I., J. H. Ahn, and H. Byun, “Efficient measurement of eye blinking under various illumination conditions for drowsiness detection systems,” in Proc. 18th Int. Conf. Pattern Recognition, Hong Kong, Aug. 20-24, 2006, vol.1, pp.383-386.
[21] Smith, P., M. Shah, and N. da Vitoria Lobo, “Monitoring head/eye motion for driver alertness with one camera,” in Proc. of 15th Int. Conf. Pattern Recognition, Barcelona, Spain, Sep.3-7, 2000, pp.636-642.
[22] Smith, P., M. Shah, and N. da Vitoria Lobo, "Determining driver visual attention with one camera," IEEE Trans. on Intelligent Transportation Systems, vol.4, issue 4, pp.205-218, Dec. 2003.
[23] Ueno, H., M. Kaneda, and M. Tsukino, “Development of drowsiness detection system,” in Proc. Conf. Vehicle Navigation and Information Systems, Yokohama, Japan, Aug.31-Sep.2, 1994, pp.15-20.
[24] Vapnik, V. N., The Nature of Statistical Learning Theory, 2nd Ed, Springer-Verlag, New York, 1999.
[25] Wang, J.-W. and W.-Y. Chen, “Eye detection based on head contour geometry and wavelet subband projection,” Optical Engineering, vol.45, issue 5, May 2006, pp.057001.1-057001.12.
[26] Wang, Q. and J. Yang, “Eye location and eye state detection in facial images with unconstrained background,” Journal of Information and Computer Science, vol.1, no.5, pp.284-289, Dec. 2006.
[27] Wang, Q., J. Yang, M. Ren, and Y. Zheng, “Driver fatigue detection: a survey,” in Proc. 6th World Congress on Intelligent Control and Automation, Dalian, China, June 21-23, 2006, pp.8587-8591.
[28] Welch, G. and G. Bishop, An Introduction to The Kalman Filter, SIGGRAPH 2001 Course Notes, 2001.
[29] Yuille, A. L., D.S. Cohen, and P. W. Hallinan, “Feature extraction from faces using deformable templates,” in Proc. IEEE Conf. Computer Vision and Pattern Recognition, San Diego, CA, Jun.4-8, 1989, pp.104-109.