跳到主要內容

簡易檢索 / 詳目顯示

研究生: 蔡洛緯
Luo-Wei Tsai
論文名稱: 特徵顏色表示方法及其在物體偵測上之應用
Eigen Color Representation and Its Applications to Object Detection
指導教授: 范國清
Kuo-Chin Fan
口試委員:
學位類別: 博士
Doctor
系所名稱: 資訊電機學院 - 資訊工程學系
Department of Computer Science & Information Engineering
畢業學年度: 97
語文別: 英文
論文頁數: 85
中文關鍵詞: 特徵顏色物體偵測
外文關鍵詞: traffic sign detection, vehicle detection, eigen color, object detection
相關次數: 點閱:12下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 在電腦視覺領域中,物體偵測是相當基礎且重要的問題。同時可應用在很多方面,例如:視訊監控,導航,影像檢索…等。主要目的是找出物體在影像中的正確位置不論場景如何地變化.
    本論文提出一套新穎的系統架構應用於彩色影像中。首先, 我們發展出一種稱做特徵值顏色的方法。此方法是透過對某特定物體類別做一統計上的分析所推導得到的結果.在這個新的特徵色彩空間上,前景物像素點可以容易地與背景物的像素點作區分,即使是在一些具有光線變化的場景。至於在候選區塊的確認步驟,我們利用數種重要的物體外觀特徵包含角點、邊緣資訊與小波轉換之係數,來建構一串連且多重維度之物體分類器。依據此串連架構,可以對輸入影像中可能的前景物像素點作有效之確認。由於先前已利用色彩資訊濾除大量無關的背景像素點,故此掃瞄步驟將可快速的執行並找出前景物。
    與一般傳統外觀類型的偵測方式相比,我們所提出的特徵色彩空間可以事先過濾大量無關的背景像素點.因此可以有效的快速定位出物體的位置。即使是靜態影像,我們仍舊可以成功的從非固定式的照相機偵測出前景物。我們分別利用車輛與交通號誌的偵測來驗證所提出方法的可行性。實驗結果證明結合特徵色彩資訊與局部外觀資訊之偵測方式是強而有效的。


    Object detection is a fundamental and important problem in computer vision and can be applied to various applications like video surveillance, navigation, content-based image retrieval and so on. Its goal is to find the exact location of an object no matter how the environmental conditions change.
    This thesis presents a novel framework for detecting objects in color images. First of all, a novel eigen color representation derived from a statistical analysis of object instances is presented. In this new eigen-color space, different object pixels can be easily identified from background, even though they are lighted under varying illuminations. At the hypothesis verification stage, each detected pixel corresponds to an object hypothesis. Several important appearance features including corners, edge maps and coefficients of wavelet transforms were used for constructing a cascade multi-channel classifier. With the cascade structure, an effective scanning process can be performed to verify all possible candidates. Because the color feature eliminates most background pixels in advance, the scanning process can be performed extremely quickly to locate each desired object.
    Compared with the traditional appearance-based methods, our proposed eigen-color space can filter out most of impossible candidates in advance and thus each desired object can be very efficiently located from the background. Even thought still images are handled, each object still can be efficiently detected from a non-stationary camera. Two important applications are demonstrated in this thesis; that is, vehicle detection and road sign detection. Experimental results demonstrate that the integration of eigen color feature and local appearance features can form a powerful and superior tool in object detection.

    CHAPTER 1. INTRODUCTION 1 1.1 MOTIVATION 1 1.2 REVIEW OF RELATED WORKS 4 1.2.1 Previous Methods for Vehicle Detection 4 1.2.2 Previous Methods for Road Sign Detection 5 1.2 OVERVIEW OF APPROACH 7 1.2.1 Vehicle Detection system 7 1.2.2 Road Sign Detection system 9 1.3 ORGANIZATION OF THE DISSERTATION 10 CHAPTER 2. EIGEN COLOR DETECTOR 11 2.1 KARHUNEN-LOE`VE TRANSFORM 11 2.2 COLOR FEATURE EXTRACTION 13 2.3 EIGEN COLOR MODEL 14 2.3.1 Vehicle Color Model 14 2.3.2 Road Sign Color Model 18 2.4 TRAINING COLOR DETECTOR 20 2.4.1 Bayesian Classifier 21 2.4.2 Radial Basis Function Network 23 CHAPTER 3. OBJECT VERIFICATION 25 3.1 OBJECT HYPOTHESIS 25 3.2 VEHICLE FEATURES 27 3.2.1 Contour Feature 27 3.2.2 Wavelet Coefficients 28 3.2.3 Integration of Wavelet Feature and Edge Map 30 3.2.4 Corner Feature 31 3.2.5 Verification Procedure 32 3.3 ROAD SIGN FEATURES 34 3.3.1 Geometrical Properties 34 3.3.2 Modified Distance Transform with Weighting 35 3.4 ROAD SIGN RECTIFICATION 38 3.4.1 Circular Road Sign 38 3.4.2 Rectangular and Triangular Road Signs 39 3.5 BINARIZATION 41 CHAPTER 4. EXPERIMENTAL RESULTS 43 4.1 VEHICLE DETECTION PERFORMANCE 43 4.1.1 Results of Vehicle Pixels Classification 43 4.1.2 Vehicle Detection Results 49 4.2 ROAD SIGN DETECTION PERFORMANCE 55 4.2.1 Road Sign Color Segmentation 56 4.2.2 Road Sign Detection, Rectification and Text Extraction 60 CHAPTER 5. CONCLUSIONS AND FUTURE WORKS 66 5.1 CONCLUSIONS 66 5.2 FUTURE WORKS 67 REFERENCES 68

    [1] Z. Sun, G. Bebis, and R. Miller, “On-road vehicle detection: A Review,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 5, pp. 694-711, May 2006.
    [2] V. Kastinaki, M. Zervakis, and K. Kalaitozakis, “A survey of video processing techniques for traffic applications,” Image, Vision, and Computing, vol. 21, no. 4, pp.359-381, April 2003.
    [3] R. Cucchiara, P. Mello, and M. Piccardi, “Image analysis and rule-based reasoning for a traffic monitoring,” IEEE Transactions on Intelligent Transportation Systems, vol. 3, no. 1, pp.37-47, March 2002.
    [4] S. Gupte, O. Masoud, R. F. K. Martin, and N. P. Papanikolopoulos, “Detection and classification of vehicles,” IEEE Transactions on Intelligent Transportation Systems, vol. 1, no. 2, vol. 2, pp.119-130, June 2000.
    [5] I. Haritaoglu, D. Harwood, and L. Davis, “W4: who? when? where? what? a real time system for detecting and tracking people,” International Conference on Face and Gesture Recognition, pp.222-227, 1998.
    [6] G. L. Foresti, V. Murino, and C. Regazzoni, “Vehicle recognition and tracking from road image sequences,” IEEE Transactions on Vehicular Technology, vol. 48, no. 1, pp.301-318, Jan. 1999.
    [7] J. Wu, X. Zhang, and J. Zhou, “Vehicle detection in static road images with PCA-and- wavelet-based classifier,” IEEE Intelligent Transportation Systems Conference, Oakland, C.A., USA, pp.740-744, , Aug. 25-29, 2001.
    [8] Z. Sun, G. Bebis, and R. Miller, “On-road vehicle detection using Gabor filters and support vector machines,” IEEE International Conference on Digital Signal Processing, Santorini, Greece, pp.1019-1022, July 2002.
    [9] A. Broggi, P. Cerri, and P. C. Antonello, “Multi-resolution vehicle detection using artificial vision,” IEEE Intelligent Vehicles Symposium, pp. 310- 314, June 2004.
    [10] M. Bertozzi, A. Broggi, and S. Castelluccio, “A real-time oriented system for vehicle detection,” Journal of Systems Architecture, pp. 317-325, 1997.
    [11] C. Tzomakas and W. Seelen, “Vehicle detection in traffic scenes using shadow,” Tech. Rep. 98-06, Institut fur neuroinformatik, Ruhtuniversitat, Bochum, Germany, 1998.
    [12] A. Lakshmi Ratan, W.E.L. Grimson, and W.M. Wells, “Object detection and localization by dynamic template warping,” International Journal of Computer Vision, vol. 36, no. 2, pp.131-148, 2000.
    [13] A. Bensrhair, A. Bertozzi, A. Broggi, A. Fascioli, S. Mousset, and G. Toulminet, “Stereo vision-based feature extraction for vehicle detection,” IEEE Intelligent Vehicles Symposium, vol. 2, pp. 465-470, June 2002.
    [14] T. Aizawa, A. Tanaka, H. Higashikage, Y. Asokawa, M. Kimachi, S. Ogata, “Road surface estimation against vehicles’ existence for stereo-based vehicle detection,” IEEE 5th International Conference on Intelligent Transportation Systems, pp. 43-48, Sep. 2002.
    [15] J. C. Rojas and J. D. Crisman, “Vehicle detection in color images,” IEEE Conference on Intelligent Transportation System, pp.403-408, Nov. 9-11, 1997.
    [16] D. Guo, T. Fraichard, M. Xie, and C. Laugier, “Color modeling by spherical influence field in sensing driving environment,” IEEE Intelligent Vehicles Symposium, pp. 249- 254, Oct. 2000.
    [17] Y. Ohta, T. Kanade, and T. Sakai, “Color information for region segmentation,” Computer Graphics and Image Processing, vol. 13, pp. 222-241, 1980.
    [18] G. Healey, “Segmenting images using normalized color,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 22, no. 1 , pp. 64-73, 1992.
    [19] R. O. Duda, P. E. Hart, and D. G. Stork. “Pattern classification”, John Wiley & Sons, New York, 2001.
    [20] C. G. Harris and M. J. Stephens, “A combined corner and edge detector,” Proceedings of the Fourth Alley Vision Conference, Manchester, pp. 147-151, 1988.
    [21] I. Daubechies, Ten Lectures on Wavelets, SIAM, Philadelphia, PA, 1992.
    [22] P. Viola and M. J. Jones, “Robust real-time face detection,” International Journal of Computer Vision, vol. 57, no. 2, pp. 137-154, May 2004.
    [23] Stan Z. Li, L. Zhu, ZQ Zhang, A. Blake, HJ Zhang, and H. Shum, “Statistical Learning of Multi-View Face Detection,” Proceedings of the 7th European Conference on Computer Vision, vol. 2353, pp.67-81, 2002.
    [24] K.K. Sung and T. Poggio, “Example-based learning for view-based human face detection,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 20, no. 1, pp. 39-51, 1998.
    [25] C. Papageorgiou and T. Poggio, “A Trainable System for Object Detection,” International Journal of Computer Vision, vol. 38, no. 1, pp. 15-33, 2000.
    [26] R. E. Shapire and Y. Singer, “Improving boosting algorithms using confidence-rated predictions,” Machine Learning, vol. 37, no. 3, pp. 297-336, Dec. 1999.
    [27] S. Agarwal and D. Roth, “Learning a sparse representation for object detection,” Proceedings of the European Conference on Computer Vision, vol. 4, pp. 113-130, May 2002.
    [28] Z. Zhu, H. Lu, J. Hu, and K. Uchimura, “Car detection based on multi-Cues integration,” 17th International Conference on Pattern Recognition, vol. 2, pp. 699-702, Aug. 2004.
    [29] H. Schneiderman and T. Kanade, “Object detection using the statistics of parts,” International Journal of Computer Vision, vol. 45, no. 3, pp.151-177, Feb. 2004.
    [30] Y. Park, “Shape-resolving local thresholding for object detection,” Pattern Recognition Letters, vol.22, no. 8, pp. 883-890, June 2001.
    [31] M. Bertozzi, A. Broggi, A. Fascioli, and S. Nichele, “Stereo vision-based vehicle detection,” IEEE Intelligent vehicle symposium, pp. 39-44, Oct. 2000.
    [32] M. Bénallal and J. Meunier, “Real-time color segmentation of road signs,” Proceedings of IEEE Conference on Electrical and Computer Engineering, vol. 3, pp.1823–1826, May 2003.
    [33] A. de la Escalera, L. E. Moreno, M. A. Salichs, and José María Armingol, “Road traffic sign detection and classification,” IEEE Transactions on Industrial Electronics, vol. 44, no. 6, pp.848- 859, Dec.1997.
    [34] C. Y. Fang, S. W. Chen, and C. S. Fuh, “Road-sign detection and tracking,” IEEE Transactions on Vehicular Technology, vol. 52, no.5, pp.1329-1341, Sep. 2003.
    [35] A. D. L. Escalera, J. Armingol, and M. Mata, “Traffic sign recognition and analysis for intelligent vehicles,” Image and Vision Computing, vol. 21, pp. 247-258, 2003.
    [36] N. Kehtarnavaz and A, Ahmad, “Traffic sign recognition in noisy outdoor scenes,” Proceedings of Intelligent Vehicles ''95 Symposium, pp.460-465, Sep. 1995.
    [37] S. Vitabile, G. Pollaccia, G. Pilato, and E. Sorbello, “Road signs recognition using a dynamic pixel aggregation technique in the HSV color space,” Proceedings of IEEE International Conference on Image Analysis and Processing, pp.572 – 577. Sep. 2001.
    [38] X. Chen, J. Yang, J. Zhang, and A. Waibel, “Automatic detection and recognition of signs from natural scenes,” IEEE Transactions on Image Processing, vol. 13, no. 1, pp.87–99, 2004.
    [39] J. Miura, T. Kanda, and Y. Shirai, “An active vision system for real-time traffic sign recognition,” Proceedings of IEEE International Conference on Intelligent Transportation Systems, pp. 52-57, Dearborn, MI, Oct. 2000.
    [40] M. Kirby and L. Sirovich, “Application of the Karhunen-Loeve procedure for the characterization of human faces,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 12, no. 1, pp. 103-108, 1990.
    [41] G. Healey, “Segmenting images using normalized color,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 22, no.1, pp. 64-73, 1992.
    [42] Luo-Wei Tsai, Jun-Wei Hsieh, and Kao-Chin Fan, “Vehicle detection using normalized color and edge map,” IEEE Transactions on Image Processing, vol. 16, no. 3, pp.850-864, Mar. 2007.
    [43] W. Wu, X. Chen, and J. Yang, “Detection of text on road signs from video,” IEEE Transactions on Intelligent Transportation Systems, vol. 6, no. 4, pp. 378- 390, Dec. 2005.
    [44] N. Barnes and A. Zelinsky, “Real-time radial symmetry for speed sign detection,” Proceedings IEEE Intelligent Vehicles Symposium, Italy, pp. 566- 571, June 2004.
    [45] G Piccioli, E De Micheli, P Parodi, and M Campani, “Robust method for road sign detection and recognition,” Image and Vision Computing, vol.14, no. 4, pp.209-223, 1996.
    [46] E. D. Haritaoglu and I. Haritaoglu, “Real time image enhancement and segmentation for sign/text detection,” Proceedings of the 2003 IEEE Int. Conf. Image Processing, Barcelona, Spain, pp. 993–996, 2003.
    [47] C. Bahimann, Y. Zhu, V. Ramesh, M. Pellkofer, and T. Koehler “A system for traffic sign detection, tracking, and recognition using color, shape, and motion information,” Proceedings of IEEE Intelligent Vehicles Symposium, pp.255-260, June 2005.
    [48] M. D. S. Blancard, “Road sign recognition: a study of vision-based decision making for road environment recognition,” in I. Masaki (ed.), Vision-based Vehicle Guidance, Springer-Verlag, Berlin, pp. 162- 172, 1992.
    [49] J. Canny, “A computational approach to edge detection,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 8, no. 6, pp. 679-698, Nov. 1986.
    [50] J.-W. Hsieh, “Fast stitching algorithm for moving object detection and mosaic construction,” Image Vision and Computing Journal, vol. 22, no. 4, pp. 291-306, April 2004.
    [51] M. Sonka, V. Hlavac, and R. Boyle, “Image Processing, Analysis and Machine vision,” Brooks/Cole Publishing Company, 1999.
    [52] H. Fleyeh, “Color detection and segmentation for road and traffic signs,” IEEE Conference on Cybernetics and Intelligent Systems, vol. 2, pp.809-814, 2004.
    [53] S. Vitabile, A. Gentile, S. M. Siniscalchi, and F. Sorbello, “Efficient rapid prototyping of image and video processing algorithms,” Euromicro Symposium on Digital System Design, pp.452-458, 2004.
    [54] A. de la Escalera, J. M. Armingol, J. M. Pastor, and F. J. Rodriguez, “Visual sign information extraction and identification by deformable models for intelligent vehicles,” IEEE Transactions on Intelligent Transportation Systems, vol. 5, pp.57-68, 2004.
    [55] M. A. Garcia-Garrido, M. A.Sotelo, and E. Martin-Gorostiza, “Fast traffic sign detection and recognition under changing lighting conditions,” Proceedings of the IEEE Conference on Intelligent Transportation Systems, pp.811-816, 2006.
    [56] M. CE, “Basic principles of ROC analysis,” Seminars in Nuclear Medicine, vol.8, pp.283-298, 1978.
    [57] M. H. Zweig and G. Campbell, “Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine,” Clinical Chemistry, vol. 39, pp. 561-577, 1993.
    [58] JULIUS T. Tou, and RAFAEL C. GONALEZ, Pattern recognition principles, Addison-Wesley Publishing Company, 1974.

    QR CODE
    :::