人臉辨識 (face recognition) 與人臉偵測 (face detection) 技術被廣泛地應用在各種實務系統上，像是門禁系統、監控系統、身分認證的登入系統等。然而，人臉辨識的辨識率常常受到許多因素影響，包含光照環境的不同、表情的不同、臉部旋轉、及有遮蔽物的情形等。因此，我們針對帶眼鏡的議題，提出眼鏡去除的方法，希望能提高人臉辨識系統的辨識率。
眼鏡去除系統主要包含三個部分，人臉偵測、眼鏡偵測、及眼鏡去除。首先，利用膚色偵測與 Adaboost 偵測從影像中找出人臉區塊。接著，再根據眼鏡的特性，從膚色二值化影像、與邊偵測二值化影像，定位出眼鏡區域，並參考主成份分析法 (PCA) 重建影像將五官部分去除。最後，我們以 PCA 重建影像為參考影像，將其膚色部分的平均數與標準差與戴眼鏡影像膚色部分的平均數與標準差做顏色的對應調整，之後，將眼鏡部分以調整後的 PCA 重建影像中對應位置的膚色填補，再以兩張影像的差異值做細部調整，以及邊界平滑化，產生眼鏡去除後的影像。
在眼鏡去除的應用上，我們找了兩種人臉辨識方法做實驗測試，分別針對無戴眼鏡影像、戴眼鏡影像、與眼鏡去除影像進行人臉辨識率的分析。在實驗中，可以發現戴眼鏡影像是會影響辨識系統的辨識率的，而針對戴眼鏡的人臉影像，在臉部辨識前，先去除眼鏡，再辨識人臉，也是可以提高臉部辨識率，減少受到眼鏡的影響。

Face recognition and face detection techniques are widely used in various applications, such as access control systems, surveillance system, login system, etc. However, there are some factors that affect the recognition performance like different lighting conditions, expression, size, and occlusion by other objects. In this thesis, we propose an eyeglasses removal method to generate a naturally looking glassless facial image to improve the face recognition rate.
The proposed system consists of three modules: face detection, eyeglasses detection, and eyeglasses removal. First, we detect the face regions by skin color and Adaboost detection. Second, we use skin color and edge data to detect the eyeglasses region. Finally, we generate an eyeglasses- removal facial image by PCA reconstruction method and color correction strategy.
After all, we combine the eyeglasses removal system to face recognition system, for face recognition result of the images of face without eyeglasses, with eyeglasses, and eyeglasses removal. We can find that the proposed method can improve the recognition rate for overall face recognition system.

[1] Andrew, A. M., "Another efficient algorithm for convex hulls in two dimensions," Information Processing Letters, vol.9, no.5, pp.216-219, 1979.
[2] Bay, H., A. Ess, T. Tuytelaars, and L. V. Gool, "SURF: speeded up robust features," Computer Vision and Image Understanding, vol.110, no.3, pp.346-359, 2008.
[3] Belhumeur, P. N., J. P. Hespanha, and D. J. Kriegman, "Eigenfaces vs. Fisherfaces: recognition using class specific linear projection," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol.19, no.7, pp.711-720, 1997.
[4] Cootes, T. F., C. J. Taylor, D. H. Cooper, and J. Graham, "Active Shape Models-Their Training and Application," Computer Vision and Image Understanding, vol.61, pp.38-59, 1995.
[5] Dreuw, P., Steingrube, P., Hanselmann, H. and Ney, H., "SURF-face: face recognition under viewpoint consistency constraints," in Proc. British Machine Vision Conf., London, UK, Sep.7-10, 2009.
[6] Du, C. and G. Su, "Eyeglasses removal from facial images," Pattern Recogn. Lett., vol.26, no.14, pp.2215-2220, 2005.
[7] Garcia, C. and G. Tziritas, "Face detection using quantized skin color regions merging and wavelet packet analysis," IEEE Trans. on Multimedia, vol.1, no.3, pp.264-277, 1999.
[8] Geetha, A., V. Ramalingam, S. Palanivel, and B. Palaniappan, "Facial expression recognition - A real time approach," Expert Systems with Applications, vol.36, no.1, pp.303-308, 2009.
[9] Hjelmås, E. and B. K. Low, "Face Detection: A Survey," Computer Vision and Image Understanding, vol.83, no.3, pp.236-274, 2001.
[10] Horng, W.-B., C.-Y. Chen, Y. Chang, and C.-H. Fan, "Driver fatigue detection based on eye tracking and dynamic template matching," in Proc. IEEE Intl. Conf. on Networking, Sensing and Cont., Taipei, Taiwan, Mar.21-23, 2004, pp.7-12.
[11] Jiang, X., M. Binkert, B. Achermann, and H. Bunke, "Towards detection of glasses in facial images," in Proc. 14th Int. Conf. on Pattern Recognition, Brisbane, Australia, Aug.16-20, 1998, vol.2, pp.1071-1073.
[12] Jing, Z. and R. Mariani, "Glasses detection and extraction by deformable contour," in Proc. 15th Int. Conf. on Pattern Recognition, Barcelona, Spain, Sep.3-8, 2000, pp.933-936.
[13] Kelly, M. D., "Visual Identification of People by Computer," Tech. rep. AI-130, Stanford AI Project, Stanford, CA,1971.
[14] Leung, T. K., M. C. Burl, and P. Perona, "Finding faces in cluttered scenes using random labeled graph matching," in Proc. Fifth Int. Conf. on Computer Vision, Cambridge, Massachusetts, Jun.20-23, 1995, pp.637-644.
[15] Li, S. Z. and A. K. Jain, eds., Handbook of Face Recognition, Springer, 2005.
[16] Lienhart, R. and J. Maydt, "An extended set of Haar-like features for rapid object detection," IEEE Int. Conf. on Image Processing, vol.1, pp.900-903, 2002.
[17] Meynet, J., V. Popovici, and J.-P. Thiran, "Face detection with boosted Gaussian features," Pattern Recognition, vol.40, no.8, pp.2283-2291, 2007.
[18] Nefian, A. V. and M. H. Hayes, III, "Hidden Markov models for face recognition," in Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing, Seattle, Washington, May 12-15, 1998, vol.5, pp.2721-2724.
[19] Okada, K., J. Steffens, T. Maurer, H. Hong, E. Elagin, H. Neven, and C. v. d. Malsburg, "The Bochum/USC face recognition system and how it fared in the FERET phase III test," in Face Recognition: From Theory to Applications, H. Wechsler, P. J. Phillips, V. Bruce, F. Fogeman Saulie, and T. S. Huang, ed. , Springer Verlag, 1998, pp.186-205.
[20] Park, J.-S., Y. H. Oh, S. C. Ahn, and S.-W. Lee, "Glasses removal from facial image using recursive PCA reconstruction," Lecture Notes on Computer Science 2688, pp.369-376, 2003.
[21] Park, J.-S., Y. H. Oh, S. C. Ahn, and S.-W. Lee, "Glasses removal from facial image using recursive error compensation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol.27, no.5, pp.805-811, 2005.
[22] Reinhard, E., M. Adhikhmin, B. Gooch, and P. Shirley, "Color transfer between images," IEEE Computer Graphics and Applications, vol.21, no.5, pp.34-41, 2001.
[23] Saito, Y., Y. Kenmochi, and K. Kotani, "Estimation of eyeglassless facial images using principal component analysis," in Proc. Int. Conf. on Image Processing, Kobe, Japan, Oct.24-28, 1999, vol.4, pp.197-201.
[24] Tan, X., S. Chen, Z.-H. Zhou, and F. Zhang, "Face recognition from a single image per person: A survey," Pattern Recognition, vol.39, no.9, pp.1725-1745, 2006.
[25] Turk, M. A. and A. P. Pentland, "Face recognition using eigenfaces," in Proc. IEEE Conf. on Computer Vision and Pattern Recognition, Maui, Hawaii, Jun.3-6, 1991, pp.586-591.
[26] Viola, P. and M. Jones, "Rapid object detection using a boosted cascade of simple features," in Proc. IEEE Conf. on Computer Vision and Pattern Recognition, Cambridge, Massachusetts, 2001, vol.1, pp.I-511-I-518.
[27] Viola, P. and M. J. Jones, "Robust real-time face detection," Int. Journal of Computer Vision, vol.57, no.2, pp.137-154, 2004.
[28] Wang, S.-W., Automatic Eye Detection and Glasses Removal, Master Thesis, Elect. Eng. Dept., Univ of Chiao Tung, Taiwan, June, 2004.
[29] Wu, C., C. Liu, H.-Y. Shum, Y.-Q. Xu, and Z. Zhang, "Automatic eyeglasses removal from face images," in Proc. 5th Asian Conf. on Computer Vision, Melbourne, Australia, Jan.23-25, 2002, pp.1-6.
[30] Wu, C., C. Liu, H.-Y. Shum, Y.-Q. Xu, and Z. Zhang, "Automatic eyeglasses removal from face images," IEEE Trans. Pattern Anal. Mach. Intell., vol.26, no.3, pp.322-336, 2004.
[31] Yang, M.-H., D. J. Kriegman, and N. Ahuja, "Detecting faces in images: a survey," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol.24, no.1, pp.34-58, 2002.
[32] Zhao, W., R. Chellappa, P. J. Phillips, and A. Rosenfeld, "Face recognition: A literature survey," ACM Comput. Surv., vol.35, no.4, pp.399-458, 2003.