本論文主要是建立一套可以自動分析人臉表情的系統。研究的主要內容由三個部份所組成，包含人臉偵測（face detection）、特徵擷取（feature extraction）以及表情辨識（facial expression）。
在人臉偵測部份，主要利用膚色偵測等影像處理技術將臉部區塊從複雜背景中取出。在特徵擷取部份，主要利用唇色偵測、邊緣偵測、眼睛偵測等影像處理技術從臉部區塊中取出嘴巴、眼睛、鼻子、皺眉、抬頭紋等特徵，然後從取得的特徵中求得開口特徵值、嘴型特徵值、嘴角特徵值、皺眉特徵值與抬頭紋特徵值，作為判斷表情的依據。在表情辨識部份，本論文採用Takagi–Sugeno–Kang（TSK）模糊系統，將上述求得的特徵值分析處理後，判斷是屬於以下何種表情：驚訝、生氣、悲傷、高興、噁心及正常表情。
本論文採用自行拍攝的影像做為資料庫，並藉此資料庫來測試本系統表情辨識的成功率。最後將實驗結果進行分析與描述。

The goal of this thesis is to build a system which can analyze the facial expression. In this study, the major contents are composed of the “face detection”, “feature extraction” and “facial expression recognition”.
At the part of face detection, we use the skin detection to pick up the facial region from the complicated background. Through the technique of “lip detection”, “edge detection” and “eyes detection”, we can find out the characteristics of the degree of opening month, the shape of month, the corner of the month, the frown and the wrinkles on the forehead. However those characteristics will be regard as the factors of the facial expression recognition. Moreover this thesis can determine the facial expression by Takagi-Sugeno-Kang (TSK) fuzzy system after analyzing the characteristics. Finally the system can recognize many facial expressions such as surprise, anger, sadness, happiness, disgust and normal expression.
In order to measure the accuracy of the recognition, we establish a database with facial images and describe the experiment result in the end.

[1] C. C. Chiang, W. K. Tai, M. T. Yang, Y. T. Huang and C. J. Huang, “A novel method for detecting lips, eyes and faces in real time,” Real–Time Imaging, vol. 9, no. 4, pp. 277–287, August 2003.
[2] 林志明（楊茂村 教授指導）, 視覺式嘴唇輪廓偵測與追蹤應用於產生MPEG–4臉部動畫參數, 國立東華大學, 資訊工程學系, 碩士論文, 2006.
[3] R. L. Hsu, M. Abdel-Mottaleb, and A. K. Jain, “Face Detection in Color Images,” IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 696-706, May 2002.
[4] M. Soriano, B. Martinkauppi, S. Huovinen and M. Laaksonen, “Adaptive skin color modeling using the skin locus for selecting training pixels,” Pattern Recognition, vol. 36, no. 3, pp. 681–690, March 2003.
[5] C. Garcia and G. tzirita, “Face detection using quantized skin color region merging and wavelet packet analysis,“ IEEE Trans. on Multimedia, vol. 1, no. 3, pp. 264-277, September 1999.
[6] E. Osuna, R. Freund and F. Girosi, “ Training support vector machines : an application to face detection,“IEEE Conf. on Computer Vision and Pattern Recognition, pp. 130-136, June 1997.
[7] J. Lu., X. Yuan and T. Yahaqi , “A Method of Face Recognition Based on Fuzzy c–Means Clustering and Associated Sub–NNs,” IEEE Trans. on Neural Networks, vol. 18, no. 1, pp. 150–160, January 2007.
[8] 謝怡竹（蘇木春 教授指導）, 以光流為基礎之自動化表情辨識系統, 國立中央大學, 資訊工程研究所, 碩士論文, 2005.
[9] 蘇芳生（郭鐘榮、湯敬文 教授指導）, 人臉表情辨識系統, 國立中正大學, 通訊工程研究所, 碩士論文, 2004.
[10] G. Zhou, Y. Zhan and J. Zhang, “Facial Expression Recognition Based on Selective Feature Extraction” International Conf. on Intelligent Systems Design and Applications, vol. 2, pp. 412–417, October 2006.
[11] P. Ekman and W.V. Friesen, The Facial Action Coding System: A Technique for The Measurement of Facial Movement. San Francisco: Consulting Psychologists Press, 1978.
[12] 陳皇名（鄭士康 教授指導）, 臉部表情辨識系統–以FACS為導向, 國立臺灣大學, 電機工程學研究所, 碩士論文, 2003.
[13] Y. l. Tian, T. Kanade and J. F. Cohn, ” Evaluation of Gabor-Wavelet-Based Facial Action Unit Recognition in Image Sequences of Increasing Complexity,” IEEE International Conf. on Automatic Face and Gesture Recognition, pp. 229–234, May 2002.
[14] 吳明衛（郭淑美 教授指導）, 自動化臉部表情分析系統, 國立成功大學, 資訊工程系, 碩士論文, 2003.
[15] M. Mufti and A. Khanam, “Fuzzy Rule Based Facial Expression Recognition,” International Conf. on Computational Intelligence for Modelling, Control and Automation, pp. 57–61, November 2006.
[16] R. C. Gonzalez and R. E. Woods, Digital Image Processing, 2nd Edition, Prentice Hall, 2002.
[17] 黃文吉, C++ Builder與影像處理, 儒林圖書有限公司, 2006.
[18] 余明興、吳明哲、黃世陽、黃豐隆、紀旺松與潘能煌, Borland C++ Builder6 程式設計經典, 松崗電腦圖書資料股份有限公司, 2002.
[19] H. S. Line, L. M. Ang and K. P. Seng, “Eye Detection in Face Images,” International Conf. on Neural Networks and Brain, vol. 2, pp. 1160–1163, October 2005.
[20] N. Otsu, “A Thresholding Selection Method from Gray Level Histograms,” IEEE Transactions on Systems, Man and Cybernetics, vol. 9, pp. 62-66, 1979
[21] 陳翔傑（王文俊 教授指導）, 自動化車牌辨識系統設計, 國立中央大學, 電機工程研究所, 碩士論文, 2005.
[22] 鍾國亮, 影像處理與電腦視覺, 台灣東華書局股份有限公司, 2002.