跳到主要內容

簡易檢索 / 詳目顯示

研究生: 李重寬
Chong-Kuan Lee
論文名稱: 注音符號眼寫系統之可行性研究
A Feasibility Study of an Eye-writing System for Mandarin Phonetic Symbols
指導教授: 蔡章仁
Jang-Zern Tsai
口試委員:
學位類別: 碩士
Master
系所名稱: 資訊電機學院 - 電機工程學系
Department of Electrical Engineering
畢業學年度: 93
語文別: 中文
論文頁數: 98
中文關鍵詞: 眼動訊號漸凍症文字辨識眼電圖
外文關鍵詞: electro-oculography, Amyotrophic lateral sclerosis, eye movement, pattern recognition
相關次數: 點閱:6下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 「眼寫(Eye writing)」是本團隊所發明的一種新的溝通方法,靠偵測使用者眼球移動的特定軌跡,來辨識其所欲表達的符號。此系統可以應用於一個意識清醒卻無法正常說話或用手寫字的漸凍症(A.L.S.)、運動神經元疾病(M.N.D.)或中風等疾病患者身上。本研究以眼電圖法 (Electro-OculoGraphy, EOG)來擷取眼睛移動的軌跡,藉由量測眼睛周圍皮膚微弱的電位差,以得知眼睛移動的方向。系統將EOG訊號擷取後,經由數位訊號處理來濾除雜訊,利用串音規則策略來判斷眼動軌跡路徑,辨識出使用者所要表達的符號。系統裡共建構了60個符號,包含注音符號37個、五聲符號5個、阿拉伯數字0~9共10個符號、3個標點符號以及5個控制符號。經過8個志願者的測試,証明了本系統的可行性,並且其辨識率高達90%以上。這樣的辨識率加上本系統提供的字句編輯和語音合成功能,足以取代口語及手寫的表達方式,讓漸凍人只靠眼球轉動便能與他人溝通。本系統未來的發展,首先將擴增新符號,例如漢字、英文字母和英文單字等;另一方面,為了提高漸凍症患者的自主性以及降低其受照顧的需求,將進一步利用此眼寫方法來控制其日常生活中所需使用的設備,例如電腦、電視、電話、輪椅等。希望奠基於本眼寫方法所發展出來的一系列輔具技術,不只能降低社會和家庭照顧漸凍症一類病患的成本和心力,更有意義的是為病患帶來比以往更便利和舒適,而且更有尊嚴的生活。


    Eye-writing herein introduced is a novel language communication method wherein the eyes fill the role of a writing organ. This technology will be especially useful for severe amyotrophic lateral sclerosis (ALS) patients who have lost oral speaking and hand-writing abilities. An eye-writing system for Mandarin Phonetic Symbols detects the traces of eye movements and determines their corresponding symbols by pattern recognition. In this study, we measured the eye movements by electro-oculograophy (EOG). The electrical potential difference measured between the skins above and below the eyes reflected the eye movement in the vertical direction. That measured between the skins to the left and to the right of the eyes reflected the eye movement in the horizontal direction. We evaluated the eye-writing system with a symbol set consisting of 37 Mandarin phonetic symbols, 5 lexical-tone symbols, 10 Arabic numeral symbols, 3 punctuation marks, and 5 control symbols. The symbol set is expandable to contain new symbols. Experiments on 8 voluntary human subjects showed recognition rate is higher than 90%. Based on the result we got in the feasibility study, we envision that the system is capable of controlling computers, televisions, or wheelchairs by incorporating some control algorithms.

    中文摘要 I 英文摘要 III 致謝 IV 目錄 V 圖目錄 VII 表目錄 IX 第一章 緒論 1.1 研究動機 1 1.2 論文架構 3 第二章 研究背景 2.1 眼動原理 4 2.2 眼動訊號相關應用 6 2.3 EOG 相關應用 10 2.4 漸凍人簡介與相關輔具應用 11 2.5 研究方法 13 第三章 方法說明簡介 3.1 移動平均濾波理論 14 3.2 眼動訊號分析 17 3.3 語音訊號合成理論 20 第四章 眼動符號表達系統架構 4.1 系統硬體架構與簡介 29 4.2 眼動訊號處理流程 34 4.3 語音訊號處理流程 40 第五章 實驗結果討論與未來展望 5.1 系統測試 41 5.2 結果討論 53 5.3 結論與展望 58 參考文獻 60 附錄1 各符號之眼動軌跡訊號 64 附錄2 各符號之標準軌跡特徵值 95

    [1] 王敏智, 眼動符號表達系統之可行性研究, 碩士學位論文, 中壢: 國立中央大學電機工程研究所, 2004.
    [2] 林茂村, 解剖生理學, 新店市: 徐氏基金會, pp. 308-309, 1991.
    [3] S. I. Fox著, 林茂村 等譯, 人體生理學, 台北: 文京, pp. 258-273, 1998.
    [4] J. W. Clark, Jr., “The origin of biopotentials,” in Medical Instrumentation: Application and Design, 3rd ed., J. G. Webster, Ed. New York: John Wiley & Sons, pp. 121?182, 1998.
    [5] R. Barea, L. Boquete, M. Mazo, and E. López, “System for Assisted Mobility Using Eye Movements Based on Electrooculography,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 10, no. 4, pp. 209-218, 2002.
    [6] A. T. Duchowski, Eye Tracking Methodology: Theory and Practice, London: Springer-Verlag, pp. 55-65, 2002.
    [7] 劉文義, 以眼球電訊號控制之殘障者人機介面設計, 碩士學位論文, 台北: 國立台灣大學電機工程學研究所, 1996.
    [8] 簡志忠, 光學式瞳位追蹤器之人機介面系統研製, 碩士學位論文, 台中: 私立逢甲大學自動控制工程研究所, 1997.
    [9] C.-J. Lin, C.-H. Yang, C.-M. Yang, K.-P. Chang, “Abnormal electroretinogram and abnormal electrooculogram after lightning-induced ocular injury,” American Journal of Ophthalmology, vol. 133, no. 4, pp. 578-579, Apr. 2002.
    [10] C. F. Arndt, P. Derambure, S. Defoort-Dhellemmes, and J. C. Hache, “Outer retinal dysfunction in patients treated with vigabatrin,” Neurology, vol. 52, pp. 1201?1205, Apr. 1999.
    [11] M. Bareš, M. Brázdil, P. Kanovský, P. Jurák, P. Daniel, M. Kukleta, and I. Rektor, “The effect of apomorphine administration on smooth pursuit ocular movements in early Parkinsonian patients,” Parkinsonism and Related Disorders, vol. 9, no. 3, pp. 139?144, Jan. 2003.
    [12] F. W. Bylsma, D. X. Rasmusson, G. W. Rebok, P. M. Keyl, L. Tune, and J. Brandt, “Changes in visual fixation and saccadic eye movements in Alzheimer''s disease,” International Journal of Psychophysiology, vol. 19, no. 1, pp. 33?40, Feb. 1995.
    [13] N. Ozaki, N. E. Rosenthal, F. Myers, P. J. Schwartz, and D. A. Oren, “Effects of season on electro-oculographic ratio in winter seasonal affective disorder,” Psychiatry Research, vol. 59, no. 1-2, pp. 151?155, Nov. 1995.
    [14] R. Carniel, E. D. Pin, R. Budai, and P. Pascolo, “Identifying timescales and possible precursors of the awake to asleep transition in EOG time series,” Chaos, Solitons and Fractals, vol. 23, no. 4, pp. 1259?1266, Feb. 2005.
    [15] R. Barea, L. Boquete, M. Mazo, E. Lopez, and L. M. Bergasa, “EOG guidance of a wheelchair using neural networks,” in Proc. 15th Int. Conf. Pattern Recognition, pp. 668?671, 2000.
    [16] Y. Kim, N. Doh, Y. Youm, and W. K. Chung, “Development of human-mobile communication system using electrooculogram signals,” in Proc. 2001 IEEE/RSJ Int. Conf. Intelligent Robots and Systems, pp. 2160?2165.
    [17] J. J. Gu, M. Meng, A. Cook, and M. G. Faulkner, “A Study of Natural Eye Movement Detection and Ocular Implant Movement Control Using Processed EOG Signals,” in Proc. 2001 IEEE Int. Conf. Robotics &Automation, Korea, pp. 1555?1560.
    [18] J. J. Tecce, J. Gips, C. P. Olivieri, L. J. Pok, and M. R. Consiglio, “Eye movement control of computer functions,” International Journal of Psychophysiology, vol. 29, no. 3, pp. 319?325, Aug. 1998.
    [19] C. Armon, ALS 1996 and Beyond: New Hopes and Challenges (A manual for patients, families, and friends), Third (Year 2000) Edition, Loma Linda, CA: Loma Linda University, 1999. Available: http://www.llu.edu/llumc/neurosciences/als/index.html
    [20] 林大欽,用愛解凍-二十位漸凍勇者的生命故事, 台北: 聯經, 2005.
    [21] K. Yano, K. Ishihara, M. Makikawa, and H. Kusuoka, “Detection of eye blinking from video camera with dynamic ROI fixation,” in Proc. IEEE SMC ''99 Conf. Systems, Man, and Cybernetics, 1999, pp. 335?339.
    [22] Y. Tomita, Y. Igarashi, S. Honda, and N. Matsuo, “Electro-oculography mouse for amyotrophic lateral sclerosis patients,” in Proc. 18th Annual Int. Conf. IEEE Engineering in Medicine and Biology Society, 1996, pp. 1780?1781.
    [23] T. Maehara, A. Uchibori, Y. Mizukami, Y. Wakasa, and K. Tanaka, “A communication system for ALS patients using eye-direction,” in Conf. Rec. IEEE EMBS Asian-Pacific Conf. Biomedical Engineering, 2003, pp. 274?275.
    [24] R. M. Rangayyan, Biomedical Signal Analysis: A Case-Study Approach, New York, NY: Wiley Interscience, pp. 99-108, 2002.
    [25] 王小川, 語音訊號處理, 台北: 全華, 2004.
    [26] 朱立平, 語音合成器之晶片設計, 碩士學位論文, 台南: 國立成功大學電機工程研究所, 2002.
    [27] 林政源, 國語歌曲的合成與實作, 碩士學位論文, 新竹: 國立清華大學資訊工程研究所, 2001.
    [28] 德州儀器公司網頁, http://www-s.ti.com/sc/ds/ina128.pdf
    [29] 國家儀器公司網頁, http://www.ni.com/

    QR CODE
    :::