本論文設計了兩個應用Kinect於英語互動學習的系統，第一個系統是擴增實境 (Augmented Reality) 系統，輔助老師的英語單字教學。本系統經由 Kinect 來抓取人體停止、前進、後退、左轉以及右轉的姿勢，透過無線射頻傳送指令到自走車，讓自走車行走於虛擬的英語拼單字遊戲板上，藉此學習英文單字，並且能夠讓孩童藉由遊戲來互相切磋比較，進而互相討論與學習，讓孩童能夠寓教於樂。本系統還藉由直覺化的操作，讓自走車控制能夠更符合人性。
第二個系統是機器人互動學習系統，希望藉由本系統來輔助老師上課時使用全肢體反應教學法(Total Physical Response)來教學。本系統由 Kinect 抓取人體的骨架資訊，透過動態時間校正 (Dynamic Time Warping, DTW) 或是隱藏式馬可夫模型 (Hidden Markov Model, HMM) 來判斷做的動作是否正確。本系統提供老師方便上課教學的編輯介面，並且可以讓學生透過老師的幫助，自行使用本系統讓學生能夠自行探索動作和英語的意義，藉由肢體動作以及口語表達出正確的英文語意，並且輔以機器人來互動學習，讓學習是由真實的口語以及動作來輔助學生學習英文的意義並非單純的填鴨式學習。

This thesis designed two applications on Kinect interactive English learning system; the first system is Augmented Reality system, aim to assist teachers in English vocabulary teaching. This system catch skeleton through Kinect for stop, forward, backward, turn left and right, through RF transmission commend to the cars. Cars can drive in virtual English word games to help student learn English words, and allows children to learn from each other by game, and then discuss with each other and learning so that children can be edutainment. This system also represents an intuition car control, can be more consistent with humanity.
The second system is Robot interactive learning system, to help teachers in class using the Total Physical Response. This system catch skeleton through Kinect, through Dynamic Time Warping or Hidden Markov Model to determine the action is correct or not. This system provides the teacher convenient teaching editing interface, and allows the students explore their own movements and English meaning himself. We supply the robot to interactive learning, so that learning in real-spoken language and action to assist students to learn English meaning is not simply spoon-fed learning.

[1] 黃國祐、謝莉卿，「國英雙語幼兒的詞彙學習策略和說話產生量」，朝陽人文社會學刊，民國九十四年。
[2] W. E. Merriman, “The mutual exclusivity bias in children''s world learning: A reply to Woodward and Markman,” Developmental Review, vol. 11, pp. 164-191, 1991.
[3] 中華民國教育部 [Online] Available:
http://www.edu.tw/files/site_content/B0055/%E8%8B%B1%E8%AA%9E970526%E5%AE%9A%E7%A8%BF%EF%BC%88%E5%96%AE%E5%86%8A% EF%BC%89.pdf Jun. 10, 2012 [data accessed]
[4] R. T. Azuma, “A Survey of Augmented Reality,” Presence-Teleoperators and Virtual Environments, vol. 6, pp. 355-385, 1997.
[5] J. J. Asher, “The learning strategy of the total physical response: A review,” The Modern Language Journal, vol. 50, no. 2, pp. 79-84, 1966.
[6] 微軟Kinect for windows [Online] Available:
http://www.microsoft.com/en-us/kinectforwindows/ Jun. 10, 2012[data accessed]
[7] N. Hagbi, R. Grasset, O. Bergig, M. Billinghurst, and J. El-Sana, “In-Place Sketching for Content Authoring in Augmented Reality Games,” in Virtual Reality Conference of IEEE, pp. 91-94, 2010.
[8] C. M. Juan, G. Toffetti, F. Abad, and J. Cano, “Tangible Cubes Used as the User Interface in an Augmented Reality Game for Edutainment,” in Advanced Learning Technologies (ICALT), pp. 599-603, 2010.
[9] Y. J. Chang, C. H. Chen, W. T. Huang, and W. S. Huang, “Investigating Students'' Perceived Satisfaction, Behavioral Intention, and Effectiveness of English Learning Using Augmented Reality,” in Multimedia and Expo (ICME), pp. 1-6, 2011.
[10] Y. Z. Hsieh, M. C. Su, S. Y. Chen, G. D. Chen, and S. C. Lin, “A Robot-Based Learning Companion for Storytelling,” in Proc. of the 18th International Conference on Computers in Education, Putrajaya, Malaysia, Nov. 29-Dec. 2, 2010.
[11] J. J. Asher, “The Total Physical Response Approach to Second Language Learning,” The Modern Language Journal, vol. 53, no. 1, pp. 3-17, 1969.
[12] 江明麗，「全肢體反應教學法對國小資源班智能障礙學生英語聽說能力之教學成效」，國立臺灣師範大學特殊教育學系身心障礙特教教學碩士論文，民國九十九年。
[13] Xbox360+Kinect官方網站 [Online] Available:
http://www.xbox.com/zh-TW/kinect/ Jun. 10, 2012 [data accessed]
[14] Waybeta [Online] Available:
http://www.waybeta.com/news/58230/microsoft-kinect-somatosensory-gamedevice-full-disassembly-report-_microsoft-xbox Jun. 10, 2012 [data accessed]
[15] I. T. Chiang and J. C. Tsai, “Using Xbox 360 Kinect Games on Enhancing Visual Performance Skills on Institutionalized Older Adults with Wheelchairs,” in Digital Game and Intelligent Toy Enhanced Learning, pp. 263-267, Takamatsu, Japan, March 27-30, 2012.
[16] X. Yu, L. Wu, Q. Lin, and H. Zhou, “Children tantrum behaviour analysis based on Kinect sensor,” in Intelligent Visual Surveillance (IVS), pp. 49-52, Beijing, China, Dec. 1-2, 2011.
[17] P. Henry, M. Krainin, E. Herbst, X. Ren, and D. Fox, “RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments,” international journal of robotics research, vol. 31, no. 5, pp. 647-663, 2012.
[18] J. Tong, J. Zohu, L. Lin, Z. Pan, and H. Yan, “Scanning 3D Full Human Bodies Using Kinects,” Visualization and Computer Graphics, vol. 18, no. 4, pp. 643-650, 2012.
[19] R. Xu, S. Zhou, and W.J. Li, “MEMS Accelerometer Based Nonspecific-User
Hand Gesture Recognition,” IEEE Sensors Council, vol. 12, no .5, pp. 1166-1173, 2012.
[20] J. Y. Hwang, J.M. Kang, Y. W. Jang and H. C. Kim, “Development of novel algorithm and real-time monitoring ambulatory system using bluetooth module for fall detection in the elderly,” in Proc. of the 26th Annual International Conference of the IEEE EMBS, pp. 2204-2207, San Francisco, USA, 2004.
[21] S. Tsuruta, Y. Kawauchi, W. Choi, and K. Hachimura, “Real-Time Recognition of Body Motion for Virtual Dance Collaboration System,” in Artificial Reality and Telexistence, 17th International Conference, pp.23-30, Esbjerg, Jylland, Nov. 28-30, 2007.
[22] K. Lai, J. Konrad, and P. Ishwar, “A gesture-driven computer interface using Kinect,” in Image Analysis and Interpretation (SSIAI), pp. 185-188, Santa Fe, NM, Apr. 22-24, 2012.
[23] S. Kumari and S. K. Mitra, “Human Action Recognition Using DFT,” in Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG), pp. 239-242, Hubli, Karnataka, Dec. 15-17, 2011.
[24] AM24L01BS-U datasheet [Online] Available:
http://read.pudn.com/downloads67/doc/fileformat/241962/AM24L01BS-UDataSheet-1.pdf Jun. 10, 2012 [data accessed]
[25] nRF24L01 datasheet [Online] Available:
http://www.nordicsemi.com/eng/nordic/download_resource/8041/1/30955977&ei=vZvVT6a7L8nXmAWA1_iAAw&usg=AFQjCNHMw5UHyWyjmmjMIiKDZ_Tjod4R6Q&sig2=UfftS09xBuPKRGxJ_s08sg Jun. 10, 2012 [data accessed]
[26] Fujitsu MB9Axxx/MB9Bxxx Series [Online] Available:
http://www.fujitsu.com/downloads/CN/fss/events/contest/2010/doc/MB9Bxxx-MN706-00002-1v0-E.pdf Jun. 12, 2012 [data accessed]
[27] Fujitsu MB9B506R datasheet [Online] Available:
http://www.fujitsu.com/downloads/CN/fss/events/contest/2010/doc/MB9BF500N-DS706-00010-0v01-E.pdf Jun. 12, 2012 [data accessed]
[28] ULINK-ME Debug Adapter [Online] Available:
http://www.keil.com/ulinkme/ Jun. 12, 2012[data accessed]
[29] 伍星翰，「線性加速度感測器的研究與其應用」，國立中央大學資訊工程學系碩士論文，民國一百年。
[30] M. C. Su, G. D. Chen, Y. S. Tsai, R. H. Yao, C. K. Chou, Y. B. Jinawi, D. Y. Huang, Y. Z. Hsieh, and S. C. Lin, “Design of an Interactive Table for Mixed-Reality Learning Environments,” in 4th International Conference on E-Learning and Games, Banff, Canada, Aug. 9-11, pp. 489-494, 2009.
[31] KONDO官網 [Online] Available:
http://www.kondo-robot.com/EN/ Jun. 12, 2012 [data accessed]
[32] SSC32 [Online] Available:
http://www.lynxmotion.com/p-395-ssc-32-servo-controller.aspx Jun. 12, 2012 [data accessed]
[33] X. Hui, “Similarity search and outlier detection in time series,” Ph.D. dissertation, Fudan Univ., Shanghai, China, 2005.
[34] L. R. Rabiner, A. Rosenberg, and S. Levinsen, “Considerations in dynamic time warping algorithms for discrete word recognition,” Speech and Signal Processing, vol. 26, no. 6, pp. 575-582, 1978.
[35] HMM source [Online] Available:
http://www.pudn.com/downloads91/sourcecode/math/detail348920.html Jun. 12, 2012 [data accessed]
[36] T. T. Julius and C. G. Rafael, “Pattern Recognition Principles,” 2nd edition, Addison-Wesley Publishing Company, London, 1981.
[37] 教學方法 [Online] Available:
http://content.edu.tw/senior/english/tp_tt/teachmethod/totalphysicalresponse.htm Jun. 19, 2012[data accessed]