| 研究生: |
吳建宇 Jian-Yu Wu |
|---|---|
| 論文名稱: |
以學生具身沉浸與具身辨識達成具身認知學習以提升學習成效 Using Embodied Immersion and Embodied Recognition by students to enhance learning outcome through Embodied Cognition learning |
| 指導教授: |
陳國棟
Gwo-Dong Chen |
| 口試委員: | |
| 學位類別: |
碩士 Master |
| 系所名稱: |
資訊電機學院 - 資訊工程學系 Department of Computer Science & Information Engineering |
| 論文出版年: | 2023 |
| 畢業學年度: | 111 |
| 語文別: | 中文 |
| 論文頁數: | 110 |
| 中文關鍵詞: | 情境認知 、數位實境 、具身認知 、具身學習 、具身辨識 、數位雙生 、數位自我 、沉浸感 |
| 外文關鍵詞: | Situated Cognitive, Virtual Reality, Embodied cognitive, Embodied learning, Human Activity Recognition, Digital Twin, Digital self, Immersion |
| 相關次數: | 點閱:10 下載:0 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
在過去的傳統教學當中,通常以口語和紙本教導學生知識內容,然而某些特定的知識,需要透過學生具身行為來理解教學內容,加強學習體驗,讓學生透過自身感官和運動行為進行學習,而情境認知強調使用者在符合的情境學習,透過在情境中的認知感受獲得相關經驗,隨著資訊科技發達,為了改善過去情境學習在現實實行的困難性,研究開始以數位實境的方式實現,包括以虛擬化身代替使用者進入情境、透過頭戴式裝置讓學習者以自身視角進入到情境中,但這些方式缺乏讓使用者在過程中看到自己沉浸在數位情境中的結果,並無法將學習展示給教師和其他學習者進行評量和觀摩。
本研究在數位雙生劇場上,建立具身沉浸與具身辨識的學習系統,提供學習者置身融入數位實境的學習,並透過ZED 2i,擷取現實學生的具身表現,建立使用者的數位雙生,並根據數位雙生的身體感知和運動行為進行回應,顯示與周圍環境的關係,達成具身認知學習提升學習成效,研究結果顯示,與一般數位實境並藉由老師教導的系統相比,透過本研究系統可以在數位情境中有具身沉浸和認知感受的體驗,可以幫助學生在學習成績上有比較顯著的提升,此外透過問卷及訪談結果也顯示,學生對於自身行為與系統互動的學習模式有正向的回饋。
In the traditional learning, usually use verbal and paper-based method to teach students knowledge. However, some specific knowledge requires students to engage in embodied actions to comprehend the knowledge they learn and let students learn through their sensor and motor. Situated cognition emphasizes that learners acquire relevant experiences through learning in contextually appropriate situations. Due to technological advancements and the need to address challenges in implementing situational environments in the real world, researchers have started utilizing digital reality as an alternative to real-space implementation. Some use avatar to replace users enter the digital space or using head-mounted devices allow user experience the situation in the first-person perspective. However, with these approaches users cannot see themselves immersed in the digital environment during the learning process and they also cannot observe how they impact the digital space by their own interactive with the digital situation environment, at the same time, other students cannot see their performance for observe.
In this study, we have devised an immersive embodied recognition system within the digital twin theater. This system enables students to fully engage within a digital reality space, thereby presenting their digital selves throughout the learning journey. The system leverages data from the ZED 2i sensor to capture students' bodily movements and spoken content from the physical world. This information is then seamlessly integrated into the virtual realm, constructing a personalized digital representation of the students themselves. Thus, students can observe their impact to the digital world cause by their embodied behaviors. According to the research results, students who used our system showed significant improvements in learning outcomes compared to traditional situated learning systems through embodied cognitive learning. In addition, according to questionnaire and interview result, students provide positive feedback to the learning method with our system and identify interactive with their own behavior with the system have contribute to their learning.
胡立綸. (2021). 設計與製作一個易於持續演進之數位學習劇場軟體架構 國立中央大學資訊工程學系學位論文.
黃招憲、許惠端、王靖絜 (2010) 餐旅日文(下)。致良出版社
Activity recognition. (2023, May 8). In Wikipedia, Retrieved from https://en.wikipedia.org/wiki/Activity_recognition
Anderson, J. R., Greeno, J. G., Reder, L. M., & Simon, H. A. (2000). Perspectives on learning, thinking, and activity. Educational Researcher, 29(4), 11-13.
Barsalou, L. W. (2008). Grounded cognition. Annu. Rev. Psychol., 59, 617-645.
Bora, S. F. (2022). Drama pedagogy in foreign language learning: investigating the impact of theatre texts and theatre performance on L2 speaking accuracy and complexity. Research in Drama Education: The Journal of Applied Theatre and Performance, 27(4), 507-523.
Brown, J. S., Collins, A., & Duguid, P. (1989). Situated cognition and the culture of learning. 1989, 18(1), 32-42.
Bujak, K. R., Radu, I., Catrambone, R., MacIntyre, B., Zheng, R., & Golubski, G. (2013). A psychological perspective on augmented reality in the mathematics classroom. Computers & Education, 68, 536-544.
Chiou, Y. M. (2019, March). Multi-party mixed reality interaction for earth sciences education. In Proceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction (pp. 719-722).
Culbertson, J., & Kirby, S. (2016). Simplicity and specificity in language: Domain-general biases have domain-specific effects. Frontiers in psychology, 6, 1964.
De Lucia, A., Francese, R., Passero, I., & Tortora, G. (2009). Development and evaluation of a virtual campus on Second Life: The case of SecondDMI. Computers & Education, 52(1), 220-233.
Dede, C. (2009). Immersive interfaces for engagement and learning. science, 323(5910), 66-69.
Digital Twin. (2023, July 23). In Wikipedia, Retrieved from https://en.wikipedia.org/wiki/Digital_twin
Dourish, P. (2001). Where the action is: the foundations of embodied interaction. MIT press.
Embodied cognition. (2023, July 29). In Wikipedia, Retrieved from https://en.wikipedia.org/wiki/Embodied_cognition
Eriksson, K., Alsaleh, A., Behzad Far, S., & Stjern, D. (2022). Applying Digital Twin Technology in Higher Education: An Automation Line Case Study. Adv. Transdiscipl. Eng, 21, 461-472.
Freina, L., & Ott, M. (2015, April). A literature review on immersive virtual reality in education: state of the art and perspectives. In The international scientific conference elearning and software for education (Vol. 1, No. 133, pp. 10-1007).
George, D. (2011). SPSS for windows step by step: A simple study guide and reference, 17.0 update, 10/e. Pearson Education India.
Glenberg, A. M. (2010). Embodiment as a unifying perspective for psychology. Wiley interdisciplinary reviews: Cognitive science, 1(4), 586-596.
Grieves, M., & Vickers, J. (2017). Digital twin: Mitigating unpredictable, undesirable emergent behavior in complex systems. Transdisciplinary perspectives on complex systems: New findings and approaches, 85-113.
Hu-Au, E., & Lee, J. J. (2017). Virtual reality in education: a tool for learning in the experience age. International Journal of Innovation in Education, 4(4), 215-226.
Hulse, B., & Owens, A. (2019). Process drama as a tool for teaching modern languages: supporting the development of creativity and innovation in early professional practice. Innovation in Language Learning and Teaching, 13(1), 17-30.
Immersion (virtual reality). (2023, August 7). In Wikipedia, Retrieved from https://en.wikipedia.org/wiki/Immersion_(virtual_reality)
Kosmas, P., Ioannou, A., & Zaphiris, P. (2019). Implementing embodied learning in the classroom: Effects on children’s memory and language skills. Educational Media International, 56(1), 59-74.
Kwon, C. (2019). Verification of the possibility and effectiveness of experiential learning using HMD-based immersive VR technologies. Virtual Reality, 23(1), 101-118.
Lan, Y. J. (2015). Contextual EFL learning in a 3D virtual environment.
Lan, Y. J., Hsiao, I. Y., & Shih, M. F. (2018). Effective learning design of game-based 3D virtual language learning environments for special education students. Journal of Educational Technology & Society, 21(3), 213-227.
Lanier, J. (2001). Virtually there. Scientific American, 284(4), 66-75.
Li, Y., Yang, Y., Yao, Z., & Xu, G. (2020). Virtual 3D environment for exploring the spatial ability of students. Virtual Reality & Intelligent Hardware, 2(6), 556-568.
Lindgren, R., & Johnson-Glenberg, M. (2013). Emboldened by embodiment: Six precepts for research on embodied learning and mixed reality. Educational researcher, 42(8), 445-452.
Lindgren, R., Tscholl, M., Wang, S., & Johnson, E. (2016). Enhancing learning and engagement through embodied interaction within a mixed reality simulation. Computers & Education, 95, 174-187.
Liu, R., Wang, L., Lei, J., Wang, Q., & Ren, Y. (2020). Effects of an immersive virtual reality‐based classroom on students’ learning performance in science lessons. British Journal of Educational Technology, 51(6), 2034-2049.
Liu, Y., Zhang, L., Yang, Y., Zhou, L., Ren, L., Wang, F., Liu, R., Pang, Z., & Deen, M. J. (2019). A novel cloud-based framework for the elderly healthcare services using digital twin. IEEE access, 7, 49088-49101.
Makransky, G., & Petersen, G. B. (2021). The cognitive affective model of immersive learning (CAMIL): A theoretical research-based model of learning in immersive virtual reality. Educational Psychology Review, 1-22.
Niedenthal, P. M., Barsalou, L. W., Winkielman, P., Krauth-Gruber, S., & Ric, F. (2005). Embodiment in attitudes, social perception, and emotion. Personality and social psychology review, 9(3), 184-211.
Paladini, A., Dhanda, A., Reina Ortiz, M., Weigert, A., Nofal, E., Min, A., ... & Santana Quintero, M. (2019). Impact of virtual reality experience on accessibility of cultural heritage. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 42(W11), 929-936.
Pintrich, P., Smith, D., Garcia, T., & McKeachie, W. (1991). A manual for the use of the motivated strategies for learning Questionnaire (MSLQ)
Rolle, R., Martucci, V., & Godoy, E. (2020). Architecture for Digital Twin implementation focusing on Industry 4.0. IEEE Latin America Transactions, 18(05), 889-898.
Schrotter, G., & Hürzeler, C. (2020). The digital twin of the city of Zurich for urban planning. PFG–Journal of Photogrammetry, Remote Sensing and Geoinformation Science, 88(1), 99-112.
Shapiro, L., & Stolz, S. A. (2019). Embodied cognition and its significance for education. Theory and Research in Education, 17(1), 19-39.
Shapiro, Lawrence & Spaulding, Shannon (2021) Embodied Cognition In E. N. Zalta (Ed.), The Stanford encyclopedia of philosophy (Fall 2020 ed.). Stanford University (Fall 2020 ed.). https://plato.stanford.edu/entries/embodied-cognition/
Situated cognition. (2023, April 19). In Wikipedia, Retrieved from https://en.wikipedia.org/wiki/Situated_cognition
Stolz, S. A. (2015). Embodied learning. Educational philosophy and theory, 47(5), 474-487.
Sugiura, A., Kitama, T., Toyoura, M., & Mao, X. (2019). The use of augmented reality technology in medical specimen museum tours. Anatomical sciences education, 12(5), 561-571.
Tao, F., Zhang, H., Liu, A., & Nee, A. Y. (2018). Digital twin in industry: State-of-the-art. IEEE Transactions on industrial informatics, 15(4), 2405-2415.
Virtual Reality. (2023, August 7). In Wikipedia, Retrieved from https://en.wikipedia.org/wiki/Virtual_reality
Wilson, M. (2002). Six views of embodied cognition. Psychonomic bulletin & review, 9, 625-636.
Wolf, E., Klüber, S., Zimmerer, C., Lugrin, J. L., & Latoschik, M. E. (2019, October). ” Paint that object yellow”: Multimodal Interaction to Enhance Creativity During Design Tasks in VR. In 2019 International Conference on Multimodal Interaction (pp. 195-204).
Wornyo, A. A., Klu, E. K., & Motlhaka, H. (2018). Authentic learning: Enhancing learners’ academic literacy skills. International Journal of Applied Linguistics and English Literature, 7(4), 56-62.
Wu, W. Y., Luo, Y. F., Huang, D. Y., Huang, C. W., Peng, Y. I., & Chen, G. D. (2015). A Self-Observable Learning Cinema in the Classroom. In The 23rd International Conference on Computers in Education (pp. 257-262).
Xiao, W. Y., Duan, J. Z., & Xue, C. Q. (2020, August). Research on visual programming system of gesture interaction interface in VR. In Proceedings of the 2020 4th International Conference on Big Data and Internet of Things (pp. 38-42).
Xie, M. X., Wu, Y. W., Chen, G. D., Wang, J. H., & Yang, S. H. (2022, July). An immersive situational group learning system with body movement and emotion recognition combined with subject knowledge. In 2022 International Conference on Advanced Learning Technologies (ICALT) (pp. 292-296). IEEE.
Yee, N., Bailenson, J. N., & Ducheneaut, N. (2009). The Proteus effect: Implications of transformed digital self-representation on online and offline behavior. Communication Research, 36(2), 285-312.
Zhao, S. (2005). The digital self: Through the looking glass of telecopresent others. Symbolic interaction, 28(3), 387-405.