| 研究生: |
林孟衡 Meng-Heng Lin |
|---|---|
| 論文名稱: |
可融入使用者與實體物件之數位雙生實境學習系統 An Interactive Digital Twin Augmented Reality Learning System Integrating Users and Physical Objects |
| 指導教授: |
陳國棟
Gwo-Dong Chen |
| 口試委員: | |
| 學位類別: |
碩士 Master |
| 系所名稱: |
資訊電機學院 - 資訊工程學系 Department of Computer Science & Information Engineering |
| 論文出版年: | 2023 |
| 畢業學年度: | 111 |
| 語文別: | 中文 |
| 論文頁數: | 113 |
| 中文關鍵詞: | 情境認知 、具身認知 、具身互動 、具身學習 、虛擬實境 、擴增實境 、混合實境 、實體用戶介面 、數位雙生 |
| 外文關鍵詞: | Situational Cognition, Embodied Cognition, Embodied Interaction, Embodied Learning, Virtual reality, Augmented Reality, Mixed reality, Tangible User Interface, Digital Twin |
| 相關次數: | 點閱:10 下載:0 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
在傳統的教學方法中,教師大多以紙本的方式教授知識,造成學生無法將知識運用在真實情境之中,為了讓學習者學以致用,情境學習強調學習者應將學習內容和情境相結合,讓學習者在應用環境中實踐知識與技能。為了將真實情境帶入至一般教室中,有研究開始使用虛擬實境與擴增實境的技術打造數位的情境學習系統。然而,現階段的情境學習系統大多透過滑鼠或其他控制器在數位實境中操作虛擬替身與虛擬物件互動,缺乏以真實物件互動的學習方式,導致學習者的感知與動作無法在數位實境中如實呈現。
因此,本研究設計了一款可融入使用者與實體物件之數位雙生實境學習系統,藉由立體視覺相機將使用者與周遭實體環境放入數位實境之中。教師可以透過編輯系統將課本內容轉換成情境教材,讓學生以操作實體物件的方式在數位情境中學習相關知識。實驗結果顯示,操作實體物件的學習模式可以有效提升學習者的學習成效,而在問卷與訪談的部分,則顯示結合物件追蹤與數位雙生設計的情境學習系統在學習動機、任務價值與自我表現上皆有正面影響。
In traditional teaching methods, teachers often deliver knowledge through paper-based materials, which limits students' ability to apply knowledge in real-world contexts. To promote practical application of learning, context-based learning emphasizes the integration of learning content with real-world situations, allowing learners to apply knowledge and skills in authentic environments. To bring real-world contexts into conventional classrooms, researchers have started developing digital context-based learning systems using virtual reality (Ahuja et al.) and augmented reality (AR) technologies. However, existing context-based learning systems primarily rely on mouse or other controllers to interact with virtual avatars and objects in digital environments, lacking interaction with physical objects, resulting in a weaker connection between learners and applied contexts.
Therefore, this study designs a digital twin augmented reality learning system that incorporates users and physical objects. Through stereo vision cameras, users and their surrounding physical environments are merged into the digital environment. Teachers can convert textbook content into contextual teaching materials using the editing system, enabling students to learn relevant knowledge by interacting with physical objects in the digital context. Experimental results demonstrate that the learning mode involving physical object manipulation effectively enhances learners' learning outcomes. Questionnaire and interview data further indicate that the context-based learning system, integrating object tracking and digital twin design, positively impacts learners' motivation, task value, and self-performance.
胡立綸 (2021)。 設計與製作一個易於持續演進之數位學習劇場軟體架構。 國立中央大學資訊工程學系學位論文。
黃招憲、郭德信、王淑麗 (2005)。餐旅日語(上)。致良出版社。
黃招憲、許惠端、王靖絜 (2010)。餐旅日語(下)。致良出版社。
Ahuja, K., Shah, D., Pareddy, S., Xhakaj, F., Ogan, A., Agarwal, Y., & Harrison, C. (2021). Classroom digital twins with instrumentation-free gaze tracking. Proceedings of the 2021 chi conference on human factors in computing systems,
Bacca Acosta, J. L., Baldiris Navarro, S. M., Fabregat Gesa, R., & Graf, S. (2014). Augmented reality trends in education: a systematic review of research and applications. Journal of Educational Technology and Society, 2014, vol. 17, núm. 4, p. 133-149.
Billinghurst, M. (2002). Augmented reality in education. New horizons for learning, 12(5), 1-5.
Bregler, C. (2007). Motion capture technology for entertainment [in the spotlight]. IEEE Signal Processing Magazine, 24(6), 160-158.
Brown, J. S., Collins, A., & Duguid, P. (1989). Situated cognition and the culture of learning. 1989, 18(1), 32-42.
Brundiers, K., Wiek, A., & Redman, C. L. (2010). Real‐world learning opportunities in sustainability: from classroom into the real world. International Journal of Sustainability in Higher Education.
Chang, W. Y. (2010). Taiwanese Elementary Students' Motivation and Attitudes toward Learning English in English Village Program in Kaohsiung County. ERIC.
Chiang, P.-Y., Lee, C.-H., Lin, S.-H., Fan, C.-Y., Chen, Y.-H., & Chen, G.-D. (2018). A Situational Comic Play Drama Learning System to Enhance Students’ Learning Motivation. EdMedia+ Innovate Learning,
Choi, J.-I., & Hannafin, M. (1995). Situated cognition and learning environments: Roles, structures, and implications for design. Educational technology research and development, 53-69.
Choi, S. H., Park, K.-B., Roh, D. H., Lee, J. Y., Mohammed, M., Ghasemi, Y., & Jeong, H. (2022). An integrated mixed reality system for safety-aware human-robot collaboration using deep learning and digital twin generation. Robotics and Computer-Integrated Manufacturing, 73, 102258.
Cohen, J. (1992). Statistical power analysis. Current directions in psychological science, 1(3), 98-101.
Dawson, K., & Lee, B. K. (2018). Drama-based pedagogy: Activating learning across the curriculum. Intellect Books.
De Ribaupierre, S., Kapralos, B., Haji, F., Stroulia, E., Dubrowski, A., & Eagleson, R. (2014). Healthcare training enhancement through virtual reality and serious games. Virtual, augmented reality and serious games for healthcare 1, 9-27.
Dourish, P. (2001). Where the action is: the foundations of embodied interaction. MIT press.
Erbay, F., & Doğru, S. S. Y. (2010). The effectiveness of creative drama education on the teaching of social communication skills in mainstreamed students. Procedia-Social and Behavioral Sciences, 2(2), 4475-4479.
Eriksson, K., Alsaleh, A., Behzad Far, S., & Stjern, D. (2022). Applying Digital Twin Technology in Higher Education: An Automation Line Case Study. Adv. Transdiscipl. Eng, 21, 461-472.
Fjeld, M., Fredriksson, J., Ejdestig, M., Duca, F., Bötschi, K., Voegtli, B., & Juchli, P. (2007). Tangible user interface for chemistry education: comparative evaluation and re-design. Proceedings of the SIGCHI conference on Human factors in computing systems,
Freina, L., & Ott, M. (2015). A literature review on immersive virtual reality in education: state of the art and perspectives. The international scientific conference elearning and software for education,
Ganskop, D. (2010). Psychological benefits and educational potential of physically immersive artificial environment pedagogy. Rochester Institute of Technology.
George, D. (2011). SPSS for windows step by step: A simple study guide and reference, 17.0 update, 10/e. Pearson Education India.
Gerup, J., Soerensen, C. B., & Dieckmann, P. (2020). Augmented reality and mixed reality for healthcare education beyond surgery: an integrative review. International journal of medical education, 11, 1.
Giasiranis, S., & Sofos, L. (2016). Production and evaluation of educational material using augmented reality for teaching the module of “representation of the information on computers” in junior high school. Creative Education, 7(9), 1270-1291.
Grieves, M. (2014). Digital twin: manufacturing excellence through virtual factory replication. White paper, 1(2014), 1-7.
Grieves, M., & Vickers, J. (2017). Digital twin: Mitigating unpredictable, undesirable emergent behavior in complex systems. Transdisciplinary perspectives on complex systems: New findings and approaches, 85-113.
Hengki, H., Jabu, B., & Salija, K. (2017). The effectiveness of cooperative learning strategy through English village for teaching speaking skill. Journal of Language Teaching and Research, 8(2), 306-312.
Hou, H.-T. (2015). Integrating cluster and sequential analysis to explore learners’ flow and behavioral patterns in a simulation game with situated-learning context for science courses: A video-based process exploration. Computers in human behavior, 48, 424-435.
Ishii, H., & Ullmer, B. (1997). Tangible bits: towards seamless interfaces between people, bits and atoms. Proceedings of the ACM SIGCHI Conference on Human factors in computing systems,
Khajavi, S. H., Motlagh, N. H., Jaribion, A., Werner, L. C., & Holmström, J. (2019). Digital twin: vision, benefits, boundaries, and creation for buildings. IEEE Access, 7, 147406-147419.
Lan, Y.-J., Kan, Y.-H., Hsiao, I. Y., Yang, S. J., & Chang, K.-E. (2013). Designing interaction tasks in Second Life for Chinese as a foreign language learners: A preliminary exploration. Australasian Journal of Educational Technology, 29(2).
Lindgren, R., & Johnson-Glenberg, M. (2013). Emboldened by embodiment: Six precepts for research on embodied learning and mixed reality. Educational researcher, 42(8), 445-452.
Lindgren, R., & Moshell, J. M. (2011). Supporting children's learning with body-based metaphors in a mixed reality environment. Proceedings of the 10th international conference on interaction design and children,
Lindgren, R., Tscholl, M., Wang, S., & Johnson, E. (2016). Enhancing learning and engagement through embodied interaction within a mixed reality simulation. Computers & Education, 95, 174-187.
Lorenzo‐Alvarez, R., Rudolphi‐Solero, T., Ruiz‐Gomez, M. J., & Sendra‐Portero, F. (2020). Game‐Based learning in virtual worlds: a multiuser online game for medical undergraduate radiology education within second life. Anatomical sciences education, 13(5), 602-617.
Miller, G. A., & Gildea, P. M. (1987). How children learn words. Scientific American, 257(3), 94-99.
Mohammadi, N., & Taylor, J. (2020). Knowledge discovery in smart city digital twins.
Ornellas, A., Falkner, K., & Edman Stålbrandt, E. (2019). Enhancing graduates’ employability skills through authentic learning approaches. Higher education, skills and work-based learning, 9(1), 107-120.
Palmer, C., Roullier, B., Aamir, M., McQuade, F., Stella, L., Anjum, A., & Diala, U. (2022). Digital Twinning remote laboratories for online practical learning. Production & Manufacturing Research, 10(1), 519-545.
Piirainen–Marsh, A., & Tainio, L. (2009). Collaborative game‐play as a site for participation and situated learning of a Second Language. Scandinavian Journal of Educational Research, 53(2), 167-183.
Rolle, R., Martucci, V., & Godoy, E. (2020). Architecture for Digital Twin implementation focusing on Industry 4.0. IEEE Latin America Transactions, 18(05), 889-898.
Schwarz, C. W., & Hahn, K.-U. (2006). Full-flight simulator study for wake vortex hazard area investigation. Aerospace Science and Technology, 10(2), 136-143.
Skulmowski, A., Pradel, S., Kühnert, T., Brunnett, G., & Rey, G. D. (2016). Embodied learning using a tangible user interface: The effects of haptic perception and selective pointing on a spatial learning task. Computers & Education, 92, 64-75.
Stein, D. (1998). Situated learning in adult education. ERIC Clearinghouse on Adult, Career, and Vocational Education, Center on ….
Tang, Y.-M., Au, K. M., Lau, H. C., Ho, G. T., & Wu, C.-H. (2020). Evaluating the effectiveness of learning design with mixed reality (MR) in higher education. Virtual Reality, 24(4), 797-807.
Tao, F., Cheng, J., Qi, Q., Zhang, M., Zhang, H., & Sui, F. (2018). Digital twin-driven product design, manufacturing and service with big data. The International Journal of Advanced Manufacturing Technology, 94, 3563-3576.
Tolentino, L., Birchfield, D., Megowan-Romanowicz, C., Johnson-Glenberg, M. C., Kelliher, A., & Martinez, C. (2009). Teaching and learning in the mixed-reality science classroom. Journal of Science Education and Technology, 18, 501-517.
Ullah, S. (2011). Multi-modal Interaction in Collaborative Virtual Environments: Study and analysis of performance in collaborative work Université d'Evry-Val d'Essonne].
Wikipedia contributors. (2023a). Augmented reality. In Wikipedia, The Free Encyclopedia.
Wikipedia contributors. (2023b). Digital twin. In Wikipedia, The Free Encyclopedia.
Wikipedia contributors. (2023c). Embodied cognition. In Wikipedia, The Free Encyclopedia.
Wikipedia contributors. (2023d). Mixed reality. In Wikipedia, The Free Encyclopedia.
Wikipedia contributors. (2023e). Situated cognition. In Wikipedia, The Free Encyclopedia.
Wikipedia contributors. (2023f). Virtual reality. In Wikipedia, The Free Encyclopedia.
Wilson, M. (2002). Six views of embodied cognition. Psychonomic bulletin & review, 9, 625-636.
Wu, W., Luo, Y., Huang, D., Huang, C., Peng, Y., & Chen, G. (2015). A Self-Observable Learning Cinema in the Classroom. The 23rd International Conference on Computers in Education,
Zandavi, S. M., & Chung, V. (2018). Augmented reality for remote laboratory improving educational learning: Using elevated particle swarm optimization in object tracking scheme. 2018 International Joint Conference on Neural Networks (IJCNN),