跳到主要內容

簡易檢索 / 詳目顯示

回結果列表
研究生： 張文璇
Wen-hsuan Chang
論文名稱： 多型態影片代理表徵對摘要影片式學習之影響
Effects of Multimodal Surrogates in a Video SummarizationLearning Platform
指導教授： 楊接期
Jie-chi Yang
口試委員:
學位類別： 碩士
Master
系所名稱： 資訊電機學院 - 網路學習科技研究所
Graduate Institute of Network Learning Technology
畢業學年度： 99
語文別： 中文
論文頁數： 102
中文關鍵詞： 系統使用行為 、理解力 、認知風格 、摘要影片式學習 、影片代理表徵
外文關鍵詞： Comprehension, Navigation, Cognitive Style, Video-Based Learning, Video Surrogate, Video Summarization
相關次數： 點閱：9  下載：0 
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報

    • 在過去的影片式學習環境中，學習者必須花費較長的時間觀看整部影片，或者使用影音播放器中簡易的快轉、倒轉、暫停方式來捕捉影片中的重要內容，本研究欲透過影片摘要技術來協助降低影片式學習中大量的時間成本。因此，以摘要式影片技術結合影片代理表徵(Video Surrogate)之概念作為基礎，將保留重要內容的影片摘要搭配具有輔助內容理解的訊息元件，來發展一套摘要影片式學習之平台，希望能夠藉此提供充分的學習資訊與支援工具，輔助學習者對影片內容進行有效地理解，並討論摘要影片式學習之效果。
    本研究透過不同的影片代理表徵組合型態來輔助學習者影片內容理解之實驗，主要探討所設計的快進播放型、影片摘要型、關鍵字影片摘要型等三種影片代理表徵組合型態，對於輔助內容理解之學習成效與差異，並且討論學習者的個體差異與系統使用行為之間的關係，以及這些變項對於摘要影片式學習理解成效之影響。最後，評估學習者知覺該系統平台的滿意度與建議，並整理學習者使用多媒體的背景因素與其滿意度間的關係。實驗結果證實，學習者使用此三種影片代理表徵後皆有達到理解之目的，而其中以關鍵字影片摘要型與影片摘要型影片代理表徵組合型態較快進播放型之理解效果為佳。此外，結果發現學習者的認知風格會影響其系統使用行為，然而並無直接影響理解成效；然而，從學習者之系統使用行為發現，學習者經由使用平台中特定訊息元件之行為，對於影片內容的理解成效有正面的效益。在系統滿意度問卷的分析結果中，學習者知覺最為滿意之組合型態為排序單型影片代理表徵組合型態，不過同時也認為關鍵字影片摘要型組合型態在有限時間下為有效抓取重點之學習工具；除此之外，經分析後發現學習者的多媒體偏好與經驗與其知覺系統有用性、易用性或滿意度之間有著正向的關係。

    The traditional video-based learning seldom considers the issue of time constraint that learners may keep viewing videos until the whole video stream finished or the suitable videos are explored. They spend a lot of time grasping the important gist of videos, but yet hardly attain the learning goal. In order to learn by video summaries, this study combines the idea of video surrogate with video summarization technique as a video-based learning platform to enhance learners’ comprehension. Consequently, three composed sets of multimodal video surrogates, namely the fast forward (FF), the video summarization inventory (VSUM) and the keyword-based video summarization (KVSUM), are proposed to investigate the effects on learners’ comprehension towards video contents. Furthermore, this study attempts to explore the relationships of cognitive style and navigation in this platform, and the effects on comprehension performance. Finally, a satisfaction questionnaire is implemented to assess learners’ perceptions of multimodal video surrogates. The results reveal three possible implications: First, the video summarization learning platform with multimodal video surrogates provides helpful information to enhance learners’ comprehension. The effects of KVSUM and VSUM are better than FF. Second, the learners’ cognitive styles affect their navigation behaviors and strategies, but yet no significant effect on comprehension performance. Moreover, among those usage behaviors, learners who have utilized the specific surrogates in the platform show positive correlations with better comprehension to video contents. Last but not least, in terms of system usage and satisfaction, VSUM is most attractive to learners, but meanwhile learners think the KVSUM may be a useful tool for quick grasping gist in a limited period. Furthermore, the learners’ preferences and prior experiences of multimedia show positive correlations with usefulness, ease of use and satisfaction of the multimodal video surrogates in the video summarization learning platform.

    摘要.................................... I Abstract............................... II 目錄.................................... III 圖目錄................................... VII 表目錄................................... VIII 第一章 緒論............................ 1 1.1 研究背景......................... 1 1.2 研究動機......................... 2 1.3 研究目的......................... 3 1.4 研究問題......................... 3 1.5 研究限制......................... 3 1.6 名詞釋義..........................5 第二章 文獻探討......................... 6 2.1 影片式學習相關探討................. 6 2.1.1 影片式學習應用.................... 6 2.1.2 影片認知過程...................... 8 2.2 影片代理表徵（Video Surrogate）... 8 2.2.1 影片代理表徵之類型................. 8 2.2.2 影片代理表徵各類型間之關係.......... 12 2.2.3 影片代理表徵與內容理解.............. 13 2.3 個體差異與系統使用行為.............. 16 2.3.1 認知風格之類型.................... 17 2.3.2 「整體型-序列型」認知風格之相關研究... 19 2.4 文獻探討總結...................... 20 第三章 系統實作......................... 22 3.1 系統架構......................... 22 3.1.1 字幕處理......................... 23 3.1.2 影片處理......................... 24 3.1.3 瀏覽工具處理...................... 26 3.2 系統介面及功能.................... 27 3.2.1 系統使用流程...................... 28 3.2.2 系統操作介面...................... 28 第四章 研究方法......................... 32 4.1 研究架構與實驗設計................. 33 4.2 實驗目的......................... 35 4.3 研究對象與實驗背景................. 35 4.4 實驗流程......................... 36 4.5 研究工具......................... 38 4.5.1 影片內容理解力測驗試題.............. 38 4.5.2 學習偏好量表...................... 38 4.5.3 問卷調查......................... 39 4.5.4 系統使用紀錄...................... 41 第五章 研究結果與討論.................... 42 5.1 影片內容理解測驗結果分析............ 42 5.1.1 組內影片代理表徵組合型態之前後測成績.. 42 5.1.2 組間影片代理表徵組合型態之前後測成績比較44 5.2 學習者個體差異與理解成效結果分析..... 46 5.2.1 認知風格與不同影片代理表徵組合型態對影片內容理解之影響.... 46 5.3 系統使用行為分析.................. 47 5.3.1 瀏覽策略與不同認知風格間之關係....... 48 5.3.2 瀏覽行為與不同影片代理表徵組合型態下的理解成效之關係..... 49 5.4 問卷調查結果分析.................. 51 5.4.1 整體系統評量問卷.................. 51 5.4.2 系統偏好綜合評量.................. 56 5.4.3 開放式問卷內容分析................. 61 5.5 討論............................ 64 第六章 結論與未來工作.................... 64 6.1 研究結論......................... 68 6.2 研究貢獻......................... 70 6.3 未來工作......................... 70 參考文獻................................. 72 中文部分................................. 72 英文部分................................. 73 附錄一 影片內容理解力測驗（後測）............ 79 附錄二 學習偏好量表 ........................85 附錄三 學生個人背景問卷..................... 87 附錄四 整體系統評量問卷..................... 89 附錄五 系統偏好綜合評量問卷................. 90

    中文部分
    林政廷（民99）。適用於不同聽力理解程度學習者之英語影片學習系統。國立中央大學網路學習科技研究所碩士論文。
    許永昌（民94）。建置一個影片式語料庫檢索系統提升大一新生口語體的理解能力。國立中央大學網路學習科技研究所碩士論文。
    劉佳芬（民99）。以圖形化註記英語發音縮減特徵為關鍵字幕對英語學習之研究。國立中央大學網路學習科技研究所碩士論文。
    劉冠麟（民99）。從人因探討網路學習者對不同媒體呈現的學習偏好。國立中央大學網路學習科技研究所碩士論文。
    蔡其澂（民97）。開發場景導向之影片式語料庫檢索系統輔助英語口語體理解。國立中央大學網路學習科技研究所碩士論文。
    羅鴻雁（民98）。電影融入教學對中學生世界史認知學習之教學設計與實施歷程--希臘、羅馬史之教學個案研究。淡江大學教育科技學系碩士論文。
     
    英文部分
    Brickell, G. (1993). Navigation and learning style. Australian Journal of Educational Technology, 9(2), 103-114.
    Cairncross, S., & Mannion, M. (2001). Interactive Multimedia and Learning: Realizing the Benefits. Innovations in Education and Teaching International, 38(2), 156 - 164.
    Calcaterra, A., Antonietti, A., & Underwood, J. (2005). Cognitive style, hypermedia navigation and learning. Computers & Education, 44(4), 441-457.
    Caspi, A., Gorsky, P., & Privman, M. (2005). Viewing comprehension: Students’ learning preferences and strategies when studying from video. Instructional Science, 33(1), 31-47.
    Chen, S. Y., Ghinea, G., & Macredie, R. D. (2006). A cognitive approach to user perception of multimedia quality: An empirical investigation. International Journal of Human-Computer Studies, 64(12), 1200-1213.
    Chen, S. Y., & Macredie, R. (2010). Web-based interaction: A review of three important human factors. International Journal of Information Management, 30(5), 379-387.
    Chen, S. Y., & Macredie, R. D. (2002). Cognitive styles and hypermedia navigation: Development of a learning model. Journal of the American Society for Information Science and Technology, 53(1), 3-15.
    Chen, S. Y., Magoulas, G. D., & Dimakopoulos, D. (2005). A flexible interface design for Web directories to accommodate different cognitive styles. Journal of the American Society for Information Science and Technology, 56(1), 70-83.
    Christel, M. G., Smith, M. A., Taylor, C. R., & Winkler, D. B. (1998). Evolving video skims into useful multimedia abstractions. Paper presented at the Proceedings of the SIGCHI conference on Human factors in computing systems, Los Angeles, California, United States.
    Christel, M. G., Winkler, D. B., & Taylor, C. R. (1997). Improving Access to a Digital Video Library. Paper presented at the Proceedings of the IFIP TC13 Interantional Conference on Human-Computer Interaction.
    Clarke, J. A. (1993). Cognitive style and computer-assisted learning: Problems and a possible solution. Alt-J, 1(1), 47 - 59.
    Clewley, N., Chen, S. Y., & Liu, X. (2009). Cognitive styles and web-based instruction: field dependent/independent vs. Holist/Serialist. Paper presented at the Proceedings of the 2009 IEEE international conference on Systems, Man and Cybernetics, San Antonio, TX, USA.
    Davis, F. D. (1989). Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology. MIS Quarterly, 13(3), 319-340.
    Ding, W., Marchionini, G., & Soergel, D. (1999). Multimodal surrogates for video browsing. Paper presented at the Proceedings of the fourth ACM conference on Digital libraries, Berkeley, California, United States.
    Federico, P.-A., & Landis, D. B. (1984). Cognitive styles, abilities, and aptitudes: Are they dependent or independent? Contemporary Educational Psychology, 9(2), 146-161.
    Felton, L. A., Keesee, K., Mattox, R., McCloskey, R., & Medley, G. (2001). Comparison of Video Instruction and Conventional Learning Methods on Students'' Understanding of Tablet Manufacturing. American Journal of Pharmaceutical Education, 65(1), 53-56.
    Fisch, S. M. (2000). A Capacity Model of Children''s Comprehension of Educational Content on Television. Media Psychology, 2(1), 63 - 91.
    Fonseca, P. M., & Pereira, F. (2004). Automatic video summarization based on MPEG-7 descriptions. Signal Processing: Image Communication, 19(8), 685-699.
    Ford, N. (1985). Learning Styles and Strategies of Postgraduate Students. British Journal of Educational Technology, 16(1), 65-77.
    Ford, N. (2000). Cognitive Styles and Virtual Environments. Journal of the American Society for Information Science, 51(6), 543-557.
    Ford, N., & Chen, S. Y. (2000). Individual Differences, Hypermedia Navigation,and Learning: An Empirical Study (Vol. 9, pp. 281-311). Charlottesville, VA: AACE.
    Ford, N., & Chen, S. Y. (2001). Matching/mismatching revisited: an empirical study of learning and teaching styles. British Journal of Educational Technology, 32(1), 5-22.
    Fu, C.-H., Wang, K.-T., Cheng, S.-C., & Hou, T.-W. (2008). Building Video Concordancer Supported English Online Learning Exemplification. In Y.-M. Huang, C. Xu, K.-S. Cheng, J.-F. Yang, M. Swamy, S. Li & J.-W. Ding (Eds.), Advances in Multimedia Information Processing - PCM 2008 (Vol. 5353, pp. 731-737): Springer Berlin / Heidelberg.
    Ghinea, G., & Chen, S. (2006). Perceived quality of multimedia educational content: A cognitive style approach. Multimedia Systems, 11(3), 271-279.
    Goodrum, A. A. (2001). Multidimensional scaling of video surrogates. [Article]. Journal of the American Society for Information Science and Technology, 52(2), 174-182.
    Greene, S., Marchionini, G., Plaisant, C., & Shneiderman, B. (2000). Previews and overviews in digital libraries: Designing surrogates to support visual information seeking. Journal of the American Society for Information Science, 51(4), 380-393.
    Grodal, T. (1997). Moving Pictures --- A New Theory of FilmGenres, Feelings, and Cognition. Oxford: Clarendon Press.
    He, L., Sanocki, E., Gupta, A., & Grudin, J. (1999). Auto-summarization of audio-video presentations. Paper presented at the Proceedings of the seventh ACM international conference on Multimedia (Part 1), Orlando, Florida, United States.
    Hsu, Y.-C., Lin, H., Ching, Y.-H., & Dwyer, F. M. (2009). The effects of web-based instruction navigation modes on undergraduates'' learning outcomes. Educational Technology & Society, 12(1), 271-284.
    Hughes, A., Wilkens, T., Wildemuth, B., & Marchionini, G. (2003). Text or Pictures? An Eyetracking Study of How People View Digital Video Surrogates. In E. Bakker, M. Lew, T. Huang, N. Sebe & X. Zhou (Eds.), Image and Video Retrieval (Vol. 2728, pp. 1-6): Springer Berlin / Heidelberg.
    Iyer, H., & Lewis, C. D. (2007). Prioritization strategies for video storyboard keyframes. [Article]. Journal of the American Society for Information Science and Technology, 58(5), 629-644.
    Jenkins, C., Corritore, C. L., & Wiedenbeck, S. (2003). Patterns of Information Seeking on the Web: a Qualitative Study of Domain Expertise and Web Expertise IT&SOCIETY, 1(3), 64-89.
    Kaiser, H. (1974). An index of factorial simplicity. Psychometrika, 39(1), 31-36.
    Koutrika, G., Zadeh, Z. M., & Garcia-Molina, H. (2009). Data Clouds: Summarizing Keyword Search Results over Structured Data. Paper presented at the 12th International Conference on Extending Database Technology (EDBT 2009), Saint-Petersburg, Russia.
    Lee, J. (2007). The effects of visual metaphor and cognitive style for mental modeling in a hypermedia-based environment. Interacting with Computers, 19(5-6), 614-629.
    Lienhart, R., Pfeiffer, S., & Effelsberg, W. (1997). Video abstracting. Commun. ACM, 40(12), 54-62.
    Lindgren, R., Pea, R., Lewis, S., & Rosen, J. (2007). Learning from digital video: an exploration of how interactions affect outcomes. Paper presented at the Proceedings of the 8th iternational conference on Computer supported collaborative learning, New Brunswick, New Jersey, USA.
    Lohmann, S., Ziegler, J., & Tetzlaff, L. (2009). Comparison of Tag Cloud Layouts: Task-Related Performance and Visual Exploration. Paper presented at the Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part I, Uppsala, Sweden.
    Mackey, T. P., & Ho, J. (2008). Exploring the relationships between Web usability and students'' perceived learning in Web-based multimedia (WBMM) tutorials. Computers & Education, 50(1), 386-409.
    Mampadi, F., Chen, S. Y., Ghinea, G., & Chen, M.-P. (2011). Design of adaptive hypermedia learning systems: A cognitive style approach. Computers & Education, 56(4), 1003-1011.
    Marchionini, G., Song, Y., & Farrell, R. (2009). Multimedia surrogates for video gisting: Toward combining spoken words and imagery. Information Processing & Management, 45(6), 615-630.
    Mayer, R. E. (2001). Multimedia learning. New York: Cambridge University Press.
    Mu, X., & Marchionini, G. (2003). Enriched video semantic metadata: Authorization, integration, and presentation. Proceedings of the American Society for Information Science and Technology, 40(1), 316-322.
    Pask, G. (1976). Styles and strategies of learning. British Journal of Educational Psychology, 46(2), 128-148.
    Pask, G. (1979). Final report of SSRC Research Programme HR 2708. Richmond(Surrey): System Research Ltd.
    Pask, G. (1988). Learning strategies, teaching strategies, and conceptual or learning style (In Schmeck, R. R. ed.). New York:: Plenum Press.
    Riding, R. J., & Rayner, S. (1998). Cognitive Styles and Learning Strategies. London: David Fulton.
    Schwartz, D. L., & Hartman, K. (Eds.). (2007). It is not television anymore: Design digital video for learning and assessment. Mahwah,NJ: Erlbaum.
    Slaughters, L., Shneiderman, B., & Marchionini, G. (1997). Comprehension and object recognition capabilities for presentations of simultaneous video key frame surrogates. In C. Peters & C. Thanos (Eds.), Research and Advanced Technology for Digital Libraries (Vol. 1324, pp. 41-54): Springer Berlin / Heidelberg.
    Song, Y., & Marchionini, G. (2007). Effects of audio and visual surrogates for making sense of digital video. Paper presented at the Proceedings of the SIGCHI conference on Human factors in computing systems, San Jose, California, USA.
    Tse, T., Marchionini, G., Ding, W., Slaughter, L., & Komlodi, A. (1998). Dynamic key frame presentation techniques for augmenting video browsing. Paper presented at the Proceedings of the working conference on Advanced visual interfaces, L''Aquila, Italy.
    van Oostendorp, H., & Juvina, I. (2007). Using a cognitive model to generate web navigation support. International Journal of Human-Computer Studies, 65(10), 887-897.
    Wildemuth, B. M., Marchionini, G., Wilkens, T., Yang, M., Geisler, G., Fowler, B., & Mu, X. (2002). Alternative Surrogates for Video Objects in a Digital Library: Users’ Perspectives on Their Relative Usability. In M. Agosti & C. Thanos (Eds.), Research and Advanced Technology for Digital Libraries (Vol. 2458, pp. 143-160): Springer Berlin / Heidelberg.
    Wildemuth, B. M., Marchionini, G., Yang, M., Geisler, G., Wilkens, T., Hughes, A., & Gruss, R. (2003). How fast is too fast?: evaluating fast forward surrogates for digital video. Paper presented at the Proceedings of the 3rd ACM/IEEE-CS joint conference on Digital libraries, Houston, Texas.
    Wilkens, T., Hughes, A., Wildemuth, B. M., & Marchionini, G. (2003). The role of narrative in understanding digital video: An exploratory analysis. Proceedings of the American Society for Information Science and Technology, 40(1), 323-329.
    Witkin, H. A., Moore, C. A., Goodenough, D. R., & Cox, P. W. (1977). Field-Dependent and Field-Independent Cognitive Styles and Their Educational Implications. Review of Educational Research, 47(1), 1-64.
    Wu, Y. C., Lee, Y. S., & Chang, C. H. (2004). VSUM: Summarizing from Videos. Paper presented at the Proceedings of the IEEE Sixth International Symposium on Multimedia Software Engineering.
    Yang, H., Chaisorn, L., Zhao, Y., Neo, S. Y., & Chua, T. S. (2003). VideoQA: question answering on news video. Paper presented at the Proceedings of the eleventh ACM international conference on Multimedia, Berkeley, CA, USA.
    Yang, J. C., & Chen, S. Y. (in press). Investigation of Learners'' Perceptions for Video Summarization and Recommendation. Interactive Learning Environments.
    Yang, J. C., Huang, Y. T., Tsai, C. C., Chung, C. I., & Wu, Y. C. (2009). An Automatic Multimedia Content Summarization System for Video Recommendation. [Proceedings Paper]. Educational Technology & Society, 12(1), 49-61.
    Yang, M., Wildemuth, B. M., Marchionini, G., Wilkens, T., Geisler, G., Hughes, A., . . . Webster, C. (2003). Measuring user performance during interactions with digital video collections. Proceedings of the American Society for Information Science and Technology, 40(1), 3-12.
    Yeo, B.-L., & Yeung, M. M. (1997). Retrieving and visualizing video. Commun. ACM, 40(12), 43-52. doi: 10.1145/265563.265571
    Zhang, D., & Nunamaker, J. F. (2004). A Natural Language Approach to Content-BasedVideo Indexing and Retrieval for Interactive E-Learning. IEEE TRANSACTIONS ON MULTIMEDIA, 6(3), 450-458.
    Zhang, D., Zhou, L., Briggs, R. O., & Nunamaker, J. J. F. (2006). Instructional video in e-learning: Assessing the impact of interactive video on learning effectiveness. Information & Management, 43(1), 15-27.
    Zhao, H., & Kit, C. (2007). Incorporating global information into supervised learning for Chinese word segmentation. Paper presented at the The 10th Conference of the Pacific Association for Computational Linguistics (PACLING-2007).

    QR CODE
    :::