混合實境音樂互動系統｜國立中央大學博碩士論文系統

簡易檢索 / 詳目顯示

回結果列表

研究生：	金姵辰 Pei-Chen Ching
論文名稱：	混合實境音樂互動系統 Mixed-Reality Music Interactive System
指導教授：	蘇木春 Mu-Chun Su
口試委員:
學位類別：	碩士 Master
系所名稱：	資訊電機學院 - 軟體工程研究所 Graduate Institute of Software Engineering
論文出版年：	2013
畢業學年度：	101
語文別：	中文
論文頁數：	111
中文關鍵詞：	深度攝影機、人機互動、混合實境互動桌、投影觸控、國小音樂課程
相關次數：	點閱：13 下載：0
分享至:	分享至facebook 分享至twitter

查詢本校圖書館目錄查詢臺灣博碩士論文知識加值系統勘誤回報

　　本論文將微軟Kinect感應器與投影機結合，並融入國小音樂課程，建立一個具有音樂教育功能的混合實境互動桌。系統提供四個模式：彈奏模式、創作模式、五線譜模式、娛樂模式。(1)彈奏模式模擬十六種類型樂器的真實彈奏方式（共128種音色），供使用者彈奏。(2)創作模式提供八種曲風的爵士鼓節奏以及三十二種和弦，讓使用者很容易地認識節奏與和弦並能創作出配樂。(3)五線譜模式會檢驗樂理規則，讓使用者在五線譜上擺放音符的同時，學會樂理、認識拍號、音符與休止符、五線譜位置等，而系統還能紀錄使用者所寫下的曲子。(4)娛樂模式提供128種樂器音色給使用者選擇，讓使用者化身為音樂家，隨意彈奏就能演奏出以該樂器為主奏之名曲，並藉此認識樂器音色與曲目。
　　而本系統實際應用在國小音樂課，證實了這樣的互動學習方式確實能夠提昇學習成效，以及學生對於自身學習動機、班級學習氣氛等感受，且不論是親自操作系統，或是在一旁協助他人操作皆有效果。甚至原本對音樂無興趣者，在經過音樂互動桌的學習後，不但考試成績進步，對於音樂課的喜愛程度、學習的成就感、上課專心程度都有所提昇。

Combined a Microsoft Kinect sensor and a projector, we design an interactive table for elementary music education using mixed-reality technology. The interactive table provides 4 modes, inclusive of playing mode, composing mode, staff mode, and entertainment mode.
In playing mode, the system simulates 128 kinds of musical instruments that offer users to play different kinds of instruments with the projected keyboard and to absorb the knowledge of these instruments. In composing mode, the system provides 8 rhythms and 32 chords that help users compose easily. In staff mode, the system automatically verifies the accuracy of music theory while users put musical notes on the staff so that users can learn the concept of staff, time signature, and musical alphabet. Besides, users can record staves and the system would merge them as a song. In entertainment mode, users can choose from 128 kinds of musical instruments and play a beautiful song with the virtual keyboard as if they themselves are famous musician.
After those elementary school students take music classes using our system, we prove that it definitely can help students improve their grades no matter if they manipulate themselves or just assist others aside. Besides, it helps students improve their motivation, concentration, and sense of achievement as well even for those who have no interests in music classes.

中文摘要...............................i
ABSTRACT.............................ii
誌謝..................................iii
目錄..................................iv
圖目錄 List of Figures.................viii
表目錄 List of Tables..................xi
第一章、緒論............................1
1-1 研究動機...........................1
1-2 研究目的...........................2
1-3 論文架構...........................3
1-4 研究範圍與限制......................3
第二章、相關研究........................4
2-1 Kinect for Windows介紹............4
2-1-1 設備規格.........................4
2-1-2 系統需求.........................5
2-2 音樂教育與科技......................6
2-3 國小音樂課程綱要....................10
2-4 互動桌相關應用.....................13
2-4-1 在音樂上之應用...................13
2-4-2 其他領域之應用...................16
2-5 數位樂器介面(MIDI).................19
2-5-1 頻道 (Channel).................19
2-5-2 命令 (Command).................19
第三章、互動系統技術與演算法..............21
3-1 投影畫面校正.......................22
3-1-1 座標系轉換.......................22
3-1-2 過濾雜訊層.......................24
3-2 物件偵測..........................25
3-2-1 侵蝕與擴張演算法..................25
3-2-2 標號演算法.......................26
3-2-3 物件資訊.........................27
3-2-4 邊緣偵測.........................29
3-2-5 記錄輪廓座標.....................30
3-2-6 區隔音樂物件與使用者肢體...........31
3-3 物件特徵擷取與辨識..................32
3-4 各類樂器按鍵之觸發判斷...............33
3-4-1 鍵盤類..........................33
3-4-2 撥弦類..........................34
3-4-3 提琴類..........................35
3-4-4 打擊類與特效.....................36
3-4-5 合成音..........................36
3-4-6 鋼鼓與爵士鼓.....................37
3-4-7 古箏...........................37
3-4-8 卡林巴琴........................38
3-4-9 吹管與銅管類.....................38
第四章、人機介面與應用...................40
4-1 系統環境..........................40
4-2 系統操作流程與介面..................41
4-3 使用者模式選擇.....................47
4-3-1 彈奏模式........................47
4-3-2 創作模式........................49
4-3-3 五線譜模式......................51
4-3-4 娛樂模式........................54
第五章、實驗設計與結果...................56
5-1 虛擬樂器彈奏之精準度................56
5-1-1 實驗內容與流程...................56
5-1-2 實驗結果........................57
5-2 和弦彈奏之精準度....................58
5-2-1 實驗內容與流程....................58
5-2-2 實驗結果.........................58
5-3 音符與休止符之辨識率.................59
5-3-1 實驗內容與流程....................59
5-3-2 實驗結果.........................59
5-4 學習成效與動機......................61
5-4-1 實驗規劃.........................61
5-4-2 實驗流程.........................61
5-4-3 上課流程.........................63
5-4-4 實驗結果.........................65
第六章、結論與未來展望....................74
6-1 結論..............................74
6-2 未來展望...........................75
參考文獻...............................76
附錄一、Least-Squares SVD..............80
附錄二、樂器分類與中英文名稱對照............81
附錄三、樂器學習前測、後測、延宕測試.........85
附錄四、五線譜學習前測、後測、延宕測試.......88
附錄五、音樂背景問卷.....................94
附錄六、環境感受問卷.....................95

                                

[1] J. M. Piro and C. Ortiz, “The effect of piano lessons on the vocabulary and verbal sequencing skills of primary grade students,” Psychology of Music, Vol. 37, pp. 325-348, 2009.
[2] 夏琳．海伯梅爾著，滕淑芬譯，學音樂，孩子更聰明，智庫文化，台灣，民國八十九年。
[3] L. Hetland, “Learning to Make Music Enhances Spatial Reasoning,” Journal of Aesthetic Education, Vol. 34, No. 3/4, pp. 179-238, 2000.
[4] 姚世澤，「音樂治療活動對國中階段中重度智障學生社會技能之影響」，國立臺灣師範大學，碩士論文，民國88年。
[5] S. Hallam, “The power of music: Its impact on the intellectual, social and personal development of children and young people,” International Journal of Music Education, Vol. 28, pp. 269-290, 2010.
[6] 楊秀惠和陳嘉彌，「積木角遊戲活動引爆創造力之啟思」，幼兒保育學刊，第五期，87~112頁，2007。
[7] 吳雅玲和許惠欣，「積木遊戲－幼兒單位積木的遊戲型態」，幼兒教保研究期刊，第二期，19~43頁，2008。
[8] Kinect圖片[Online] Available:
http://msdn.microsoft.com/zh-tw/hh367958.aspx Apr. 7, 2013[data accessed]
[9] G. D. Peters, “Music Software and Young Children Fun and Focused Instruction,” General Music Today, Vol. 22, pp. 37-39, SAGE, 2009.
[10] Groovy Shapes Software圖片[Online] Available:
http://www.nook.se/groovy-music-sibelius/ Apr. 7, 2013[data accessed]
[11] Garageband[Online] Available:
http://www.apple.com/tw/apps/garageband/ Apr. 7, 2013[data accessed]
[12] D. Merrill, J. Kalanithi, and P. Maes, “Siftables: Towards Sensor Network User Interfaces,” in TEI'07, pp. 75-78, Baton Rouge, LA, USA, Feb 2007.
[13] Siftables[Online] Available:
http://www.ted.com/talks/david_merrill_demos_siftables_the_smart_blocks.html Apr. 7, 2013[data accessed]
[14] 國民中小學九年一貫課程綱要藝術與人文學習領域，國民教育司，民國97年。
[15] Noteput[Online] Available:
http://www.jonasheuer.de/index.php/noteput/ Apr. 7, 2013[data accessed]
[16] M. Kaltenbrunner, S. Jord`a, G. Geiger, and M. Alonso, “The reacTable*: A Collaborative Musical Instrument,” IEEE Trans. Enabling Technologies: Infrastructure for Collaborative Enterprises (WETICE'06), pp. 406-411, June 2006.
[17] Reactable圖片[Online] Available:
http://www.reactable.com/products/live/design/ Apr. 7, 2013[data accessed]
[18] S. Lynch, M. A. Nacenta, S. Carpendale, “ToCoPlay: Graphical Multi-touch Interaction for Composing and Playing Music,” Lecture Notes in Computer Science, Vol. 6948, pp. 306-322, 2011.
[19] ToCoPlay[Online] Available:
http://www.youtube.com/watch?NR=1&v=VwG_kXWliRo&feature=endscreen Apr. 7, 2013[data accessed]
[20] M. Piovesana, Y. Chen, N. Yu, H. Wu, L. Chan, and Y. Hung, “Multi-Display Map Touring with Tangible Widget,” in Proc. ACM Multimedia, pp.679-682, 2010
[21] Classroom of the future[Online] Available:
http://www.universitiesweek.org.uk/Media/Pages/DurhamUniversity.aspx Apr. 7, 2013[data accessed]
[22] 星際迷航觸摸系統教室[Online] Available: http://tech.qq.com/a/20121125/000036.htm Apr. 7, 2013[data accessed]
[23] moJo iCuisine互動餐廳[Online] Available: http://www.youtube.com/watch?v=CO8u6V9DGcw&feature=endscreen&NR=1 Apr. 7, 2013[data accessed]
[24] 林志杰，新版MIDI玩家手冊，第3波出版社，民國八十三年。
[25] MIDI Commands[Online] Available:
http://computermusicresource.com/MIDI.Commands.html Apr. 7, 2013[data accessed]
[26] MIDI音色[Online] Available:
http://www.autosoft.com.hk/article/newuser/snd_midi2/gm_map.htm Apr. 7, 2013[data accessed]
[27] 吳承宗，「基於深度攝影機之混合實境互動桌」，國立中央大學，碩士論文，民國101年。
[28] K. S. Arun, T. Huang, and S. D. Blostein, “Least-Squares Fitting of Two 3-D Point Sets,” IEEE Trans. Analysis and Machine Intelligence, Vol.9, No.5, pp. 698-700, 1987.
[29] 連國珍，數位影像處理，儒林圖書有限公司，民國九十七年。
[30] 楊武智，影像處理與辨認，全華科技圖書股份有限公司，民國九十年。
[31] C#指標掃描影像[Online] Available:
http://www.wretch.cc/blog/qqqoooqw/7444116 Apr. 7, 2013[data accessed]
[32] M. K. Hu, “Visual pattern recognition by moment invariants,” IRE Trans. on Information Theory, Vol.8, No.2, pp. 179-187, Feb 1962.
[33] 鋼鼓圖片[Online] Available:
http://saint616.pixnet.net/blog/post/68220861-%E6%9C%83%E5%94%B1%E6%AD%8C%E7%9A%84%E6%B1%BD%E6%B2%B9%E6%A1%B6---%E6%9C%B1%E5%AE%97%E6%85%B6%E6%89%93%E6%93%8A%E6%A8%82%E5%9C%98%E3%80%8A%E9%8B%BC%E9%BC%93%E9%9F%B3%E6%A8%82 Apr. 7, 2013[data accessed]
[34] 卡林巴圖片[Online] Available:
https://itunes.apple.com/au/app/kalimba-free/id300802995?mt=8 Apr. 7, 2013[data accessed]
[35] 小號指法圖片[Online] Available:
http://www.yyjx.net/ketang/UploadFiles/200506/200568133810526.gif Apr. 7, 2013[data accessed]
[36] Kinect near mode[Online] Available:
http://blogs.msdn.com/b/kinectforwindows/archive/2012/01/20/near-mode-what-it-is-and-isn-t.aspx Apr. 7, 2013[data accessed]
[37] M. C. Su, W. Y. Lee, and S. Y. Chen, “Electronic Trombone-An Interactive Tool to Promote Musical Learning and Performance Creativity,” in VRCAI '11, pp. 585-588, New York, NY, USA, 2011.
[38] ADSR[Online] Available:
http://blog.yam.com/ktliao88/article/6016664 Apr. 7, 2013[data accessed]
[39] 陳俊文，「形成性評量對國中生於「自然與生活科技」網路學習課程情意學習之影響－以「發現生命的驚奇」單元為例」，國立彰化師範大學，碩士論文，民國93年。

簡易檢索 / 詳目顯示

相關論文