跳到主要內容

簡易檢索 / 詳目顯示

研究生: 粘存賢
Cun-xian Nian
論文名稱: 設計與實作一個基於雙攝影機視覺系統的雙點觸控螢幕
Design and Implementation of a Dual-touch Display Based on Dual-camera Vision System
指導教授: 陳慶瀚
Ching-han Chen
口試委員:
學位類別: 碩士
Master
系所名稱: 資訊電機學院 - 資訊工程學系
Department of Computer Science & Information Engineering
畢業學年度: 97
語文別: 中文
論文頁數: 66
中文關鍵詞: 電腦視覺人機介面多點觸控螢幕
外文關鍵詞: computer vision, multi-touch panel, human-computer interaction
相關次數: 點閱:13下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 直接操作顯示於螢幕上的資料能為使用者帶來直覺且方便的使用經驗,因此近年來觸控螢幕已成為顯示科技的一個發展趨勢,其中多點式觸控技術更是受到相當大的關注。本研究提出一個使用雙攝影機為基礎的雙點式觸控螢幕架構與觸碰物偵測和定位的演算法,並透過觸控點追蹤以解決真假點問題,達成雙點觸控的功能。此方法可使一般市售之液晶螢幕外掛此一雙攝影機模組即可具有雙點式觸控的功能,而無須藉助特製的面板。相較於目前的多點式觸控技術,本方法有著成本低和體積小的優點。
      此外,我們定義一組觸控手勢,並將其映射至滑鼠操作的控制指令,使之可以用來操控為滑鼠所設計的應用軟體。我們還規畫了觸控偵測程式和觸控軟體之間的觸資料傳輸協定。藉此,我們實現一個使用雙點輸入手勢操作的觸控軟體。
      最後我們分別在19吋和42吋的螢幕上實作出雙點式觸控系統,再進行不同的應用軟體的觸控操作測試,以驗證此一觸控方法的可行性。此外,我們以點擊遊戲實驗來評估觸控系統可用性和效能,實驗結果顯示所提出的觸控方法具有良好的效能。


    To touch and manipulate data on screens directly without any intermediary device provides more convenient and instinctive using experience to the user. Therefore, the touch screen has become a trend for the display technology in recent years, especially to multi-touch technique attracts more focus. In this work, we propose a vision-base touch screen architecture with dual cameras, touch detection and locating algorithms. For the fraud point problem, we adopt touch point tracking to solve it and achieve the dual touch ability. The ready-made liquid crystal display (LCD) can mount this dual cameras module to equip the dual touch ability, and the cost is cheaper and the volume is smaller than current multi-touch techniques.
    Moreover, we define a set of touch gestures and map it to the controlling commands of mouse. This makes it can manipulate those application software designed for mouse. We also define a touch data transmission protocol between the touch detecting programs and touch software. By using above schemes, we realize the touch software which manipulated with dual touch point inputs.
    Finally, we implement the dual touch system on the 19-inch and 42-inch displays, respectively. Then, to verify the feasibility of proposed method, we test the touch operations with various applications. Furthermore, we evaluate the usability of our system with a hit game experiment, and the result shows the proposed method provides a satisfying performance.

    摘要 I Abstract II 致謝 III 目錄 IV 圖目錄 VI 表目錄 VIII 第一章 緒論 1 1.1 研究動機 1 1.2 論文架構 2 第二章 文獻探討 3 2.1 單點式觸控螢幕技術 3 2.1.1 電阻式觸控螢幕技術 4 2.1.2 電容式觸控螢幕技術 5 2.1.3 波動式觸控螢幕技術 6 2.2 多點式觸控螢幕技術 8 2.2.1 投影電容式多點觸控技術 8 2.2.2 感測器陣列式多點觸控技術 9 2.2.3 電腦視覺式多點觸控技術 10 2.2.4 由單點式觸控螢幕改良 12 2.3 觸控軟體設計相關研究 13 第三章 雙攝影機視覺式雙點觸控技術 17 3.1 構想 17 3.2 硬體設備及安裝 18 3.3 觸控偵測和定位演算法 20 3.3.1 影像前處理 22 3.3.2 觸碰物偵測 26 3.3.3 廣角鏡頭校正與角度計算 27 3.3.4 觸控點定位 29 3.3.5 假觸控點問題 29 3.3.6 觸控點追蹤 30 3.3.7 平滑觸控點軌跡 32 3.3.8 更新背景 33 第四章 觸控軟體設計 34 4.1 映射觸控操作到滑鼠 34 4.2 觸控資料傳輸 35 4.3 觸控手式定義 36 第五章 系統實作與實驗 38 5.1 實驗設備與開發環境 38 5.2 觸控操作映射滑鼠操作實驗 39 5.3 觸控手式操作實驗 42 5.4 觸控效能測試實驗與分析 42 5.4.1 Fitts’ Law 42 5.4.2 實驗方法 44 5.4.3 實驗數據與分析 45 第六章 結論與未來方向 51 6.1 結論 51 6.2 未來方向 52 參考文獻 53

    [1] GroovyTechnology Corp., "4-Wire Resistive Touch Screen." [Online]. Available: http://www.gtouch.com.tw/dm/Gtouch_Resistive_DM_2008Oct.pdf
    [2] "電容觸碰屏驅動原理" [Online]. Available: http://bbs.meizu.com/attachment.php?aid=217398&k=16df26ed18ddce53847e2f90407235df&t=1234354241
    [3] GroovyTechnology Corp., "IR Add-On Touch Screen." [Online]. Available: http://www.gtouch.com.tw/dm/Gtouch_IR_DM_2008Oct.pdf
    [4] GroovyTechnology Corp., "Surface Acoustic Wave Touch Screen." [Online]. Available: http://www.gtouch.com.tw/dm/Gtouch_SAW_DM_2008Oct.pdf
    [5] "3M MicroTouchTM DST Touch System." [Online]. Available: http://solutions.3m.com/wps/portal/3M/en_US/3MTouchSystems/TS/Solutions/TouchScreens/DispersiveSignal/
    [6] "Apple iPhone." [Online]. Available: http://www.apple.com/iphone/technology/
    [7] P. Dietz and D. Leigh, "Diamondtoucn: a multi-user touch technology," in UIST''01: Proceedings of the 14th annual ACM symposium on User interface software and technology. New York, NY, USA: ACM, 2001, pp. 219-226.
    [8] S. Hodges, S. Izadi, A. Butler, A. Rrustemi and B. Buxton, "ThinSight: Versatile Multi-touch Sensing for Thin Form-factor Displays," in UIST''07: Proceedings of the 20th ACM symposium on User interface software and technology. Newport, Rhode Island, USA: ACM, 2007, pp. 259-268.
    [9] "Microsoft surface." [Online]. Available: http://www.microsoft.com/surface/
    [10] J. Y. Han, "Low-cost multi-touch sensing through frustrated total internal reflection," in UIST''05: Proceedings of the 18th ACM symposium on User interface software and technology. Seattle, Wahington, USA: ACM, 2005, pp. 115-118.
    [11] Chi-Ho Yeung, Man-Wa Lam, Hon-Ching Chan and Oscar C. Au, "Vision-Based Hand Gesture Interactions for Large LCD-TV Display Tabletop Systems," in PCM''08: Proceedings of the 9th Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing, pp. 89-98.
    [12] Z. Mo, J.P. Lewis and U. Neumann, "SmartCanvas: A Gesture-Driven Intelligent Drawing Desk System," in IUI''05: Proceedings of ACM symposium on Intelligent User Interfaces. San Diego, CA, USA: ACM, 2005, pp. 239-243.
    [13] N. Matsushita, Y. Ayatsuka and J. Rekimoto, "Dual Touch: A Two-Handed Interface for Pen-Based PDAs," in UIST''00: Proceedings of the 13th ACM symposium on User interface software and technology. San Diego, CA, USA: ACM, 2000, pp. 211-212.
    [14] J. Loviscach, "TwoFinger Input with a Standard Touch Screen," in UIST''07: Proceedings of the 20th ACM symposium on User interface software and technology. Newport, Rhode Island, USA: ACM, 2007, pp. 169-172.
    [15] F. Echtler and G. Klinker, "A Multitouch Software Architecture," in NordiCHI 2008: Using Bridges, 18-22 October, Lund, Sweden: ACM.
    [16] "Open Sound Control." [Online]. Available: http://opensoundcontrol.org/
    [17] "TUIO." [Online]. Available: http://www.tuio.org/
    [18] J. O. Wobbrock, M. R. Morris and A. D. Wilson, "User-Defined Gestures for Surface Computing," in CHI 2009, April 4-9, 2009, Boston, Massachusetts, USA: ACM, pp. 1083-1092.
    [19] S. Webel, J. Keil and M. Zoellner, "Multi-touch Gestural Interaction in X3D using Hidden Markov Models," in VRST''08, October 27-29, 2008, Bordeaux, France: ACM, pp. 263-264.
    [20] A. Olwal, S. Feiner and S. Heyman, "Pubbing and Tapping for Precise and Rapid Selection on Touch-Screen Displays," in CHI 2008, April 5-10, 2008, Florence, Italy: ACM, pp. 295-304.
    [21] J. Matejka, T. Grossman, J. Lo and G. Fitzmauric, "The Design and Evaluation of Multi-Finger Mouse Emulation Techniques," in CHI 2009, April 4-9, 2009, Boston, Massachusetts, USA: ACM, pp. 1073-1082.
    [22] "Distortion." [Online]. Available: http://toothwalker.org/optics/distortion.html
    [23] 吳啟豪,包蒼龍, "紅外線多點觸控系統之模擬與實現." [Online.] Available: http://eboard.cse.ttu.edu.tw/thesis/dldoc.php?id=608
    [24] Paul M. Fitts, "The information capacity of the human motor system in controlling the amplitude of movement," in Journal of Experimental Psychology, vol. 47, no. 6, June 1954, pp.381-391.
    [25] Paul. M. Fitts and James R. Peterson, "Information capacity od discrete motor responses," in Journal of Experimental Psychology, 67(2):103-112, February 1964.
    [26] "Fitts'' Law." [Online]. Available: http://en.wikipedia.org/wiki/Fitts%27s_law

    QR CODE
    :::