| 研究生: |
蘇家漢 Jia-Han Su |
|---|---|
| 論文名稱: |
設計與實作多人多點觸控系統之研究 The Study of Designing a Multi-user and Multi-touch Computing System |
| 指導教授: |
黃武元
Wu-Yuin Hwang |
| 口試委員: | |
| 學位類別: |
博士 Doctor |
| 系所名稱: |
資訊電機學院 - 資訊工程學系 Department of Computer Science & Information Engineering |
| 畢業學年度: | 100 |
| 語文別: | 英文 |
| 論文頁數: | 111 |
| 中文關鍵詞: | 設計與實作多人多點觸控系統之研究 |
| 外文關鍵詞: | The Study of Designing a Multi-user and Multi-to |
| 相關次數: | 點閱:8 下載:0 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
近年來,人機互動介面的領域已經廣泛此採用了多點觸控技術。但這項技術除了改善人機之間的互動之外,作者還發現它有更大的潛能將此技術推廣到在人們做面對面溝通與合作的輔助平台,用來改善人與人之間的互動。為了完成這樣的系統,這篇研究設計和實作了一個支援多人多點觸控的運算系統,這系統一共包含了三層的軟體堆疊,從底層到最上層的分別是: 1.多點觸控的追蹤演算法、2. 支援多人多點互動的應用程式開發介面,和3.應用程式。在多點觸控追蹤演算法方面,作者使用了OpenCL的運算模型來實作針對GPU最佳化的演算法,以提高運算的速度與品質,並將這套軟體命名為diTouch。結果顯示diTouch即使在處理百萬像素的解析度下,也擁有每秒五十格以上的處理速度,在相同的測試環境下比知名的Open Source 專案TouchLib還快五到七倍。除了速度之外,作者還加入了以像素為單位的臨界值查表法(threshold map)、二維條碼追蹤,和手指中心位置偵測等技術來增加辨識的精準度。更重要的是現代的作業系統並沒有支援在單一螢幕下的多人使用情境。為了克服這樣的困難,作者在Java Swing的基礎之上,用OpenGL改寫整個UI的底層繪圖系統,來支援可自由旋轉,和多重鎖定的視窗功能,讓使用者介面針對多人多點互動最佳化,並命名Surface Application Framework (SAF)。並且基於這樣的架構開發了多套的應用程式,證實這樣的系統是可行的。最後,作者基於這套系統的研究經驗,提出多個可行的改善方案,包括子像素(sub-pixel)精準度的演算法、使用者辨識和以HTML5為基礎的應用程式開發介面,來改善應用程式開發環境和使用者經驗。
Recently, the multi-touch technology has become widely available for human-computer interaction. We found it has a great potential to facilitate more awareness of human-to-human interaction than conventional computers in co-located collaborative work. To complete such a computing system, this study builds three layers of software stack; they are multi-touch tracking layer, multi-touch and multi-user-supported UI framework layer, and applications layer. In the multi-touch tracking layer, this study proposes a novel GPU computing framework, name diTouch for robust multi-touch tracking. It utilizes the OpenCL programming model benefited greatly from GPU. The results of the test showed that diTouch promises to have more than 50 frames process speed per second on million pixels image sequence, which is 5 to 7 times faster than that of optimized CPU implementation. Besides the speed, more features, like recursive and symmetric highpass-filter, threshold map and, 2D tag detection, hand detection and fingertip locating are investigated in the proposed system. Moreover, co-located interactions rarely been concerned by other studies, is also being explored. Therefore, the user interface framework, namely Surface Application Framework (SAF), is designed to support multi-touch and multi-user applications on the proposed computing system. Finally, this study suggests some future improvements of the propose system, like sub-pixel precision tracking, three dimensions CSCW design approaches, user recognition and novel HTMl5 based UI framework.
Alexander Kharlamov and Victor Podlozhnyuk. (2007). “Image Denoising,” Tech. Rep., NVIDIA, Inc.
Baudisch, P., Cutrell, E., Robbins, D., Czerwinski, M., Tandler, P., Bederson, B. (2003). Drag-and-pop and drag-and-pick: Techniques for accessing remote screen content on touch-and pen-operated systems. Paper presented at the Proc. Interact.
Bernsen, J. (1986). "Dynamic thresholding of grey-level images," in Proc. 8th ICPR, pp. 1251-1255.
Buxton, B. (2007). Multi-touch systems that I have known and loved, Microsoft Research,.
Carroll, J. M., Rosson, M. B., Convertino, G., & Ganoe, C. H. (2006). Awareness and teamwork in computer-supported collaborations. Interacting with Computers, 18(1), 21-46.
Chittaro, L., & Ranon, R. (2007). Web3D technologies in learning, education and training: Motivations, issues, opportunities. Computers & Education, 49(1), 3-18.
Collomb, M., Hascoet, M., Baudisch, P., & Lee, B. (2005). Improving drag-and-drop on wall-size displays. Paper presented at the Proceedings of Graphics Interface 2005, 25-32.
Dietz, P. H., & Eidelson, B. D. (2009). SurfaceWare: Dynamic tagging for Microsoft surface. Paper presented at the Proceedings of the 3rd International Conference on Tangible and Embedded Interaction, 249-254.
Dietz, P., & Leigh, D. (2001). DiamondTouch: A multi-user touch technology. Proceedings of the 14th Annual ACM Symposium on User Interface Software and Technology, 219-226.
Dongen, S. V. (2000). MCL - a cluster algorithm for graphs. Analysis. Retrieved from http://www.micans.org/mcl/
Dourish, P.; Bellotti, V. (1992). "Awareness and coordination in shared workspaces". Proceedings of the 1992 ACM conference on Computer-supported cooperative work. ACM Press New York, NY, USA. pp. 107-114.
Evans, M. A., Rick, J., Horn, M., Shen, C., Mercier, E., McNaughton, J., Higgins, S., Burd, E., Tissenbaum, M., Lui, M., Slotta, J. D., Martinez Maldonado, R. and Clayphan, A. (2012). Interactive surfaces and spaces: A learning sciences agenda. In Proceedings of ICLS 2012, volume 2, pages 78–85. ISLS.
Gutwin, C., & Greenberg, S. (2004). The importance of awareness for team cognition in distributed collaboration. In E. Salas & S. M. Fiore (Eds.), Team cognition: Understanding the factors that drive processes and performance (pp. 177–201). Washington: APA Press.
Han, J. Y. (2005). Low-cost multi-touch sensing through frustrated total internal reflection. Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology, 115-118.
Harold W. Kuhn, "The Hungarian Method for the assignment problem", Naval Research Logistics Quarterly, 2:83–97, 1955. Kuhn''s original publication.
Hawick, K. Leist, A. and Playne, D. (2009). "Parallel graph component labelling with gpus and cuda," Preprint Submitted to Parallel Computing.
Homans, George C. (1958). "Social Behavior as Exchange". American Journal of Sociology 63 (6): 597-606.
Hornecker, E., Marshall, P., Dalton, N. S., & Rogers, Y. (2008). Collaboration and interference: Awareness with mice or touch input. Paper presented at the Proceedings of the ACM 2008 Conference on Computer Supported Cooperative Work, 167-176.
Intel Inc. (2009). "Open Source Computer Vision," The OpenCV Open Source Computer Vision Library, vol. 2009, 24 November.
Ishii, H. (1990). TeamWorkStation: Towards a seamless shared workspace. Paper presented at the Proceedings of the 1990 ACM Conference on Computer-Supported Cooperative Work, 13-26.
Izadi, S. Agarwal, A. Criminisi, A. Winn, J. Blake, A. Fitzgibbon, A. (2007), "C-Slate: A Multi-Touch and Object Recognition System for Remote Collaboration using Horizontal Surfaces", Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems, pp. 3–10, October 2007.
Jezek2. (2009/4/4). JBullet - java port of bullet physics library. Retrieved 5/13, 2009, from http://jbullet.advel.cz/
Jie Zhu and Jie Yang. 2002. Subpixel Eye Gaze Tracking. In Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition (FGR ''02). IEEE Computer Society, Washington, DC, USA, 131-.
Kaltenbrunner, M., & Bencina, R. (2007). reacTIVision: A computer-vision framework for table-based tangible interaction. Paper presented at the Proceedings of the 1st International Conference on Tangible and Embedded Interaction, 69-74.
Kaltenbrunner, M., Bovermann, T., Bencina, R., & Costanza, E. (2005). TUIO: A protocol for table-top tangible user interfaces. Paper presented at the Proc. of the the 6th Int’l Workshop on Gesture in Human-Computer Interaction and Simulation.
Kruger, R., Carpendale, S., Scott, S. D., & Greenberg, S. (2003). How people use orientation on tables: Comprehension, coordination and communication. Paper presented at the Proceedings of the 2003 International ACM SIGGROUP Conference on Supporting Group Work, 369-378.
Mazalek, A., Reynolds, M., & Davenport, G. (2006). TViews: An extensible architecture for developing multi-user digital media tables. Submitted to IEEE CG&A, Special Issue on Interacting with Digital Tabletops.
Morris, M.R., Fisher, D., and Wigdor, D. (2010). Search on Surfaces: Exploring the Potential of Interactive Tabletops for Collaborative Search Tasks. Information Processing and Management, Spring 2010.
Morris, M. R., Huang, A., Paepcke, A., & Winograd, T. (2006). Cooperative gestures: Multi-user gestural interactions for co-located groupware. Proceedings of the 2006 SIGCHI Conference on Human Factors in Computing Systems, 1201-1210.
Moyer, P. S., Bolyard, J. J., & Spikell, M. A. (2002). What are virtual manipulatives?. Teaching Children Mathematics, 8(6), 372-377.
Munshi, A. (2009) "The OpenCL specification version 1.0," Khronos OpenCL Working Group, 2009.
NUI Group Community. (2009), "Touchlib: an opensource multi-touch framework," vol. 2009, 26 October.
NVidia, C. (2009). "CUDA Zone," vol. 2009, December 13.
Pinelle, D., Nacenta, M., Gutwin, C., & Stach, T. (2008). The effects of co-present embodiments on awareness and collaboration in tabletop groupware. Paper presented at the Proceedings of Graphics Interface 2008, 1-8.
Piper, A. M., O''Brien, E., Morris, M. R., & Winograd, T. (2006). SIDES: A cooperative tabletop computer game for social skills development. Proceedings of the 2006 20th Anniversary Conference on Computer Supported Cooperative Work, 1-10.
Rekimoto, J., & Matsushita, N. (1997). Perceptual surfaces: Towards a human and object sensitive interactive display. Workshop on Perceptual User Interfaces (PUI’97) , 30-32.
Rick, J., Rogers, Y., Haig, C., and Yuill, N (2009). Learning by doing with shareable interfaces. Children, Youth & Environments, 19(1),.
Rogers, Y., & Lindley, S. (2004). Collaborating around vertical and horizontal large interactive displays: Which way is best? Interacting with Computers, 16(6), 1133-1152.
Schoning, J., Brandl, P., Daiber, F., Echtler, F., Hilliges, O., Hook, J. (2008). Multi-touch surfaces: A technical guide Technical report, Technical University of Munich
Shen, C., Vernier, F. D., Forlines, C., & Ringel, M. (2004). DiamondSpin: An extensible toolkit for around-the-table interaction. Paper presented at the Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 167-174.
Thomson, A. M., Perry, J. L., & Miller, T. K. (2009). Conceptualizing and measuring collaboration. Journal of Public Administration Research and Theory, 19(1),23-56
Triona, L. M., & Klahr, D. (2003). Point and click or grab and heft: Comparing the influence of physical and virtual instructional materials on elementary school students'' ability to design experiments. Cognition and Instruction, 21(2), 149-173.
Tuddenham, P., & Robinson, P. (2007). Distributed tabletops: Supporting remote and mixed-presence tabletop collaboration. Horizontal Interactive Human-Computer Systems, 2007. TABLETOP''07. Second Annual IEEE International Workshop on, 19-26.
Tuddenham, P., & Robinson, P. (2009). Territorial coordination and workspace awareness in remote tabletop collaboration. Paper presented at the Proceedings of the 27th International Conference on Human Factors in Computing Systems, 2139-2148.
Van Dongen, S. (2000). A cluster algorithm for graphs. Report- Information Systems, (10), 1-40.
Vasconcelos, C.N and Rosenhahn, B., (2009). "Bipartite Graph Matching Computation on GPU," Energy Minimization Methods in Computer Vision and Pattern Recognition, vol. 5681, pp. 42-55.
Wilson, A. D. (2004). TouchLight: An imaging touch screen and display for gesture-based interaction. Proceedings of the 6th International Conference on Multimodal Interfaces, 69-76.
Wu-Yuin Hwang and Jia-Han Su. (2011)” The Study of Surface Computer Supported Cooperative Work and its Design, Efficiency and Challenge”, Interactive Learning Environment, 1-22, Jul 2011.
Xiph.Org. (2008/12/31). Theora video compression. Retrieved 5/31, 2009, from http://www.theora.org/
Zurita, G., & Nussbaum, M. (2004). Computer supported collaborative learning using wirelessly interconnected handheld computers. Computers & Education, 42(3), 289-314.