| 研究生: |
陳暐翔 Wei-hsiang Chen |
|---|---|
| 論文名稱: |
以單一攝影機實現單指虛擬鍵盤之功能 Virtual Keyboard Implementation Using Single Camera |
| 指導教授: |
鄭旭詠
Hsu-yung Cheng |
| 口試委員: | |
| 學位類別: |
碩士 Master |
| 系所名稱: |
資訊電機學院 - 資訊工程學系 Department of Computer Science & Information Engineering |
| 畢業學年度: | 99 |
| 語文別: | 中文 |
| 論文頁數: | 39 |
| 中文關鍵詞: | 虛擬鍵盤 |
| 外文關鍵詞: | Virtual Keyboard |
| 相關次數: | 點閱:15 下載:0 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
隨著科技的發展,人們漸漸習慣使用更人性化的科技產品,講求方便、直覺且容易操作的軟硬體設備。然而觸控式螢幕的日新月異,逐漸取代一般常見的輸入裝置,例如:滑鼠、鍵盤等等。除此之外,也開始有人用網路攝影機取像,並且以電腦視覺的方法分析,形成另一種的輸入裝置。
本論文提出一個以單一攝影機實現單指虛擬鍵盤之功能的系統,目的是希望能夠以網路攝影機取得並分析使用者輸入的行為,進而作為一種新式的輸入方式。首先我們利用霍夫曼直線偵測建立並且定位虛擬鍵盤,再利用背景相減取得手指和手指陰影的形狀,並將兩者分開以取得手指指尖移動的軌跡、方向、速度與手指陰影指尖的距離變化這幾項資訊來做一系列的分析和觸碰偵測;觸碰偵測部分我們分成了兩大類,第一類是手指陰影存在的情況,利用的是觸碰時指尖與手指陰影指尖距離變化的特性,第二類則是手指陰影不存在的情況,使用的方法是觀察指尖移動軌跡向量的變化和觸碰時指尖停留的特性來做觸碰偵測,最後再進行觸碰驗證與結果輸出。
在實驗部分,我們模擬了很多不同使用者的觸碰行為在數種不同的距離和不同的型式的虛擬鍵盤。實驗結果顯示,本論文提出的方法可以準確且有效地偵測不同使用者的輸入方式。
Due to the fast development of computer and video technologies, people are used to more humanized and convenient products. The touch screens are replacing other traditional input devices such as keyboards and mouse. Researchers have also been devoted themselves to designing new interfaces. Interfaces using webcams are one of the emerging interfaces.
This thesis presents a method to detect touches on a virtual keyboard using a single camera. We use a webcam to analyze fingertip touching actions. Firstly, we use hough transform to locate the virtual keyboard. Then, we separate the finger and the shadow to get the information such as trajectory, direction, speed and the distance between the fingertip and the shadow. Afterwards, we consider touches under two different conditions when shadow exists and shadow does not exist. We use the distance between the finger and the shadow to detect touches when shadow exists, and use the variation of trajectory and the time property to detect touches when shadow does not exist. Finally, we validate these touches by their locations and the frequency of touches.
Experimental results show that the proposed method provides a feasible way to detect touches on several kinds of the virtual keyboards with various camera distance settings. Moreover, the proposed method can be used in real-time applications.
[1] Celluon.Virtual Laser Keyboard-Magic Cube, EvoMouse.[Online]
Available:www.virtual-laser-keyboard.com/.
[2] Microsoft Xbox. Kinect.[Online]
Available:www.xbox.com/zh-TW/kinect.
[3] D. Duan, M. Xie, Q. Mo, Z. Han, Y. Wan, “An Improved Hough Transform for Line Detection,” Computer Application and System Modeling (ICCASM), 2010 International Conference, Vol. 2, pp. 354, 2010.
[4] S. Sarcar, S. Ghosh,P. K. Saha, D. Samanta, “Virtual Keyboard Design: State of the Arts and Research Issues,” Students'' Technology Symposium (TechSym) IEEE, pp. 289,2010.
[5] N. A. M. Isa, S.A. Salamah, U.K. Ngah.,“Adaptive Fuzzy Moving Kmeans Clustering Algorithm for Image Segmentation,” IEEE Transactions on Consumer Electronics, Vol. 55, pp. 2145-2153, 2009.
[6] K. L. Chung, Y. R. Lin, and Y. H. Huang, “Efficient shadow detection of color aerial images based on successive thresholding scheme,” IEEE Trans. On Geoscience and Remote Sensing, Vol. 47, no. 2, pp. 671-682, 2009.
[7] R. Cucchiara, C. Grana, “Improving shadow suppression in moving object detection with HSV color Information,”Proceedings of IEEE 2001 Conference on Intelligent Transportation Systems. Oakland, USA, 2001:334-339.
[8] H. Liu, C. Yang, X. Shu, Q. Wang, “A New Method of shadow detection based on edge information and HSV color information,” Power Electronics and Intelligent Transportation System (PEITS), 2009 2nd International Conference.
[9] Q. Zhu, S. Avidan, M. C. Yeh, K. T. Cheng, “Fast human detection using a cascade of histograms of oriented gradients,” in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2006, pp. 1491–1498.
[10] L. Jin, D. Yang, L. X. Zhen,J. C. Huang, “A novel vision based finger-writing character recognition system” Pattern Recognition, 2006. ICPR 2006. 18th International Conference,pp. 1104 – 1107.
[11] F. Quek, “Finger mouse: A freehand pointing interface. Proc. of International Workshop on Automatic Face and Gesture Recognition,” 1995, Zurich, Switzerlan.
[12] K. Oka, Y. Sato, H. Koike, “Real-time fingertip tracking and gesture recognition,” IEEE Comput. Graphics Appl., Vol. 22, no. 6, pp.64–71, Nov./Dec. 2002.
[13] S. Bi, D. Liang, X. Shen, Q. Wang, “Human Cast Shadow Elimination Method Based on Orientation Information Measures,” Automation and Logistics, 2007 IEEE International Conference, pp. 1567 – 1571.
[14] R. Cucchiara, C. Grana, M. Piccardi, A. Prati, “Detecting moving objects, ghosts and shadows in video streams,”IEEE Transactions on Pattern Analysis and Machine Intel., 25(10):1337–1342, 2005.
[15] S. Calderara, R. Melli, A. Prati, R. Cucchiara, “Reliable background suppression for complex scenes,” in Proceedings of the 4th ACM international workshop on Video surveillance and sensor networks, 2006, pp. 211–214.
[16] Z. W. Chen , Y. C. Lin, C.C. Chiang, “The design of a vision-based fingertip writing interface,” Proceedings of the IEEE International Conference on Pattern Recognition (ICPR).,Vol. 2, pp. 104-107, 2006.
[17] C.C. Hsieh, M.R. Tsai, M. C. Su,“A fingertip extraction method and its application to handwritten alphanumeric characters recognition,”Proceedings of the IEEE International Conference Signal Image Technology and Internet Based Systems, 293-300, 2008.
[18] J. F. Canny, “A computation approach to edge detection,” IEEE Trans. On Pattern Analysis and Machine Intelligence, 1986, Vol. 8, pp.679-698.
[19] R. O. Duda, P. E. Hart, D. G. Stork, Pattern Classification, 2nd Edition, Wiley, 2000, ISBN 978-0-471-05669-0