跳到主要內容

簡易檢索 / 詳目顯示

研究生: 黃孟仁
Meng-Jen Huang
論文名稱: 整合影像操作與觸控手勢的HMI控制器設計與實作
Design and Implementation of HMI Controller integrating Image Manipulation and Touch Gesture
指導教授: 陳慶瀚
Ching-Han Chen
口試委員:
學位類別: 碩士
Master
系所名稱: 資訊電機學院 - 資訊工程學系在職專班
Executive Master of Computer Science & Information Engineering
畢業學年度: 100
語文別: 中文
論文頁數: 85
中文關鍵詞: 觸控手勢影像操作
外文關鍵詞: Touch Gesture, HMI, Image Manipulation
相關次數: 點閱:18下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 在現今人機互動的系統中,觸控手勢和即時影像操作,如影像的平移、縮放及旋轉,已經漸漸成為必備的功能。而目前這些運算主要都是透過後端的中介軟體來實現,這將會加佔用更多的系統資源,並不適合要求即時且資源有限的嵌入式系統。本研究提出一個整合觸控與即時影像操作的人機互動介面控制器。
    對於即時的影像處理,使用CORID(COrdinate Rotation DIgital Computer)計算器來取代原本複雜的三角函數計算,並使用雙立方模板插補(bicubic spline)演算法進行影像的插補工作,再透過顯示控制器呈現在LCD上,最後整合智慧型即時手勢辨識控制器。
    我們以MIAT方法論將其演算法整合為一個全硬體化的人機互動介面控制器,於FPGA(Field Programmable Gate Array)平台進行硬體驗證,並使用管線化(pipeline)架構設計硬體電路來提高系統效能。實驗分析的結果顯示,影像操作的處理速度較軟體執行來的快,適用於嵌入式系統及可攜式電子產品。


    In today''s human-machine interaction(HMI) systems, the touch gestures and the real-time image manipulation , such as image translation, scaling and rotating, have became the must-have features. These operations conventionally are implemented through the embedded
    middleware of back-end system. This software''s solution is not suitable for real-time requirements and limited resources of embedded systems because of consuming too much system resources, so in this study, we design a high efficient hardwired HMI controller integrating the image manipulation and touch gesture. We implement a CORDIC processor for the complex trigonometric calculations, and a bicubic spline accelerator for real-time image interpolation. Finally, we integrate the touch gesture controller with real-time gesture
    recognition engine. The hardwired controller is realize by using MIAT embedded hardware design methodology and verified on a FPGA platform. In the experiments, the proposed controller provide the better performance of the image manipulation than the software’s solution, which is suitable for power-aware , low-cost embedded system and portable electronic products.

    摘要 I Abstract II 致謝 III 目錄 IV 圖目錄 VI 表目錄 IX 第一章、緒論 2 1.1 研究動機與目標 2 1.2 研究內容與系統架構 3 1.3 論文架構 3 第二章、LCD顯示/觸控人機互動 4 2.1 LCD顯示原理 4 2.1.1 TFT-LCD控制器 5 2.1.2 時序控制器 6 2.2 觸控原理 9 2.2.1 觸控面板技術 10 2.2.2 基於觸控的人機互動 11 2.3 觸控手勢辨識 14 2.3.1 觸控手勢訊號前處理 15 2.3.2 手勢特徵擷取(feature extraction) 19 2.3.3 手勢辨識分類器 21 2.4 即時手勢辨識控制器 22 2.5 結合LCD顯示與觸控的人機互動控制器架構 23 第三章、即時影像幾何轉換 25 3.1 快速影像插補方法 25 3.2 雙立方影像插補 29 3.2.1 原始雙立方插補法 29 3.2.2 雙立方模板(bi-cubic spline)插補法 31 3.3 影像旋轉及CORDIC計算器 34 3.4 LCD顯示的即時影像操作 37 第四章、硬體實作 40 4.1 硬體合成方法論 40 4.2 即時影像縮放/旋轉控制器設計 42 4.2.1 幾何重建模組 42 4.2.2 CORDIC計算器 47 4.2.3 影像平移模組 49 4.2.4 影像插補模組 52 4.3 管線化系統架構設計 54 第五章、顯示/觸控系統整合與驗證 57 5.1 實驗平台 58 5.2 液晶顯示模組控制器 61 5.3 實驗分析 62 第六章、結論與未來展望 69 6.1 結論 69 6.2 未來展望 70 參考文獻 71

    [1] 拓墣產業研究所,"2011觸控面板需求漲3成",[Online].Avalialbe:http://www.teema.org.tw/industry-information-detail.aspx?infoid=1482
    [2] Ching-Han Chen and Jia-Hong Dai,"Design and High-Level Synthesis of Discrete-Event Controller",National Conference of Automatic Control and Mechtronics System.Taiwan,R.O.C.,pp.75-80,2002
    [3] 周立笙,"整合及時手勢辨識的智慧型觸控控制器",中央大學資訊工程系碩士學位論文,2011
    [4] 張廖元超,"智慧型高畫質視訊縮放器的設計與實作",中央大學資訊工程系碩士學位論文,2010
    [5] Apple iPhone,[Online].Avalialbe:http://www.apple.com/iphone/technology/
    [6] F. Echtler and G. Klinker, "A Multitouch Software Architecture," in NordiCHI 2008: Using Bridges,18-22 October,Lund,Sweden:ACM
    [7] "Open Sound Control." [Online]. Available:http://opensoundcontrol.org/
    [8] "TUIO." [Online]. Available:http://www.tuio.org/
    [9] J. O. Wobbrock, M. R. Morris and A. D. Wilson,"User-Defined Gestures for Surface Computing" in CHI 2009, April 4-9, 2009, Boston,Massachusetts
    [10] S. Webel, J. Keil and M. Zoellner, "Multi-touch Gestural Interaction in X3D using Hidden Markov Models," in VRST''08, October27-29, 2008, Bordeaux,France:ACM,pp.263-264
    [11] A. Olwal, S. Feiner and S. Heyman, "Pubbing and Tapping for Precise and Rapid Selection on Touch-Screen Displays," in CHI 2008, April 5-10, 2008, Florence, Italy: ACM, pp. 295-304.
    [12] J. Matejka, T. Grossman, J. Lo and G. Fitzmauric, "The Design and Evaluation of Multi-Finger Mouse Emulation Techniques," in CHI 2009, April 4-9,2009, Boston, Massachusetts, USA: ACM, pp. 1073-1082.
    [13] "Apple Wins Strategic Multitouch & Music Tempo Workout Patents", [Online]. Available: http://www.patentlyapple.com/patently-apple/2010/04/ apple-wins-strategic-multitouch-music-tempo-workout-patents.html
    [14] T.N.E. Greville, "Theory and Application of Spline Functions",New York:Academic,1969.
    [15] A. Bobick,J.Davis,"The recognition of human movement using temporal templates",IEEE Trans. Pattern Anal.Mach.Intell.,Volume 23,No.3,pp.257-267,2001
    [16] Y.A. Pan, “Automatic Facial Expression Recognition System in Low Resolution Image Sequence”, Master Thesis, National Cheng Kung University, Department of Computer Science and Information Engineering, page 33-34, 2004
    [17] R.C. Gonzalez, R.E. Woods, 繆紹綱編譯,2006,數位影像處理,培生教育出版集團
    [18] R.C. Gonzalez, R.E. Woods,1992,Digital Image Processing, Addison-Wesley.
    [19] M.K. Hu,“Visual pattern recognition by moment invariants”, IEEE Trans. Information Theory, Volume 8, pp.179-187,1962
    [20] Zaknich, "Introduction to the Modified Probabilistic Neural Network for General Signal Processing Applications", IEEE Trans. On Signal Processing, Volume 46. No. 7, pp. 1980-1990.
    [21] D. F. Specht, "Probabilistic Neural Networks (original contribution)", Neural Networks, Volume 3, No.1, pp.109-118,1990.
    [22] N. Shezaf et al, “Adaptive Low Complexity Algorithm for Image Zooming at Fractional Scaling Ratio,” Proceedings of the 21st IEEE Convention of the Electrical and Electronic Engineers in Israel, pp. 253-256, Israel, April 2000.
    [23] R. Prodan, “Multidimensional Digital Signal Processing for Television Scan Conversion,” Philip Journal of Research, vol. 41, no. 6, pp. 576–603, 1986.
    [24] A. Nguyen and E. Dubois, “Spatio-Temporal Adaptive Interlaced To Progressive Conversion,” Proc. Int. Workshop on HDTV, pp. 2–5, Nov. 1992.
    [25] H. Rantanen, M. Karlsson, P. Pohjala. and S. Kalli, “Color Video Signal Processing with Median Filters”, IEEE Transactions on Consumer Electronics, Vol. 38, No. 3, pp. 1–4, August 1992
    [26] H. B. KWON et al. “ Pseudomedian character for de-Interlacing Scan conversion,” Journal of Korea telecommunication society, Vol. 21, No. 1, pp. 1151-1171, 1996.
    [27] D.B. Carl, “ Bicubic Spline Interpolation ”, Journal of Mathematics and Physics, Vol. 41, pp. 212-218, 1962
    [28] Ching-Han Chen, Jia-Hong Dai, and Chen-Yuan Chen, “The Design and Synthesis Using Hierarchical Robotic Discrete-Event Modeling,” Journal of Vibration and Control, 2012.
    [29] Mayer, R.J., “IDEF0 Function Modeling,” Air Force Systems Command, May , 1992.
    [30] Ching-Han Chen, Chia-Ming Kuo, Chen-Yuan Chen and Jia-Hong Dai,
    "The design and synthesis using hierarchical robotic discrete-event
    modeling". Journal of Vibration and Control, 2012

    QR CODE
    :::