跳到主要內容

簡易檢索 / 詳目顯示

研究生: 黃煒婷
Wei-Ting Huang
論文名稱: 醫療用虛擬實境人機介面發展與應用研究
The Study of Development and Application in human-machine interface for medical virtual reality
指導教授: 賴景義
Jiing-Yih Lai
口試委員:
學位類別: 碩士
Master
系所名稱: 工學院 - 機械工程學系
Department of Mechanical Engineering
畢業學年度: 99
語文別: 中文
論文頁數: 102
中文關鍵詞: 醫學影像立體顯像空間定位虛擬實境
外文關鍵詞: Medical image, Stereo display, three-dimensional positioning device technology, Virtual reality
相關次數: 點閱:11下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 現今電腦斷層(Computed Tomography, CT )影像於臨床診斷之應用已相當廣泛,一組序列式CT影像能夠提供病患身體的真實三維狀況,但受限於目前硬體顯示介面,僅能將三維影像轉換為二維才能夠由二維螢幕輸出並顯示。雖然三維成像的影像已可以提供給使用者大略的立體感,但對於醫學領域的使用仍稍嫌不足,不足的主因是無法給予使用者真實的立體感。本研究之研究針對CT影像的顯示,利用立體渲染法將其重建為三維影像,並配合虛擬實境的原理以及搭配立體顯像設備,將傳統的2D醫學影像以3D立體的方式呈現;再針對不同的硬體設備包含資訊手套和空間定位裝置做性能測試,並配合空間定位技術以及相對應的人機介面,共同搭配組合成不同的功用,建構出一套基本的醫療用虛擬實境互動系統,並應用於不同的術前評估範例當中,分別為腦血管病變範例以及骨盆骨折範例。


    Computed Tomography (CT) technology has been extensively used in daily clinical diagnosis as it can provide a series of 2D scans of the human body. However, due to the limitation of cheaper but efficient PC-based software, current diagnosis of CT images is always performed in terms of two-dimensional display. Although three-dimensional imaging technology is available and can offer more realistic display of the images, it is still insufficient for medical applications as the display is still in a two-dimensional mode. The purpose of this study is to develop a human-machine interface for medical virtual reality. We employ volume rendering and stereo display techniques for the display of medical images in a stereo manner. We also integrate data glove and six DOF positioning tracker for providing a virtual reality system for medical applications. We intend to integrate such devices into our software and develop appropriate human-machine interface so that we can manipulate real and virtual objects together. We employ this system to cerebrovascular disease diagnosis and preoperative evaluation of pelvic fracture for demonstrating its capability.

    第一章 緒論 1 1.1 研究背景與動機 1 1.2 文獻回顧 2 1.2.1 虛擬實境在教育訓練上的相關研究 3 1.2.2 虛擬實境在醫學領域上的發展與相關研究 4 1.3 研究目的 9 1.4 研究方法 9 1.5 論文架構 11 第二章 硬體設備整合 13 2.1 前言 13 2.2 虛擬實境硬體組成 13 2.3 空間定位器 15 2.3.1 WinTracker 15 2.3.2 3DGuidance trakSTAR 16 2.3.3 訊號分析與比較 20 2.4 資訊手套 44 2.5 投影裝置 48 2.5.1 頭戴式顯示器 48 2.5.2 3DVision之LCD螢幕 48 第三章 立體影像顯示與空間定位技術 51 3.1 前言 51 3.2 立體視覺技術 51 3.2.1 產生視差影像 52 3.2.2 色彩轉化技術 52 3.2.3 OpenGL四重緩衝技術 52 3.2.4 透視投影技術 55 3.3 空間定位技術 59 3.3.1 空間定位器座標系 59 3.3.2 座標轉置矩陣 TDCS ? WCS 60 3.3.3 攝影機座標轉置矩陣 63 3.3.4 範例與討論 64 第四章 系統整合及範例應用 71 4.1 前言 71 4.2 系統整合 71 4.3 腦血管病變診斷立體顯示與操作範例 73 4.3.1 腦血管病變診斷與操作流程規劃 75 4.3.2 頭殼分析與移除 79 4.4 骨盆骨折診斷立體顯示與操作範例 84 4.4.1 骨盆骨折診斷與操作流程規劃 85 4.4.2 運用Tracker與Glove進行模擬復位 88 4.4.3 運用Tracker與Glove進行植入物模擬放置 91 4.4.4 虛擬復位模擬操作流程 94 4.5 小結 95 第五章 結論與未來展望 97 5.1 結論 97 5.2 未來展望 98 參考文獻 99

    [1] S. Randy and M. Thomas, “Computers and virtual reality for surgical education in the 21st century”, Archives of Surgery, Vol. 135, pp. 768-792, 2000.
    [2] A. H. Meier, C. L. Rawn and T. M. Krummel, “Virtual reality: surgical application-challenge for the new millennium” , J Am Coll Surg, Vol. 192, No. 3, pp. 372-384, 2001.
    [3] G. Ahlberg, T. Heikkinen, L. Iselius, C. E. Leijonmarck, J. Rutqvist and D. Arvidsson1, “Does training in a virtual reality simulator improve surgical performance?”, Springer-Verlag New York, Inc., 2001.
    [4] A. Chaudhry, C. Suttont, J. Wood, R. Stonet and R. McCloy, “Learning rate for laparoscopic surgical skills on MIST VR, a virtual reality simulator: quality of human-computer interface”, Ann R Coll Surg Engl, Vol. 81, pp. 281-286, 1999.
    [5] D. M. Wilhelm, K. Ogan, C. G. Roehrborn, J. A. Cadeddu and M. S. Pearle, “Assessment of basic endoscopic performance using a virtual reality simulator”, J Am Coll Surg, Vol. 195, pp. 675-681, 2002.
    [6] J. B. Prystowsky, G. Regehr, D. A. Rogers, J. P. Loan, L. L. Hiemenz and K. M. Smith, “A virtual reality module for intravenous catheter placement”, Am. J. Surg., Vol. 177, pp. 171-175, 1999.
    [7] J. Shah and A. Darzi, “Virtual reality flexible cystoscopy: a validation study”, BJU Int, Vol. 90, pp. 828-832, 2002.
    [8] P. Milgram, “A taxonomy of mixed reality visual displays”, IEICE Transactions on Information Systems, Vol. E77-D, No. 12, 1994.
    [9] K. D. Hopper, A. Tunclyriboz, S. W. Wise, J. D. Neuman, D. T. Mauger and C. J. Kasales, “Mucosal detail at CT virtual reality: surface versus volume rendering”, Radiology, Vol. 214, pp. 517-522, 2000.
    [10] G. Szekely, “Virtual reality-based simulation of endoscopic surgery”, Presence, Vol. 9, No. 3, pp. 310-333, 2000.
    [11] C. Basdogan, C. H. Ho, M. A. Srinivasan, S. D. Small and S. L. Dawson, “Force interactions in laparoscopic simulations: haptic rendering of soft tissues”, Medicine Meets Virtual Reality, pp. 385-391, 1998.
    [12] A. Radetzky, A.Nuk mberger, M. Teistler and D. P. Pretschner, “Elastodynamic shape modeling in virtual medicine”, Master Thesis, Technical University of Braunschweig, 1999.
    [13] S. Cotin, H. Delingette and N. Ayache, “Efficient linear elastic models of soft tissues for real-time surgery simulation”, Technique Report TR-98-3510, Institut National de Recherche en Informatique et en Automatique (INRIA), 1998.
    [14] J. Marescaux, J. M. Clament, V. Tassetti, C. Koehl, S. Cotin, Y. Russier, D. Mutter, H. Delingette and N. Ayache, “Virtual reality applied to hepatic surgery simulation: the next revolution”, Annals of surgery, Vol. 228, No. 5, pp. 627-634, 1998.
    [15] M. Wierzbicki, M. Drangova, G. Guiraudon and T. Peters, “Validation of dynamic heart models obtained using non-linear registration for virtual reality training, planning, and guidance of minimally invasive cardiac surgeries”, Medical Image Analysis, Vol. 8, pp. 387-401, 2004.
    [16] N. Ayache, “Medical computer vision, virtual reality and robotics”, Image and Vision Computing, Vol. 13, No. 4, pp. 295-313, 1995.
    [17] R. M. Satava, “Medical applications of virtual reality”, Journal of Medical Systems, Vol. 19, No. 3, 1995.
    [18] S. A. Cover, N. F. Ezquerra, J. F. O’Brien, R. Rowe, J. Gadacz and E. Palm, “Interactively deformable models for surgery simulation”, IEEE Computer Graphics & Applications, Vol. 13, No. 6, pp. 68-75, 1993.
    [19] U. Ecke, L. Klimek and W. Mann, “Virtual reality: preparation and execution of sinus surgery”, Computer Aided Surgery, Vol. 3, No. 1, pp. 45-50, 1998.
    [20] S. Gibson, J. Samosky, A. Mor, C. Fyock and E. Grimson, “Simulating arthroscopic knee surgery using volumetric object representations, real-time volume rendering and haptic feedback”, CVRMed, pp. 369-378, 1997.
    [21] S. Gibson, C. Fyock, E. Grimson, T. Kanade, R. Kikinis, H. Lauer, N. McKenzie, A. Mor, S. Nakajima, H. Ohkami, R. Osborne, J. Samosky and A. Sawada, “Volumetric object modeling for surgical simulation”, Medical Image Analysis, Vol. 2. No. 2, pp. 121-132, 1998.
    [22] J. Marescaux, J. M. Clement, V. Tassetti, C. Koehl, S. Cotin, Y. Russier, D. Mutter, H. Delingette and N. Ayache, “Virtual reality applied to hepatic surgery simulation: the next revolution”, Annals of Surgery, Vol. 228, No. 5, pp. 627-634, 1998.
    [23] M. N. Dinsmore, G. Langrana, G. Burdea and J. Ladeji, “Virtual reality training simulation for palpation of subsurface tumors”, In Proceedings of the IEEE 1997 Virtual Reality Annual International Symposium, pp. 54-60, 1997.
    [24] A. H. Meier, C. L. Rawn and T. M. Krummel, “Virtual reality: surgical application- challenge for the new millennium”, J Am Coll Surg, Vol. 192, pp. 372-84, 2001.
    [25] U. G. Kühnapfel, “CAD-based simulation and modeling for endoscopic surgery”, Proceedings SMIT''94, pp. 1-4, 1994.
    [26] U. G. Kühnapfel, “Endosurgery simulations with KISMET : a flexible tool for surgical instrument design, operation room planning and VR technology based abdominal surgery training”, Proceedings VR''95 World Conference, pp. 21-23, 1995.
    [27] H. K. Çakmak and U. Kühnapfel, “Animation and simulation techniques for VR-training systems in endoscopic surgery”, Interlaken/Switzerland, Vol. 21, No. 22, pp. 173-185, 2000.
    [28] U. G. Kühnapfel, H. K. Çakmak and H. Maass, “Endoscopic surgery training using virtual reality and deformable tissue simulation”, Computers & Graphics, Vol. 24, pp. 671-682, 2000.
    [29] Maelstrom Virtual Productions Ltd, Medical Applications, January 2003, http://www.maelstrom.com/queens.htm.
    [30] Mentice Corporation, Mentice Medical Simulation, January 2003, http://mentice.com/.
    [31] Human Interface Technology Lab., Homepage, January 2003,http://www.hitl.washington.edu/projects/suturesim/.
    [32] 羅賴均,「醫學影像之三維顯示與骨組織三角網格重建技術探討」,國立中央大學機械工程學系碩士論文,2009。
    [33] 俞首安,「電腦輔助骨盆骨折術前評估系統發展」,國立中央大學機械工程學系碩士論文,2010。

    QR CODE
    :::