| 研究生: |
王昱偉 Yu-Wei Wang |
|---|---|
| 論文名稱: |
針對與運動比賽精彩畫面相關串場效果之偵測 Detecting Transition Logo for Sports Video Highlight Extraction |
| 指導教授: |
蘇柏齊
Po-Chyi Su |
| 口試委員: | |
| 學位類別: |
碩士 Master |
| 系所名稱: |
資訊電機學院 - 資訊工程學系 Department of Computer Science & Information Engineering |
| 畢業學年度: | 95 |
| 語文別: | 中文 |
| 論文頁數: | 58 |
| 中文關鍵詞: | 影片 、精彩畫面 、棒球 、串場效果 、慢動作 、運動 |
| 外文關鍵詞: | highlight, baseball, transition logo, transition effect, slow-motion, MPEG, video, sport |
| 相關次數: | 點閱:15 下載:0 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
觀賞運動賽事長久以來是一項重要的娛樂活動,而運動賽事的轉播也一直在電視節目中佔有相當大的比例。隨著數位錄影機的日益普及,許多無法即時欣賞比賽的觀眾會使用數位錄影機錄下賽事以隨後觀賞。考慮到運動比賽通常持續數小時,而比賽精華只佔其中的一部份,若能開發先進的數位錄影設備使其能夠自動地將觀眾感到有興趣的比賽精華部份擷取出來,將可為使用者帶來便利。
在現今的運動賽事轉播中,比賽精華片段會伴隨著慢動作重播,而轉播單位通常會在重播前後加上所謂串場效果以告知觀眾。我們在本論文中提出偵測與運動比賽精華相關之串場效果以達到比賽精華片段的擷取。我們的研究方法將直接處理經由數位廣播所傳來或由數位錄影機所錄製的MPEG串流,從MPEG串流中抽取及計算特徵值以節省訊號處理所需的計算時間與硬體需求。我們使用MPEG串流中所包含的色彩資訊,即DC值,以及動作資訊,包括動作向量以及在畫面中不同型態巨區塊比例等特徵,然後利用串場效果時間短暫、顏色變化與效果移動快速等特性,分析影片以找出可能是串場效果的片段。我們測試了以棒球為主的影片,其中包含了不同型態的串場效果。整體而言可達70%的準確度。
Watching sports videos has always been an important and popular recreation and the broadcasting of sports games takes a large portion of TV programs. With the rapid advancement of digital technologies, audiences nowadays can enjoy watching the sports games at home with their high-quality audio-visual facilities and even record the videos by using digital video recorders (DVR.) When the audiences choose to record the video for time-shift purposes, they may not be interested in watching the whole game but the video highlight parts only. The audiences may be benefited a lot if a novel DVR is developed to extract the highlights from sports videos automatically and accurately.
In the sports videos broadcasting nowadays, the highlights part are always followed by slow-motion replays. Besides, the editor usually inserts a transition effect between the normal frame and the replaying frame to inform the audiences. Therefore, the appearance of a transition effect has a direct linkage to the video highlight. In this thesis, we propose to detect transition effects for sports videos highlight extraction. In order to reduce the computational cost of hardware, the proposed method processes MPEG compressed bit-streams recorded from the DVR directly. We make use of the color information of MPEG streams, i.e., DC coefficients, and the motion information including motion vectors and the macro-block types in frames. Then we analyze to determine whether the transition effects occur by the characteristics of transition effects, which include a short period of appearance, fast color change and object moving etc. We tested several videos of baseball games with different transition effects. The experimental results demonstrate a 70% of accuracy.
[1] Xiao-Feng Tong, Qing-Shan Liu, Ling-Yu Duan, Han-Qing Lu, Chang-Sheng Xu and Qi Tian, ”A unified frame work for semantic shot representation of sports video”, the 7th ACM SIGMM international workshop on Multimedia information retrieval, pages 127-134, 2005.
[2] A. Hanjalic, “Adaptive Extraction of Highlights from a Sport Video based on Excitement Modeling”, IEEE Transactions on Multimedia, Dec. 2005.
[3] B. Li and M. I. Sezan, “Event detection and summarization in sports video”, IEEE Workshop on Content-based Access of Image and Video Libraries, pages 132-138, Dec. 2001.
[4] Z. Xiong, R. Radhakrishnan, A. Divakaran and T. S. Husang, “Highlights Extraction from Sports Video Based on an Audio-Visual Marker Detection frame work”, Jul. 2005.
[5] Si-Hun Sung and Woo-Sung Chun, “Knowledge-Based Numeric Open Caption Recognition for Live Sportscast”, Pattern Recognition, 2002. Proceedings. 16th International Conference on, volume 2, pages 822-825, 2002.
[6] Dian Tjondronegoro, Yi-Ping Phoebe Chen and Binh Pham, “Sports Video Summarization using Highlights and Play-Breaks”, The 5th International ACM Multimedia Information Retrieval Workshop, address Berkeley USA, Nov. 2003.
[7] Gu Xu, Yu-Fei Ma, Hong-Jiang Zhang and Shi-Qiang Yang, “A HMM based semantic analysis frame work for sports game event detection”, Image Processing, 2003. ICIP 2003. Proceedings. 2003 International Conference on, volume 1, Sept. 2003.
[8] Niall Rea, Rozenn Dahyot and Anil Kokaramn, “MODELING HIGH LEVEL STRUCTURE IN SPORTS WITH MOTION DRIVEN HMMS”, Acoustics, Speech, and Signal Processing, 2004. Proceedings. (ICASSP ''04). IEEE International Conference on, volume 3,
pages 621-624, May 2004.
[9] Gu Xu, Yu-Fei Ma, Hong-Jiang Zhang and Shi-Qiang Yang, “An HMM-based frame work for video semantic analysis”, Circuits and Systems for Video Technology, IEEE Transactions on, volume 4, pages 1422-1433, Nov. 2005.
[10]Chang, P., Han, M., Gong, Y.: Extract highlights from baseball game video with hidden markov models. In: Proceedings of the International Conference on Image Processing (ICIP ''02)
[11] Hao Jiang, Lie Lu and Hong-Jiang Zhang, “A Robust Audio Classification and Segmentation Method”, International Multimedia Conference; Vol. 9 Proceedings of the ninth ACM international conference on Multimedia, volume 9, pages 203-211, 2001.
[12] Yong Rui, Anoop Gupta and Alex Acero, “Automatically extracting highlights for TV Baseball programs”, International Multimedia Conference archive Proceedings of the eighth ACM international conference on Multimedia, pages 105-115, 2000.
[13]Z. Xiong, R. Radhakrishnan, A. Divakaran, and T.S. Huang, “Audio Events Detection based Highlights Extraction from Baseball, Golf and Soccer Games in A Unified Framework”, ICASSP 2003.
[14] D. Zhang and D. Ellis, "Detecting sound events in basketball video archive," Tech. Rep., Electrical Engineering Department of Columbia university, 2001.
[15] R. Radhakrishan, Z. Xiong, A. Divakaran and Y. Ishikawa , "Generation of sports highlights using a combination of supervised and unsupervised learning in audio domain, " IEEE Pacific-Rim Conference On Multimedia, Singapore, Dec 2003.
[16] Jane C. Boulton, “Two mechanisms for the detection of slow motion”, Journal of the Optical Society of America A: Optics, Image Science, and Vision, volume 4, pages 1634-1642, Aug. 1987.
[17] Vikrant Kobla, Daniel DeMenthon and David Doermann, “Detection Of Slow-Motion Replay Sequences For Identifying Sports Videos”, IEEE Workshop on Multimedia Signal Processing, 1999.
[18] Lifang Gu, Don Bone and Graham Reynolds, “Replay Detection in Sports Video Sequences”, CSIRO Mathematical and Information Sciences.
[19] Jinjun Wang, Engsiong Chng and Changsheng Xu, “Soccer replay detection using scene transition structure analysis”, volume: 2, pages: ii/433- ii/436, Mar. 2005
[20] H. Pan, P. Van Beek and M. I. Sezan, “Detection of Slow-motion Replay Segments in Sports Video for Highlights Generation”, IEEE International Conference on Acoustic, Speech and Signal Processing, 2001.
[21] Lei Wang, Xu Liu, S. Lin, Guang-You Xu and Heung-Yeung Shum, “Generic slow-motion replay detection in sports video”, Image Processing, 2004. ICIP ''04. 2004 International Conference on, volume 3, pages 1585-1588, Oct. 2004.
[22] E. J. Farn, L. H. Chen and J.H. Liou, “A new slow-motion replay extractor for soccer game videos”, International Journal of Pattern Recognition and Artificial Intelligence, volume 17, pages 1467-1481, 2003.
[23] J. Meng, Y. Juan, and S.-F. Chang. “Scene change detection in a MPEG compressed video sequence”, In IS&T/SPIE Symposium Proceedings on Electronic Imaging: Science & Technology, volume 2419, pages 14-25, Feb. 1995.
[24] G. Boccignone, M. De Santo and G. Percanella, "An algorithm for video cut detection in Mpeg sequences", Proc. SPIE, Storage and Retrieval for Media Databases, San Jose, CA, 2000.