道路交通事故的部分因素是因為車輛行進中沒有看到障礙物而發生的，尤其是車體結構與後照鏡角度造成的盲點區域，使得駕駛無法了解車輛週遭環境而造成人員與車輛損傷。為避免看不到車輛週遭環境而造成的交通意外，並提高停車時的安全性。我們提出一套全周俯瞰監視與偵測系統，並將之實現於DSP嵌入式系統中。整個系統共包含兩大部份：一是全周俯瞰監視用於輔助駕駛監視車輛周遭的狀況，二是側邊偵測用於協助駕駛主動偵測車輛周遭的障礙物。
全周俯瞰監視與偵測系統在車輛四周架設廣角相機以拍攝車輛週遭影像，經過離線處理扭曲校正、暗角消除、俯瞰轉換後，得到四周俯瞰影像的相對關係。再使用一部相機由上方拍攝車輛四周的特徵，將俯瞰影像快速對位為一張俯視車輛週遭的全周俯瞰影像，最後將各項參數建立一張查找表，在線上處理階段根據查找表查表內插與校正影像。動態側邊偵測系統則是以側邊影像估計光流，藉由光流濾除及群聚後，擷取障礙物主動提示駕駛者。
嵌入式全周俯瞰監視系統可在影像的解析度為720 × 480的情況下，於Texas Instruments? DaVinci™ DM648 900 MHz Digital Media Processor開發板上執行可達每秒10張的處理速度。而側邊障礙物偵測程序可在影像顯示大小為320 × 240的情況下，在Intel Core™2 Duo 2.83GHz及1.99GB RAM的個人電腦上可達每秒22張，障礙物偵測率可達94%。

Partial traffic accidents are resulted from drivers can’t watch the whole vehicle surroundings. To reduce the accidents caused by collision of surrounding obstacles, we mount four wide-angle cameras at the front, rear, and both lateral of the vehicle to capture consecutive images; then we present a real-time surrounding top-view monitor and a lateral obstacle detection system for parking assistance.
In offline steps of surrounding top-view monitor system, we first estimate camera intrinsic and extrinsic parameters, and also calibrate the parameters of distortion model and vignetting model for distortion correction and vignetting compensation. Then we calibrate the geometric relationships of four cameras using a proposed multi-camera calibration method. Third, we calculate the feathering weights of pixels to produce a seamless surrounding top-view image. At last, we build lookup tables for recording the mapping between the captured images and the surrounding synthesized image to speed up the processing. After offline steps, our system online interpolate and calibrate the surrounding synthesized image by those lookup tables directly.
In lateral obstacle detection system, we utilize the calibrated lateral images to estimate the optical flow of possible obstacles. Then we filter and group the non-ground optical flow by direction of motion vectors and color of feature pixels. Third, we determine whether the optical-flow groups are obstacle or not. Finally, the detection system will alarm if there is an obstacle to be collided by the vehicle. In our experiment, the system detection rate is about 94%.

[1] Bertozzi, M. and A. Broggi, "GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection," IEEE Trans. on Image Processing, vol.7, no.1, pp.62-81, 1998.
[2] Bertozzi, M., A. Broggi, P. Medici, P. P. Porta, and A. Sjogren, "Stereo vision-based start-inhibit for heavy goods vehicles," in Proc. IEEE Intelligent Vehicles Symposium, Tokyo, Japan, Jun.13-15, 2006, pp.350-355.
[3] Bruss, A. R. and B. K. P. Horn, "Passive navigation," Computer Vision, Graphics, and Image Processing, vol.21, no.1, pp.3-20, 1983.
[4] Devernay, F. and O. Faugeras, "Straight lines have to be straight," Machine Vision and Applications, vol.13, no.1, pp.14-24, 2001.
[5] Ehlgen, T. and T. Pajdla, "Monitoring surrounding areas of truck-trailer combinations," in Proc. 5th Int. Conf. on Computer Vision Systems, Bielefeld, Germany, Mar.21-24, 2007, CD-ROM.
[6] Ehlgen, T., M. Thorn, and M. Glaser, "Omnidirectional cameras as backing-up aid," in Proc. IEEE 11th Int. Conf. on Computer Vision, Rio de Janeiro, Brazil, Oct.14-20, 2007, pp.1-5.
[7] Enkelmann, W., "Obstacle detection by evaluation of optical flow fields from image sequences," Image and Vision Computing, vol.9, no.3, pp.160-168, 1991.
[8] Fujitsu, 360-Degree Wrap-around Video Imaging Technology, in http://www.fujitsu.com/us/news/pr/fma_20101019-02.html
[9] Gandhi, T. and M. M. Trivedi, "Parametric ego-motion estimation for vehicle surround analysis using an omnidirectional camera," Machine Vision and Applications, vol.16, no.2, pp.85-95, 2005.
[10] Gandhi, T. and M. M. Trivedi, "Vehicle surround capture: survey of techniques and a novel omni-video-based approach for dynamic panoramic surround maps," IEEE Trans. on Intelligent Transportation Systems, vol.7, no.3, pp.293-308, 2006.
[11] Hartley, R. and A. Zisserman, Multiple View Geometry in Computer Vision, 2nd Edition, Cambridge University Press, 2004.
[12] Hartley, R. and S. B. Kang, "Parameter-free radial distortion correction with center of distortion estimation," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol.29, no.8, pp.1309-1321, 2007.
[13] Hoiem, D., A. A. Efros, and M. Hebert, "Putting objects in perspective," Int. Journal of Computer Vision, vol.80, no.1, pp.3-15, 2008.
[14] Honda, Multi-view Camera System, in http://world.honda.com/news/2008/4080918Multi-View-Camera-System/
[15] Jung, H.-G., D.-S. Kim, P.-J. Yoon, and J. Kim, "Parking slot markings recognition for automatic parking assist system," in Proc. IEEE Intelligent Vehicles Symp., Tokyo, Japan, Jun.13-15, 2006, pp.106-113.
[16] Kang, S. B. and R. S. Weiss, "Can we calibrate a camera using an image of a flat, textureless lambertian surface?," in Proc. 6th European Conf. on Computer Vision, Dublin, Ireland, Jun.26-Jul.1, 2000, pp.640-653.
[17] Leibe, B., A. Leonardis, and B. Schiele, "Combined object categorization and segmentation with an implicit shape model," in Proc. ECCV Workshop on Statistical Learning in Computer Vision, Prague, Czech Republic, May.15, 2004.
[18] Leibe, B., A. Leonardis, and B. Schiele, "Robust object detection with interleaved categorization and segmentation," Int. Journal of Computer Vision, vol.77, no.1-3, pp.259-289, 2008.
[19] Liu, Y. C., K. Y. Lin, and Y. S. Chen, "Bird''s-eye view vision system for vehicle surrounding monitoring," in Proc. Robot Vision, Berlin, Germany, Feb.20-22, 2008, pp.207-218.
[20] Lucas, B. D. and T. Kanade, "An iterative image registration technique with an application to stereo vision," in Proc. 7th Int. Joint Conf. on Artificial Intelligence, Vancouver, Canada, 1981, pp.674-679.
[21] Marquardt, D., "An algorithm for least-squares estimation of nonlinear parameters," SIAM Journal on Applied Mathematics, vol.11, pp.431-441, 1963.
[22] Nissan, Around View Monitor, in http://www.nissan-global.com/EN/TECHNOLOGY/INTRODUCTION/DETAILS/AVM/
[23] Ogale, A. S., C. Fermuller, and Y. Aloimonos, "Motion segmentation using occlusions," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol.27, no.6, pp.988-992, 2005.
[24] Oniga, F. and S. Nedevschi, "Processing dense stereo data using elevation maps: road surface, traffic isle, and obstacle detection," IEEE Trans. on Vehicular Technology, vol.59, no.3, pp.1172-1182, 2010.
[25] Rosten, E. and T. Drummond, "Fusing points and lines for high performance tracking," in Proc. 10th IEEE Int. Conf. on Computer Vision, Beijing, Oct.17-20, 2005, pp.1508-1515.
[26] Rosten, E., R. Porter, and T. Drummond, "Faster and better: a machine learning approach to corner detection," IEEE Trans. on Pattern Analysis and Machine Intelligence, 2009.
[27] Saxena, A., S. H. Chung, and A. Y. Ng, "3-D depth reconstruction from a single still image," Int. Journal of Computer Vision, vol.76, no.1, pp.53-69, 2008.
[28] Sotelo, M. A., J. Barriga, D. Fernandez, I. Parra, J. E. Naranjo, M. Marron, S. Alvarez, and M. Gavilan, "Vision-based blind spot detection using optical flow," Lecture Notes in Computer Science, vol.4739, pp.1113-1118, 2007.
[29] Texas Instruments, TMS320DM647/TMS320DM648 Digital Media Processor, in http://focus.ti.com/lit/ds/symlink/tms320dm648.pdf
[30] Texas Instruments, TMS320C64x+ DSP Cache User''s Guide, in http://focus.ti.com/lit/ug/spru862b/spru862b.pdf
[31] Texas Instruments, TMS320C6000 Code Composer Studio Tutorial, in http://focus.ti.com.cn/cn/lit/ug/spru301c/spru301c.pdf
[32] Texas Instruments, TMS320C6000 Optimizing Compiler v 7.2 User''s Guide, in http://focus.ti.com/lit/ug/spru187s/spru187s.pdf
[33] Texas Instruments, Common Object File Format, in http://focus.ti.com/lit/an/spraao8/spraao8.pdf
[34] Texas Instruments, TMS320C64x/C64x+ DSP CPU and Instruction Set Reference Guide, in http://focus.ti.com/lit/ug/spru732j/spru732j.pdf
[35] Tomasi, C. and R. Manduchi, "Bilateral filtering for gray and color images," in Proc. 6th IEEE Int. Conf. on Computer Vision, Bombay, India, Jan.4-7, 1998, pp.839-846.
[36] Wang, J., G. Bebis, and R. Miller, "Overtaking vehicle detection using dynamic and quasi-static background modeling," in Proc. IEEE Conf. on Computer Vision and Pattern Recognition, San Diego, CA, Jun.20-26, 2005, pp.64-71.
[37] Zhang, Z., "A flexible new technique for camera calibration," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol.22, no.11, pp.1330-1334, 2000.