| 研究生: |
邱上銘 Shang-Ming Ciou |
|---|---|
| 論文名稱: |
無人機戶外繞物巡檢之路徑規劃及飛行控制 |
| 指導教授: |
王文俊
Wen-June Wang |
| 口試委員: | |
| 學位類別: |
碩士 Master |
| 系所名稱: |
資訊電機學院 - 電機工程學系 Department of Electrical Engineering |
| 論文出版年: | 2025 |
| 畢業學年度: | 113 |
| 語文別: | 中文 |
| 論文頁數: | 88 |
| 中文關鍵詞: | 無人機 、機器人作業系統 、OpenSfM 、點雲處理 、座標轉換 、路徑規劃 、瑕疵偵測 |
| 相關次數: | 點閱:27 下載:0 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
本論文主要設計一架搭載 GPS 定位系統與單目鏡頭的無人航空載具 (UAV),針對大型物件場景進行點雲建置與外觀瑕疵檢測。為了實現這一目標,透過點雲建置、導航點設計與路徑規劃、飛行控制與高度補償,提升了無人機於戶外巡檢任務中的穩定性,以及瑕疵偵測等多項技術整合,完成對目標物件的全面檢測,同時,該方法也降低了工作人員因為攀高操作伴隨的風險。
在點雲建置部分,無人機以 Althold 或 Loiter 模式進行手動繞物飛行,並儲存帶有 GPS Exif 資訊的 RGB 影像。後續使用 OpenSFM 進行點雲建模,建立大型物件場景。同時,提出改進地面法向量厚度分析法,結合 RANSAC 移除點雲異常值,並使用 DBSCAN 聚類篩選出目標物件。最後進行主成分分析 (PCA) 將目標物件轉換至理想導航座標。在導航點設計與路徑規劃方面,分析目標物件邊框產生導航點,解決導航點銳角交錯問題,並以群心演算法進行篩選。為了取得最佳化路徑,採用模擬退火演算法 (SA) 結合貪婪演算法 (Greedy Algorithm),有效解決旅行商問題 (TSP)。此外,結合 ISS (Intrinsic Shape Signatures) 提取物件特徵點,確保無人機在繞物飛行時始終保持面向目標物件的穩定姿態。飛行控制與高度補償部分,則是使用 MobaXterm 上傳最佳路徑及飛行姿態至機載電腦,並使用 MAVROS 控制周邊設備。針對高度衰減問題,經過讀取氣壓計數據進行平滑化處理,分析高度變化趨勢,使用導航點上拉完成高度補償。此方法能分析不穩定氣壓計數據並加以判斷高度衰減趨勢。最後,針對繞物巡檢中所儲存的影像,採用 YOLOv8 網路架構進行瑕疵偵測,實驗結果顯示,大部分瑕疵檢測結果具有高信心度,能有效框選目標物件的外觀瑕疵,但部分視角仍存在瑕疵誤判情況。
The main objective of this thesis is to design an unmanned aerial vehicle (UAV) equipped with a GPS system and a monocular camera for constructing point clouds of large object scenes. After capturing the point cloud data, the system filters and corrects the objects, generates navigation points, path planning and object defect detection. The thesis aims to address major problem including navigation points transformation, UAV pose designed and defining the UAV's viewpoint. This research extends and improves upon existing UAV-based visual localization for large object detection, making it applicable to open spaces such as statues, cars ,rooftop or water tanks. The ultimate goal is to enhance performance in outdoor environments.
The contributions of this thesis include filtering the point cloud to identify primary target objects, designing navigation points, path planning and coordinate transformation of navigation points combined with the UAV's viewpoint for object inspection. Using GPS combined with a barometer compensation to improved the UAV's stability and flight endurance that during outdoor flights.
The experimental process is as follows: First, manual flight that using Althold or Loiter mode for circling. Point cloud scenes will built by processing RGB images with GPS EXIF data through OpenSfM. RANSAC is applied to process the ground data, and we propose a method to extend the ground thickness to reduce outliers. DBSCAN filters and cluster the target objects and PCA transforms them to an ideal navigation coordinate system. After obtaining the target object, navigation points are generated using the method proposed in this thesis. At the same time overlapping navigation points created by sharp angles are solved and filtered with centroid algorithm and the Traveling Salesman Problem (TSP) is solved by Simulated Annealing (SA) combined with a Greedy Algorithm. Additionally, Intrinsic Shape Signatures (ISS) are used to obtain the object's shape features that define the drone's viewpoint and orientation.After the path planning, the data is uploaded to the UAV's offboard control computer, where MAVROS is used to control peripheral devices such as altitude trending analysis, height compensation, object circling inspections, and gimbal control. Finally, during the object circling inspection, images are processed using YOLOv8 for defect detection.
[1] 戴祥印, 無人機於大型物件之自動外觀巡檢, 國立中央大學, 資訊與電機工程研究所, 碩士論文(王文俊指導), 2022年
[2] "AviationHunt," [Online]. Available: https://www.aviationhunt.com/aircraft-walk-around/
[3] 財團法人職業災害預防及重建中心," [Online]. Available: https://data.moenv.gov.tw/dataset/detail/STAT_P_126
[4] Z. Yang, W. C. Lee, H. N. Chan and M. Ge, "A Real-time Tunnel Surface Inspection System using Edge-AI on Drone," 2022 IEEE International Conference on Mechatronics and Automation (ICMA), Guilin, Guangxi, China, 2022, pp. 749-754, doi: 10.1109/ICMA54519.2022.9856230.
[5] Seo, Junwon, Luis Duque, and Jim Wacker. "Drone-enabled bridge inspection methodology and application." Automation in construction 94 (2018): 112-126.
[6] Rakha, Tarek, and Alice Gorodetsky. "Review of Unmanned Aerial System (UAS) applications in the built environment: Towards automated building inspection procedures using drones." Automation in construction 93 (2018): 252-264.
[7] Y. -P. Huang, L. Sithole and T. -T. Lee, "Structure From Motion Technique for Scene Detection Using Autonomous Drone Navigation," in IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol. 49, no. 12, pp. 2559-2570, Dec. 2019, doi: 10.1109/TSMC.2017.2745419.
[8] A. Alsawy, A. Hicks, D. Moss and S. Mckeever, "An Image Processing Based Classifier to Support Safe Dropping for Delivery-by-Drone," 2022 IEEE 5th International Conference on Image Processing Applications and Systems (IPAS), Genova, Italy, 2022, pp. 1-5, doi: 10.1109/IPAS55744.2022.10052868.
[9] A. Parmar, R. Gaiiar and N. Gajjar, "Drone based Potholes detection using Machine Learning on various Edge AI devices in Real-Time," 2023 IEEE International Symposium on Smart Electronic Systems (iSES), Ahmedabad, India, 2023, pp. 22-26, doi: 10.1109/iSES58672.2023.00016.
[10] J. Zhang, "Using Drone-Based Remote Sensing Products to Detect Land Surface Conditions in Drylands," IGARSS 2022 - 2022 IEEE International Geoscience and Remote Sensing Symposium, Kuala Lumpur, Malaysia, 2022, pp. 7421-7424, doi: 10.1109/IGARSS46834.2022.9884804.
[11] E. Titov, O. Limanovskaya, A. Lemekh and D. Volkova, "The Deep Learning Based Power Line Defect Detection System Built on Data Collected by the Cablewalker Drone," 2019 International Multi-Conference on Engineering, Computer and Information Sciences (SIBIRCON), Novosibirsk, Russia, 2019, pp. 0700-0704, doi: 10.1109/SIBIRCON48586.2019.8958397
[12] A. A. Wirabudi, L. Hafiza and N. R. Fachrurrozi, "Design Autonomous Drone Control For Delivery Package using Prim Algorithm and Waypoint Method," 2022 13th International Conference on Information and Communication Technology Convergence (ICTC), Jeju Island, Korea, Republic of, 2022, pp. 1183-1188, doi: 10.1109/ICTC55196.2022.9952874.
[13] Y. Chang and M. Jung, "Re-Routing Costs Evaluation for the Inflight Drone," 2018 International Conference on Computational Science and Computational Intelligence (CSCI), Las Vegas, NV, USA, 2018, pp. 545-548, doi: 10.1109/CSCI46756.2018.00111.
[14] Li, Zhichao, Feng Wang and Naiyan Wang. “LiDAR R-CNN: An Efficient and Universal 3D Object Detector.” 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2021): 7542-7551.
[15] C. Hui, W. Tingting, D. Zuoxiao, L. Weibin and M. I. Menhas, "Power Equipment Segmentation of 3D Point Clouds Based on Geodesic Distance with K-means Clustering," 2021 6th International Conference on Power and Renewable Energy (ICPRE),Shanghai,China,2021,pp.317-321,doi: 10.1109/ICPRE52634.2021.9635211.
[16] G. Wang, Q. Wang, R. Zhao, C. Chen and Y. Lu, "Building Segmentation of UAV-based Oblique Photography Point Cloud Using DoPP and DBSCAN," 2022 3rd International Conference on Geology, Mapping and Remote Sensing (ICGMRS), Zhoushan, China, 2022, pp. 233-236, doi: 10.1109/ICGMRS55602.2022.9849376.
[17] H. Yan, Z. Yuhang, H. Haobing and C. Pengju, "Research on Application of SLAM in Appearance Inspection of Civil Aviation Aircraft," 2022 2nd International Conference on Big Data Engineering and Education (BDEE), Chengdu, China, 2022, pp. 168-172, doi: 10.1109/BDEE55929.2022.00035.
[18] Y. Liu, J. Dong, Y. Li, X. Gong and J. Wang, "A UAV-Based Aircraft Surface Defect Inspection System via External Constraints and Deep Learning," in IEEE Transactions on Instrumentation and Measurement, vol. 71, pp. 1-15, 2022, Art no. 5019315, doi: 10.1109/TIM.2022.3198713.
[19] D. Jia, C. Hu, K. Qin and X. Cui, "Planar Waypoint Generation and Path Finding in Dynamic Environment," 2014 International Conference on Identification, Information and Knowledge in the Internet of Things, Beijing, China, 2014, pp. 206-211, doi: 10.1109/IIKI.2014.49.
[20] S. Lopez-Soriano, "“Plug-and-Play” Inventory Robots: Autonomous Itinerary Planning Through Autonomous Waypoint Generation," in IEEE Internet of Things Journal, vol. 11, no. 1, pp. 1711-1718, 1 Jan.1, 2024, doi: 10.1109/JIOT.2023.3290395.
[21] B. H. -Y. Lee, J. R. Morrison and R. Sharma, "Multi-UAV control testbed for persistent UAV presence: ROS GPS waypoint tracking package and centralized task allocation capability," 2017 International Conference on Unmanned Aircraft Systems (ICUAS), Miami, FL, USA, 2017, pp. 1742-1750, doi: 10.1109/ICUAS.2017.7991424.
[22] “Mission Planner” [Online].Available:https://ardupilot.org/planner/ ,2024年12月
[23] “Ardupilot Measuring Vibration”:
[Online].Available:https://ardupilot.org/planner/docs/common-measuring-vibration.html,2024年12月
[24] “QM-MOTOR 4208 KV380 datasheet”
[Online]Available:https://www.qx-motor.net/products/qx-motor-qm4208-380kv-brushless-motor-accessories-for-rc-multirotor-quadcopter-hexa-drone?srsltid=AfmBOorkU9CSSu7n3NPMrWy8-14ZJZOPVB7k-6ASxoLHm9QQBJIjOrl3,2024年12月
[25] “Futaba RS3008SB datasheet”
[Online]Available:
https://www.tw-futaba.com.tw/Portals/0/FTB_Product/RC/Files/RX/R3008SB.pdf,2024年12月
[26] “HEX Pixhawk Cube Orange overview”
[Online]Available:
https://ardupilot.org/copter/docs/common-thecubeorange-overview.html,2024年12月
[27] C. Ma, Y. Zhou and Z. Li, "A New Simulation Environment Based on Airsim, ROS, and PX4 for Quadcopter Aircrafts," 2020 6th International Conference on Control, Automation and Robotics (ICCAR), Singapore, 2020, pp. 486-490, doi: 10.1109/ICCAR49639.2020.9108103.
[28] “MAVROS”[Online ] Available: https://github.com/mavlink/mavros,2024年12月
[29] “Unreal Engine”
[Online]Available:https://www.unrealengine.com/en-US,2024年12月
[30] “AirSim”
[Online]Available:https://microsoft.github.io/AirSim/,2024年12月
[31] Shah, Shital, et al. "Airsim: High-fidelity visual and physical simulation for autonomous vehicles." Field and Service Robotics: Results of the 11th International Conference. Springer International Publishing, 2018.
[32] ”Ardupilot SITL Simulator,”
[Online].Available : https://ardupilot.org/dev/docs/sitl-simulator-software-in-the-loop.html,2024年11月
[33] ”Open3D Voxel DownSampling,”
[Online].Available : https://www.open3d.org/docs/0.6.0/python_api/open3d.geometry.voxel_down_sample.html,2024年11月
[34] ”Open3D RANSAC,”
[Online].Available : https://www.open3d.org/docs/latest/tutorial/pipelines/global_registration.html,2024年11月
[35] ”Open3D DBSCAN,”
[Online].Available : https://www.open3d.org/docs/latest/tutorial/Basic/pointcloud.html
,2024年11月
[36] ”Open3D ISS points,”
[Online].Available : https://www.open3d.org/docs/latest/tutorial/Advanced/iss_keypoint_detector.html,2024年11月
[37] R. Varghese and S. M., "YOLOv8: A Novel Object Detection Algorithm with Enhanced Performance and Robustness," 2024 International Conference on Advances in Data Engineering and Intelligent Computing Systems (ADICS), Chennai, India, 2024, pp. 1-6, doi: 10.1109/ADICS58448.2024.10533619.
[38] ”Ultralytics YOLOv8,”
[Online].Available : https://docs.ultralytics.com/zh/models/yolov8/
,2024年12月