Debris Pattern Recognition Based on Visual Sensor and Image Stitching Technology

Abstract

In this study, we applied multiple unmanned aerial vehicles (UAVs) and visual sensors with deep learning neural networks, You Only Look Once (YOLO), to quickly and effectively recognize significant areas of debris. Information on debris locations, area sizes, and images is sent to the monitoring system. Then, the debris distribution is analyzed, and the source of the debris can be found. The pattern recognition process uses a variety of feature detection methods, description, and point matching for real-time image stitching of the scene. The UAVs can obtain large-area scene images and check whether undetected debris exists. A comparison with different YOLO models is given. The effects of debris recognition and the consequences of various types of data and image stitching during the image stitching process are applied to analyze the real-time image stitching effects by different methods.