Robust Drogue Positioning System Based on Detection and Tracking for Autonomous Aerial Refueling of UAVs

Abstract

In modern war, endurance mileage and combat radius are important factors for the combat effectiveness of military aircraft. However, the existing aerial refueling schemes mainly use manual docking operations and complex conditions require pilots to have high operating skills. Therefore, this work proposes a visual positioning system for autonomous aerial refueling without adding cooperation marks, which mainly includes a dynamic graph convolution module for drogue detection and a kernel correlation filter for drogue tracking. Firstly, a dynamic GCN module is designed to generate the correlation matrix to aggregate adjacent high-order features and fuse them with global features extracted from the CNN stream to achieve accurate drogue detection. Then, the multi-scale features extracted from the drogue detector network and the HOG features are input to the filter learning module together, and weighted response maps are fused to alleviate the occlusion and scale change problems in the tracking process. In addition, a visual positioning scheme combining a drogue detector and tracker is introduced to output an accurate drogue ROI area. The effectiveness and robustness of the proposed work are verified by comparison with the mainstream methods on COCO detection datasets and real aerial refueling datasets <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Note to Practitioners</i> —For probe-and-drogue refueling, the combination of autonomous aerial refueling technology and machine vision technology can improve the real-time and robustness of autonomous refueling docking system in complex aerial visual scenes. Therefore, this work studies the accurate recognition of drogue detection and real-time drogue tracking. In addition, a drogue ROI positioning system is also designed. Experiments on public datasets and real refueling scenarios validate the feasibility and effectiveness of the proposed work, which has good application potential in refueling scenes and can provide decision-making for autonomous refueling and manual docking refueling of UAVs.

Topics & Concepts