Target-Distractor Aware UAV Tracking via Global Agent

Abstract

Object tracking is a basic task of the uncrewed aerial vehicle (UAV)-based intelligent visual perception system. The presence of similar targets and complex backgrounds in the airborne perspective poses significant challenges to aerial trackers. However, existing target-aware or distractor-aware trackers fail to capture discriminative cues from both target and background information in a balanced manner, resulting in limited improvement. To address these issues, this paper proposes a global agent-based Target-Distractor Aware Tracker (TDAT) to enhance the discrimination of the target. TDAT comprises two effective modules: a global agent generator and an interactor. First, the generator aggregates the target and background regions into representative agents and then performs self-attention on these agents to explicitly model the global relationships between the target and backgrounds. Next, the interactor realizes the bidirectional information interaction between global agents and local regions via self-attention. Based on the global dependencies encoded in global agents, the interactor extracts target-oriented features and enhances the understanding of the target. TDAT embedded with target-distractor awareness effectively widens the gap between target and background distractors. Experimental results on multiple UAV benchmarks show that TDAT achieves outstanding performance with a speed of 34.5 frames/s. The code is available at https://github.com/xyl-507/TDAT

Topics & Concepts