Multiple Source Domain Adaptation for Multiple Object Tracking in Satellite Video
Xiangtao Zheng, Haowen Cui, Xiaoqiang Lu
Abstract
Satellite videos capture the dynamic changes in a large observed sense, which provides an opportunity to track the object trajectories. However, existing multiple object tracking methods require massive video annotations, which is time-consuming and fallible. To alleviate this problem, this paper proposes a Cross-Domain multiple object Tracker (CDTrack) to learn knowledge from multiple source domains. First, a cross-domain object detector with multi-level domain alignment is constructed to learn domain-invariant knowledge between remote sensing images and satellite videos. Second, the proposed method adopts a bidirectional teacher-student framework to fuse multiple source domains. Two teacher-student models learn different domain knowledge and teach mutually each other. With mutual learning, the proposed method alleviates the discrepancies between different domains. Finally, a simple weakly supervised re-identification model is proposed for long-term association. Experimental results on the satellite video datasets demonstrate that the proposed method can achieve great performance without satellite video annotations. The code is available at https://github.com/XiangtaoZheng/CDTrack.