CCLDet: A Cross-Modality and Cross-Domain Low-Light Detector

Abstract

Vehicle detection based on remote sensing images is widely used in urban traffic management and disaster rescue. RGB images, which are used more, lead to poor detection performance in low light conditions due to the imaging mechanism. At present, the main solution is to improve the detection performance in low light by fusing with infrared images. However, the current methods often overlook the impact of illumination changes on RGB images, and ignore the important role of high-frequency information for object detection, especially for low-light target detection. In this paper, we propose a Cross-modality and Cross-domain Low-light Detector (CCLDet) for low-light vehicle detection, including three improvements. First, an object illumination-aware module (OIAM) is proposed, which can adjust adaptively the weight of different modalities according to the object illumination intensity in the training phase and enables the detector to adapt to different lighting conditions. Second, we propose a visibility loss, which converts the position deviation into the illumination intensity deviation of each point in the object area. Compared with relying only on semantic information for object localization, the illumination makes the information that can be used for localization more abundant. Third, we design a cross-domain feature fusion module (CDFFM), which can enhance high-frequency features and enrich target information when low-frequency features are lost due to low light pollution. Extensive experiments on three challenging RGB-infrared objects detection datasets demonstrated the mAP and the parameter quantities of CCLDet over popular object detectors.

Topics & Concepts