Deep Enhancement-Object Features Fusion for Low-Light Object Detection
Wan Teng Lim, Kelvin Ang, Yuen Peng Loh
Abstract
With the robust development of deep learning, object detection has gained much attention for practical use cases such as in autonomous driving and surveillance. However, the task is still challenging to the state-of-the-arts in low-light. Consequently, image enhancement has become a common pre-processing step in the pipeline for object detection in low-light environments. Nonetheless, such two-step approach hinges on the reconstruction of the enhanced image which could introduce unseen artifacts and distortion that deteriorates the detection performance instead. Thus, this work proposes a deep enhancement-object features fusion approach to alleviate the problem by infusing deep features extracted from low-light image enhancement with the deep object features of a detection model. It is postulated that features learned by enhancement models emphasizes visual details which were otherwise disregarded by detection models that focus on the abstract appearance of objects. Hence, the fusion of such complementary features would compensate for the details lost due to low-visibility as well as circumvent the reconstruction error for better detection. Specifically, this work performs a study on fusing deep enhancement features from the state-of-the-art Deep Lightening Network (DLN) with the Yolov5 object detection model at various stages. Experiments on the ExDARK dataset showed that such fusion can improve the precision of object detection in various low-light image conditions and outperforms the conventional two-step pre-process-then-detect approach.