Pillar3D-Former: A Pillar-Based 3-D Object Detection and Tracking Method for Autonomous Driving Scenes
L.G. Tao, Hai Wang, Long Chen, Yicheng Li, Yingfeng Cai
Abstract
The three dimensional (3D) object detection algorithm based on Lidar is one of the fundamental technologies for autonomous vehicle environment perception. At present, compared with the Voxel-based detector, there is still a large gap in the detection accuracy of the Pillar-based detector, especially for the detection of small targets. Therefore, in this work, we conduct research around pillar-based detectors and propose a new pillar-based 3-D detector, Pillar3D-Former. We first redesign the pillar feature encoding module and propose Global-and-Local-Enhanced Pillar Encoding (GLE-PE), which can fully extract the global and local features in the pillar. In addition, a Neck called Multi-Receptive-Feature-Aggregation (MRFA) is designed to increase receptive field of model to aggregate more features focusing on localization. Finally, considering that the Center-based method is challenging to capture the feature relationship, we naturally combine the center-based method with the transformer to eliminate the inconsistency in feature learning of the traditional two-stage detector. At the same time, we achieve a multi-object tracking algorithm with higher accuracy and robustness based on the detection algorithm by improving the data association and trajectory management strategy. The proposed model is trained and validated on the large-scale dataset nuScenes. The results demonstrate that the proposed Pillar3D-Former achieves 62.89 mean Average Precision and 69.26 nuScenes detection score, and the tracking accuracy achieves 0.698 Average Multi-Object Tracking Accuracy, which is superior to many prevalent mainstream algorithms.