Leveraging Deep Convolutional Neural Networks Pre-Trained on Autonomous Driving Data for Vehicle Detection From Roadside LiDAR Data

Abstract

Recent technological advancements in computer vision algorithms and data acquisition devices have greatly facilitated the research and applications of deep learning-based traffic object recognition from Light Detection and Ranging (LiDAR) data. The majority of existing methodologies applied deep learning (DL)-based techniques, especially Convolutional Neural Networks (CNNs), for vehicle detection and tracking on autonomous driving datasets. Nevertheless, fewer studies were focused on DL-based vehicle detection using roadside LiDAR data, partially due to the lack of publicly available roadside LiDAR datasets for network training and testing. This paper develops a novel framework based on CNNs and LiDAR data for automated vehicle detection. It leverages the domain knowledge of CNNs trained on large-scale autonomous driving datasets for vehicle detection from roadside LiDAR data. In the experimental study, roadside LiDAR data were collected at a road intersection in Reno, Nevada, U.S. Meanwhile, a CNN architecture was proposed to detect vehicles from LiDAR data through 3D bounding boxes. The proposed CNN was modified from the established PointPillars network by adding dense connections to the convolutional layers to achieve more comprehensive feature extraction. Three CNNs, including the proposed CNN, PointPillars, and YOLOv4, were trained and tested on PandaSet, a publicly available large-scale autonomous driving LiDAR dataset. Subsequently, the trained CNNs were reused for vehicle detection from the captured roadside LiDAR data. The experimental results demonstrated that the proposed CNN outperformed the others in the testing metrics. All three networks showed good performance on vehicle detection from the captured roadside LiDAR data.

Topics & Concepts